-- Logs begin at Wed 2022-08-24 04:10:22 UTC, end at Wed 2022-08-24 05:52:17 UTC. -- Aug 24 04:45:35.902550 dv-cinder-854266-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 04:45:35.911084 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 04:45:35.913028 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 04:45:35 2022] *** Aug 24 04:45:35.913028 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 04:45:35.913028 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 04:45:35.913028 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: nodename: dv-cinder-854266-1-iscsi Aug 24 04:45:35.913028 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: machine: x86_64 Aug 24 04:45:35.913028 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: clock source: unix Aug 24 04:45:35.913028 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: pcre jit disabled Aug 24 04:45:35.913028 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: detected number of CPU cores: 4 Aug 24 04:45:35.913028 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: current working directory: / Aug 24 04:45:35.913028 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: detected binary path: /usr/bin/uwsgi-core Aug 24 04:45:35.913771 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: your processes number limit is 47680 Aug 24 04:45:35.913771 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: your memory page size is 4096 bytes Aug 24 04:45:35.913771 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: detected max file descriptor number: 2048 Aug 24 04:45:35.913771 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: lock engine: pthread robust mutexes Aug 24 04:45:35.913771 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: thunder lock: enabled Aug 24 04:45:35.913771 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 04:45:35.913771 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 04:45:35.952432 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: Python main interpreter initialized at 0x55bb94ac69c0 Aug 24 04:45:35.952432 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: python threads support enabled Aug 24 04:45:35.952432 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: your server socket listen backlog is limited to 100 connections Aug 24 04:45:35.952432 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: your mercy for graceful operations on workers is 90 seconds Aug 24 04:45:35.952765 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 04:45:35.952847 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: *** Operational MODE: preforking *** Aug 24 04:45:35.953092 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: *** uWSGI is running in multiple interpreter mode *** Aug 24 04:45:35.953092 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: spawned uWSGI master process (pid: 105523) Aug 24 04:45:35.953273 dv-cinder-854266-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 04:45:35.953800 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: spawned uWSGI worker 1 (pid: 105524, cores: 1) Aug 24 04:45:35.954135 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: spawned uWSGI worker 2 (pid: 105525, cores: 1) Aug 24 04:45:35.954293 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 04:45:36.617821 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:45:36.618416 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:45:37.704321 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:45:37.704321 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: from cryptography.utils import int_from_bytes Aug 24 04:45:37.704921 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:45:37.704921 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: from cryptography.utils import int_from_bytes Aug 24 04:45:37.709232 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:45:37.709232 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: from cryptography.utils import int_from_bytes Aug 24 04:45:37.709661 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:45:37.709661 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: from cryptography.utils import int_from_bytes Aug 24 04:45:40.210333 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:45:40.210896 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:45:40.211125 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:45:40.211486 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:45:40.211742 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:45:40.212127 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.212451 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.212773 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.213092 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.213420 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.213517 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:45:40.213900 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:45:40.213980 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.214160 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.214493 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.214603 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:45:40.214841 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.214944 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:45:40.215105 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.215193 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:45:40.215421 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.215566 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.215746 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-1-iscsi {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.215896 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.216066 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.216221 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.216372 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.216540 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.216683 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.216870 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.216998 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.217182 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.217301 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.217502 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.217622 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.217822 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.217935 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.218151 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.218412 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.218504 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.218746 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.218885 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.219067 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-1-iscsi {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.219198 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.219397 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.219521 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.219706 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.219837 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.220015 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.220148 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.220334 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.220471 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.220636 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.220779 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.220963 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.221095 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.221270 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.221418 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.221587 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.221764 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.221990 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-1-iscsi {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.222127 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.222293 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.222429 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.222605 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.222747 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.222947 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.223082 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.223330 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.223464 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.223640 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.223766 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.223946 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.224070 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.224255 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.224393 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.224605 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.224742 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.224865 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.225005 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.225184 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.225311 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-1-iscsi {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.225503 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.225632 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.225821 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.225949 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.226140 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.226275 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.226493 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.226629 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.226863 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.226996 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.227127 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.227259 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.227391 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.227517 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.227647 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.227778 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.227940 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.228074 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.228221 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.228384 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.228516 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.228706 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.228833 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.229027 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.229156 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.229348 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.230053 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.230263 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.230391 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.230524 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.230658 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.230838 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.230964 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.231147 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.231285 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.231457 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.231595 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.231765 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.231894 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.232096 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.232246 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.232378 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.232507 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.232662 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.232789 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.232967 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.233103 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.233272 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.233399 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.233523 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.233651 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.233788 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.233914 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.234083 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.234209 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.234406 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.234540 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.234771 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.234908 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.235031 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.235166 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.235335 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.235508 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.235644 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.235768 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.235938 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.236066 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.236245 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.236551 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.236685 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.236859 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.236987 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.237179 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.237315 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.237494 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.237621 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.237814 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.237948 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.238122 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.238258 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.238440 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.238565 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.238782 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.238923 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.239097 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.239237 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.239397 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.239523 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.239654 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.239786 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.239918 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.240053 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.240217 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.240362 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.240535 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.240669 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.240840 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.240968 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.241179 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.241325 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.241451 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.241718 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.241859 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.241989 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.242111 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.242317 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.242444 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.242574 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.242737 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.242864 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.242999 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.243132 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.243264 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.243401 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.243533 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.243657 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.243787 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.243911 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.244044 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.244177 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.244331 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.244458 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.244647 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.244775 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.244977 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.245752 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.245887 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.246050 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.246189 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.246313 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.246436 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.246567 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.246721 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.246848 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.247044 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.247186 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.247348 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.247487 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.247653 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.247781 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.247971 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.248099 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.248276 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.248412 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.248583 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.248710 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.248900 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.249028 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.249203 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.249339 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.249504 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.249636 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.249806 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.249942 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.250106 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.250241 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.250410 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.250538 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.250741 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.250886 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.251048 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.251191 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.251352 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.251488 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.251656 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.251784 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.251960 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.252094 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.252259 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.252463 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.252588 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.252710 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.252839 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.252961 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.253139 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.253264 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.253437 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.253564 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.253763 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.253886 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.254054 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.254178 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.254359 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.254482 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.254660 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.254804 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.255020 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.255156 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.255280 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.255416 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.255574 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.255702 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.255881 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.256009 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.256185 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.256321 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.256488 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.256616 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.256787 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.256916 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.257105 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.257245 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.257425 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.257552 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.257733 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.257860 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.258039 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.258168 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.258346 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.258473 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.258667 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:45:40.258819 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.259019 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.259154 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.259332 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.259460 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.259648 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.259775 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.259965 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.260093 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.260294 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.260421 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.260608 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.260736 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.260957 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.261092 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.261274 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.261434 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.261582 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.261751 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.261901 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.262066 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.262203 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.262395 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.262614 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.262762 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.262900 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.263030 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.263159 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.263367 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.263493 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.263711 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.263838 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.264025 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.264160 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.264348 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.264486 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.264666 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.264791 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.264975 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.265112 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.265301 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.265428 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.265582 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.265710 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.265902 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.266037 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.266212 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.266348 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.266525 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.266652 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.266857 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.266995 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.267167 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.267309 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.267476 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.267605 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.267783 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.267912 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.268102 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.268237 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.268399 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.268530 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.268720 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.268846 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.269032 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.269167 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.269345 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.269487 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.269656 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.269782 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.269968 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.270107 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.270278 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.270414 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.270584 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.270725 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.270918 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.271057 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.271221 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.271355 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.271524 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.271652 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.271826 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.271955 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.272134 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.272261 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.272437 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.272588 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.272793 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.272922 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.273066 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.273205 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.273371 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.273499 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.273679 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.273815 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.273990 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.274119 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.274299 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.274440 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.274605 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.274751 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.274934 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.275075 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.275236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.275449 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.275577 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.275699 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.275823 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.275953 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.276131 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.276339 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.276476 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.276600 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.276793 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.276922 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.277101 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.277242 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.277415 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.277543 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.277717 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.277844 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.278021 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.278158 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.278324 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.278459 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.278637 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.278817 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.278955 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.279081 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.279265 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.279391 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.279571 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.279697 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.279888 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.280015 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.280194 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.280328 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.280504 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.280694 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.280826 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.280956 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.281089 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.281213 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.281400 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.281527 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.281713 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.281842 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.282023 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.282151 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.282331 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.282468 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.282645 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.282819 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.283012 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.283140 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.283263 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.283405 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.283556 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.283692 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.283858 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.283999 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.284165 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.284303 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.284466 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.284595 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.284770 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.284898 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.285073 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.285214 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.285375 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.285580 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.285716 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.285841 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.285978 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.286114 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.286278 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.286414 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.286787 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.286896 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.287033 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.287160 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.287284 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.287407 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.287529 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.287652 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.287783 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.287917 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.288094 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.288221 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.288399 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.288527 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.288704 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.288833 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.289026 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.289154 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.289339 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.289475 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.289645 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.289773 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.289949 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.290085 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.290505 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.290647 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.290876 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.291004 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.291183 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.291310 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.291507 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.291646 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.291818 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.292446 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.292688 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.292815 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.293072 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.293220 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.293345 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.293480 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.293606 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.293729 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.293925 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.294055 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.294230 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.294358 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.294544 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.294701 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.294913 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.295048 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.295236 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.295364 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.295560 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.295753 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.295889 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.296020 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.296165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.296293 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.296476 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.296602 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.296784 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.296913 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.297094 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.297221 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.297397 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.297523 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.297703 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.297831 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.298020 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.298155 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.298328 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.298465 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.298647 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.298839 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.298964 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.299088 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.299287 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.299433 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.299595 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.299723 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.299901 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.300026 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.300201 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.300339 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.300511 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.300636 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.300821 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.300948 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.301140 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.301277 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.301445 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.301570 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.301755 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.301883 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.302060 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.302187 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.302369 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.302502 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.302677 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.302834 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.303007 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.303151 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.303339 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.303463 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.303591 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.303712 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.303894 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.304027 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.304206 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.304335 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.304515 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.304651 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.304826 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.304956 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.305130 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.305258 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.305443 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.305646 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.305787 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.305973 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.306100 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.306233 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.306358 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.306490 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.306614 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.306785 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.306947 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.307084 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.307256 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.307393 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.307585 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.308203 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.308471 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.308650 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.308787 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.309027 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.309156 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.309341 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.309469 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.309671 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.309796 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.309977 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.310113 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.310283 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.310409 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.310591 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.310749 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.310924 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.311117 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.311243 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.311364 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.311555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.311695 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.311858 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.311982 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.312161 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.312284 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.312482 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.312625 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.312790 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.312914 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.313095 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.313219 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.313422 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.313569 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.313696 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.313818 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.314011 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.314148 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.314324 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.314465 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.314626 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.314796 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.314960 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.315088 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.315271 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.315400 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.315577 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.315712 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.315883 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.316092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.316230 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.316353 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.316484 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.316607 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.316795 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.316921 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.317099 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.317226 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.317403 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.317532 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.317711 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.317845 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.318022 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.318155 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.318332 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.318587 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.318744 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.318943 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.319073 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.319258 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.319386 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.319569 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.319694 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.319878 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.320007 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.320180 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.320315 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.320492 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.320619 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.320809 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.320938 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.321141 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.321507 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.321659 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.321786 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.321919 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.322054 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.322179 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.322309 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.322433 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.322616 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.322856 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.322986 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.323109 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.323305 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.323442 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.323649 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.323784 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.323957 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.324096 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.324265 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.324394 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.324575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.324703 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.324884 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.325014 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.325193 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.325321 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.325505 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.325632 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.325805 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.325933 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.326147 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.326281 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.326405 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.326526 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.326724 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.326854 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.327035 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.327175 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.327336 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.327463 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.327639 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.327768 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.327940 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.328066 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.328256 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.328392 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.328561 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.328696 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.328873 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.329001 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.329178 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.329319 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.329501 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.329629 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.329810 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.329938 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.330115 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.330322 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.330450 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.330573 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.330745 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.330870 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.331039 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.331180 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.331345 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.331473 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.331655 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.331790 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.331962 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.332092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.332264 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.332392 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.332573 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.332701 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.332881 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.333053 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.333180 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.333303 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.333483 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.333633 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.333833 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.333959 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.334080 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.334208 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.334362 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.334500 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.334677 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.334826 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.335002 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.335134 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.335303 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.335436 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.335606 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.335731 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.335912 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.336042 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.336254 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.336405 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.336539 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.336665 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.336789 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.336910 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.337092 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.337228 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.337402 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.337536 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.337701 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.337836 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.338003 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.338139 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.338303 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.338430 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.338614 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.338758 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.339010 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.339149 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.339320 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.339497 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.339784 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.339912 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.340098 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.340234 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.340406 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.340535 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.340711 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.340837 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.341018 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.341147 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.341322 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.341439 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.341626 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.341762 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.341933 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.342060 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.342241 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.342375 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.342557 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.342732 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.342887 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.343015 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.343194 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.343332 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.343494 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.343629 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.343874 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.344021 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.344146 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.344269 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.344392 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.344524 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.344696 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.344828 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.344976 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.345105 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.345276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.345413 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.345576 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.345704 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.345876 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.346005 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.346166 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.346313 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.346511 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.346647 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.346795 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.346919 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.347080 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.347217 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.347379 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.347520 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.347682 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.347816 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.347986 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.348120 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.348289 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.348417 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.348593 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.348721 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.348917 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.349046 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.349227 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.349363 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.349532 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.349674 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.349838 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.349965 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.350142 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.350277 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.350443 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.350583 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.350793 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.350935 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.351103 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.351232 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.351416 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.351545 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.351717 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.351852 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.352020 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.352156 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.352340 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.352478 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.352649 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.352777 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.352957 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.353092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.353259 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.353395 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.353576 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.353703 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.353886 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.354089 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.354226 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.354349 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.355035 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.355163 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.355344 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.355480 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.355670 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.355798 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.355982 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.356111 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.356295 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.356423 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.356632 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.356762 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.356927 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.357054 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.357245 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.357380 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.357549 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.357675 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.357853 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.357988 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.358160 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.358297 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.358466 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.358602 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.358796 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.358923 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.359105 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.359313 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.359441 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.359564 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.359693 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.359817 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.360007 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.360143 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.360314 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.360450 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.360616 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.360744 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.361021 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.361158 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.361283 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.361413 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.361527 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.361636 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.361813 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.361943 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.362139 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.362266 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.362450 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.362586 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.362786 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.362915 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.363079 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.363207 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.363385 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.363519 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.363694 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.363824 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.363995 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.364195 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.364411 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.364549 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.364719 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.364847 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.365026 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.365154 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.365331 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.365471 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.365631 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.365757 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.365932 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.366062 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.366239 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.366380 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.366553 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.366749 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.366877 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.366999 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.367168 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.367307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.367471 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.367598 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.367792 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.367919 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.368096 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.368233 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.368417 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.368552 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.368756 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.368883 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.369067 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.369197 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.369391 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.369519 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.369697 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.369833 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.370002 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.370741 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.370972 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.371114 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.371305 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.371445 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.371604 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.371725 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.371927 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.372061 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.372230 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.372366 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.372543 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.372680 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.372853 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.372990 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.373179 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.373362 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.373504 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.373678 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.373893 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.374029 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.374155 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.374361 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.374488 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.374626 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.374786 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.374953 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.375082 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.375262 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.375392 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.375580 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.375710 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.375894 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.376024 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.376220 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.376348 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.376548 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.376678 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.376861 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.376990 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.377178 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.377316 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.377485 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.377613 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.377809 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.377938 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.378122 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.378258 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.378427 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.378565 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.378737 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.378864 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.379069 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.379211 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.379372 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.379501 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.379681 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.379809 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.379989 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.380127 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.380294 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.380423 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.380597 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.380726 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.380899 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.381043 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.381221 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.381427 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.381622 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.381745 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.381882 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.382008 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.382132 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.382263 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.382432 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.382561 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.382779 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.382911 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.383087 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.383215 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.383409 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.383548 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.383715 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.383845 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.384015 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.384141 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.384317 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.384538 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.384665 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.384788 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.384938 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.385062 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.385243 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.385377 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.385565 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.385718 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.385911 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.386037 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.386219 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.386354 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.386542 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.386668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.386879 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.387005 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.387186 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.387330 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.387490 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.387616 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.387796 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.387937 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.388141 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.388269 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.388447 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.388573 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.388768 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.388894 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.389081 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.389214 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.389386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.389512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.389692 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.389817 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.389994 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.390122 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.390302 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.390428 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.390605 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.390749 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.390943 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.391071 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.391245 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.391371 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.391579 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.391722 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.391858 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.391995 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.392180 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.392318 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.392483 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.392618 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.392783 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.392911 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.393083 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.393212 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.393384 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.393525 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.393687 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.393822 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.393993 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.394122 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.394298 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.394440 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.394642 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.394801 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.394926 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.395062 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.395246 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.395378 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.395558 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.395687 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.395863 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.396001 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.396171 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.396300 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.396475 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.396611 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.396787 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.396922 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.397102 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.397232 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.397411 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.397542 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.397723 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.397851 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.398037 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.398166 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.398354 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.398482 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.398671 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.398902 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.399038 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.399225 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.399355 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.399537 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.399665 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.399849 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.399986 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.400163 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.400292 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.400477 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.400613 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.400788 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.400918 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.401099 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.401227 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.401447 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.401593 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.401845 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.402037 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.402166 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.402369 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.402497 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.402725 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.402858 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.403033 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.403161 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.403350 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.403478 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.403668 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.403798 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.403985 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.404113 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.404300 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.404431 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.404689 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.404836 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.404962 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.405086 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.405214 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.405351 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.405542 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.405672 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.405867 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.405996 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.406179 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.406315 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.406496 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.406632 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.406843 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.407164 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.407305 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.407480 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.407610 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.407796 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.407925 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.408155 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.408296 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.408474 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.408603 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.408786 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.409105 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.409424 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.409741 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.410057 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.410372 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.410729 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.411022 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.411336 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.411649 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.411968 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.412280 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.412443 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.412609 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.412816 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.412948 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.413176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.413306 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.413534 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.413672 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.413871 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.413998 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.414189 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.414319 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.414553 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.414782 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.414921 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.415475 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.415606 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.416024 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.416197 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.416337 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.416686 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.416813 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.417533 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.417851 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.418066 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.418209 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.418508 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.418668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.418872 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.419038 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.419184 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.419378 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.419509 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.419714 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.419877 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.420011 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.420146 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.420319 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.420449 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.420638 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.420765 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.420949 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.421087 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.421277 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.421407 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.421595 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.421728 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.421975 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.422124 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.422239 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.422436 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.422566 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.422812 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.423134 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.423263 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.423472 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.423806 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.423933 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.424233 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.424368 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.424571 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.424904 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.425043 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.425216 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.425440 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.425582 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.425846 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.426028 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.426155 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.426454 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.426616 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.426800 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.427119 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.427246 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.427428 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.427583 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.427722 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.427904 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.428034 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.428225 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.428354 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.428550 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.428687 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.428874 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.429003 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.429187 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.429323 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.429509 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.429646 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.429821 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.429950 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.430125 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.430252 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.430432 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.430573 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.430767 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.430899 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.431075 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.431205 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.431380 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.431515 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.431688 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.431815 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.431992 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.432209 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.432345 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.432480 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.432664 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.433324 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.433509 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.433639 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.433846 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.433975 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.434101 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.434225 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.434357 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.434482 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.434654 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.434824 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.434967 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.435160 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.435297 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.435431 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.435581 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.435710 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.435907 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.436034 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.436216 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.436353 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.436549 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.436677 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.436873 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.437003 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.437185 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.437322 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.437492 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.437620 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.437815 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.437941 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.438128 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.438266 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.438478 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.438666 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.438845 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.439025 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.439346 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.439477 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.439675 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.439810 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.439995 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.440122 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.440302 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.440440 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.440608 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.440736 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.440911 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.441048 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.441236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.441358 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.441540 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.441668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.441847 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.441982 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.442158 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.442364 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.442496 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.442620 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.442776 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.442913 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.443084 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.443221 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.443391 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.443520 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.443700 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.443836 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.444007 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.444133 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.444312 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.444441 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.444619 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.444755 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.444924 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.445051 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.445263 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.445407 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.445543 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.445669 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.445829 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.445958 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.446132 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.446262 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.446448 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.446578 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.446789 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.446920 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.447106 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.447245 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.447421 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.447556 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.447726 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.447854 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.448035 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.448198 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.448372 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.448499 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.448788 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.449009 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.449135 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.449270 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.449395 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.449519 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.449652 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.449833 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.449963 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.450142 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.450272 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.450487 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.450613 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.450915 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.451056 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.451241 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.451370 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.451562 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.451690 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.451874 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.452011 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.452184 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.452320 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.452536 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.452662 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.452805 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.452942 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.453122 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.453247 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.453436 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.453561 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.453749 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.453879 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.454082 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.454216 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.454407 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.454531 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.454757 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.454889 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.455067 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.455194 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.455409 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.455547 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.455686 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.455810 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.455967 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.456098 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.456280 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.456418 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.456587 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.456715 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.456890 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.457021 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.457193 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.457334 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.457497 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.457633 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.457800 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.457929 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.458101 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.458238 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.458401 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.458559 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.458703 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.458842 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.459016 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.459155 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.459317 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.459446 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.459617 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.459746 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.459917 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.460052 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.460218 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.460398 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.460533 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.460657 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.460790 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.460916 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.461096 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.461224 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.461397 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.461526 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.461698 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.461826 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.461995 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.462122 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.462295 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.462431 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.462647 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.462795 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.462933 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.463058 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.463232 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.463370 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.463569 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.463696 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.463946 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.464199 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.464334 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.464469 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.464603 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.464729 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.464887 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.465025 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.465209 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.465347 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.465556 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.465694 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.465840 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.465969 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.466147 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.466290 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.466482 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.466612 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.466820 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.466951 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.467132 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.467262 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.467442 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.467579 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.467752 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.467888 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.468060 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.468195 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.468369 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.468499 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.468677 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.468805 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.469005 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.469136 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.469309 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.469436 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.469622 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.469758 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.469938 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.470064 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.470252 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.470381 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.470564 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.470718 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.470903 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.471030 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.471215 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.471356 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.471527 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.471663 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.471837 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.471966 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.472146 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.472273 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.472453 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.472581 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.472761 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.472890 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.473069 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.473197 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.473381 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.473509 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.473688 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.473821 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.473996 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.474125 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.474308 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.474435 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.474621 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.474802 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.474970 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.475097 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.475281 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.475410 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.475667 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.475811 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.475938 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.476082 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.476233 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.476360 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.476549 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.476677 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.476885 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.477021 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.477208 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.477335 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.477524 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.477660 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.477833 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.477975 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.478138 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.478267 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.478400 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:45:40.478527 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:45:40.478658 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:45:40.632118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO dbcounter [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Registered counter for database nova_api Aug 24 04:45:40.632890 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO dbcounter [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Registered counter for database nova_api Aug 24 04:45:40.653294 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_db.sqlalchemy.engines [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:45:40.654596 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG oslo_db.sqlalchemy.engines [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:45:40.660166 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writer thread running {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:45:40.661094 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writer thread running {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:45:40.716409 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.context [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d9a825ce-3fb0-4120-988e-13c2ad98da6a(cell1) {{(pid=105524) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:45:40.716932 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.context [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d9a825ce-3fb0-4120-988e-13c2ad98da6a(cell1) {{(pid=105525) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:45:40.720240 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:40.720713 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:40.720835 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:40.721239 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:40.722323 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:40.722834 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:40.723082 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:40.723527 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:40.723625 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:45:40.724006 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:45:40.725505 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:40.725994 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG oslo_concurrency.lockutils [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:45:40.727478 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO dbcounter [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Registered counter for database nova_cell0 Aug 24 04:45:40.727966 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO dbcounter [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Registered counter for database nova_cell0 Aug 24 04:45:40.733295 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO dbcounter [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Registered counter for database nova_cell1 Aug 24 04:45:40.733560 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO dbcounter [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Registered counter for database nova_cell1 Aug 24 04:45:40.740691 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_db.sqlalchemy.engines [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:45:40.744754 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG oslo_db.sqlalchemy.engines [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:45:40.746171 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_db.sqlalchemy.engines [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:45:40.747229 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writer thread running {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:45:40.749454 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG oslo_db.sqlalchemy.engines [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:45:40.751578 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writer thread running {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:45:40.887559 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writer thread running {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:45:40.891407 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writer thread running {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:45:40.896272 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO dbcounter [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Registered counter for database nova_cell0 Aug 24 04:45:40.900110 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO dbcounter [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Registered counter for database nova_cell0 Aug 24 04:45:40.905556 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_db.sqlalchemy.engines [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:45:40.909485 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG oslo_db.sqlalchemy.engines [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:45:40.909986 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writer thread running {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:45:40.913741 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writer thread running {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:45:41.257179 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: WARNING keystonemiddleware.auth_token [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:45:41.258118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: WARNING keystonemiddleware.auth_token [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:45:41.264586 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: WARNING keystonemiddleware.auth_token [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:45:41.265448 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: WARNING keystonemiddleware.auth_token [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:45:41.608193 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: WARNING keystonemiddleware.auth_token [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:45:41.610405 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: WARNING keystonemiddleware.auth_token [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:45:41.614032 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: WARNING keystonemiddleware.auth_token [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:45:41.616295 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: WARNING keystonemiddleware.auth_token [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:45:41.619257 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bb94ac69c0 pid: 105525 (default app) Aug 24 04:45:41.621333 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:45:41.621511 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bb94ac69c0 pid: 105524 (default app) Aug 24 04:45:41.622706 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-77ff699b-9337-4e40-bb60-834bd10062ed None None] 10.222.0.97 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001907 Aug 24 04:45:41.623129 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 1/1] 10.222.0.97 () {50 vars in 788 bytes} [Wed Aug 24 04:45:41 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:00.240382 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:00.241774 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002136 Aug 24 04:47:00.242294 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 1/2] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:00.254519 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_api:SELECT=3 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:00.255552 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_cell0:SELECT=3 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:00.257133 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_cell1:SELECT=3 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:00.258130 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:01.157190 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-af9692f8-d346-4440-a080-fe61cc7589ee admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:01.189819 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-af9692f8-d346-4440-a080-fe61cc7589ee admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.940631 Aug 24 04:47:01.190565 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 2/3] 10.222.0.97 () {60 vars in 1292 bytes} [Wed Aug 24 04:47:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:03.532440 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:03.533913 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-91b89e59-5771-4d49-9484-327f05f284c4 None None] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002110 Aug 24 04:47:03.539732 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 2/4] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:03 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:03.967175 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-2254a0cb-b367-4449-a78f-0552db8cf4e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1, "id": "c1", "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:03.989217 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:47:03.989217 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: warnings.warn(msg) Aug 24 04:47:04.017554 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-2254a0cb-b367-4449-a78f-0552db8cf4e5 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.477010 Aug 24 04:47:04.018118 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 3/5] 10.222.0.97 () {64 vars in 1283 bytes} [Wed Aug 24 04:47:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:47:04.253823 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-09eb4fa3-1a30-4aff-992d-c3514793894e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:04.258134 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:47:04.258134 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: warnings.warn(msg) Aug 24 04:47:04.260981 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_api:SELECT=3 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:04.261788 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_cell1:SELECT=3 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:04.262704 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_cell0:SELECT=3 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:04.263410 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:04.323054 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-09eb4fa3-1a30-4aff-992d-c3514793894e admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.295922 Aug 24 04:47:04.324421 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 3/6] 10.222.0.97 () {64 vars in 1336 bytes} [Wed Aug 24 04:47:04 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:47:06.690643 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-2254a0cb-b367-4449-a78f-0552db8cf4e5 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:06.693080 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-2254a0cb-b367-4449-a78f-0552db8cf4e5 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 24 04:47:06.693080 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 4/7] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:07.357224 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-e356ed11-292c-4da6-bc26-5a5e68ec9609 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:07.377018 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:47:07.377018 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: warnings.warn(msg) Aug 24 04:47:07.398256 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-e356ed11-292c-4da6-bc26-5a5e68ec9609 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.697494 Aug 24 04:47:07.398858 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 4/8] 10.222.0.97 () {64 vars in 1283 bytes} [Wed Aug 24 04:47:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:47:07.411996 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-956b1ac2-fade-422b-a6cd-8381c398f722 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:07.416714 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:47:07.416714 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: warnings.warn(msg) Aug 24 04:47:07.455944 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-956b1ac2-fade-422b-a6cd-8381c398f722 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048012 Aug 24 04:47:07.466712 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 5/9] 10.222.0.97 () {64 vars in 1336 bytes} [Wed Aug 24 04:47:07 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:09.852007 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-e356ed11-292c-4da6-bc26-5a5e68ec9609 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:09.852944 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-e356ed11-292c-4da6-bc26-5a5e68ec9609 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 24 04:47:09.853359 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 5/10] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:10.248350 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-85fb0e76-d451-48bf-b4e5-541976a2fe2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:10.266436 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-85fb0e76-d451-48bf-b4e5-541976a2fe2b admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.407123 Aug 24 04:47:10.267009 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 6/11] 10.222.0.97 () {64 vars in 1283 bytes} [Wed Aug 24 04:47:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:47:10.279064 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-62a2ae2e-524c-4a3a-8766-5dfcfc69a666 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:10.303424 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-62a2ae2e-524c-4a3a-8766-5dfcfc69a666 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027963 Aug 24 04:47:10.304535 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 6/12] 10.222.0.97 () {64 vars in 1336 bytes} [Wed Aug 24 04:47:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:12.670305 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-85fb0e76-d451-48bf-b4e5-541976a2fe2b admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:12.671374 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-85fb0e76-d451-48bf-b4e5-541976a2fe2b admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 24 04:47:12.671777 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 7/13] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:13.170724 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-bb499001-f0d2-4af5-9627-85d9f381e523 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:13.191938 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-bb499001-f0d2-4af5-9627-85d9f381e523 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514224 Aug 24 04:47:13.192579 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 7/14] 10.222.0.97 () {64 vars in 1283 bytes} [Wed Aug 24 04:47:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:47:13.204651 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-2f578d5d-478a-4af8-b365-01e5e2fda48c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:13.232392 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-2f578d5d-478a-4af8-b365-01e5e2fda48c admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031377 Aug 24 04:47:13.233248 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 8/15] 10.222.0.97 () {64 vars in 1336 bytes} [Wed Aug 24 04:47:13 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:15.583966 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-bb499001-f0d2-4af5-9627-85d9f381e523 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:15.584972 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-bb499001-f0d2-4af5-9627-85d9f381e523 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Aug 24 04:47:15.585367 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 8/16] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:16.053184 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-20c30509-8fbc-4c4a-9e1b-e24d81738139 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "rxtx_factor": 1.0, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:16.073389 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-20c30509-8fbc-4c4a-9e1b-e24d81738139 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.481723 Aug 24 04:47:16.073937 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 9/17] 10.222.0.97 () {64 vars in 1283 bytes} [Wed Aug 24 04:47:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:47:16.085712 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-c429fe0f-6b14-4ba2-9a6b-92b1d1046aad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:16.109720 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-c429fe0f-6b14-4ba2-9a6b-92b1d1046aad admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027505 Aug 24 04:47:16.110209 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 9/18] 10.222.0.97 () {64 vars in 1336 bytes} [Wed Aug 24 04:47:16 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:18.494785 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-20c30509-8fbc-4c4a-9e1b-e24d81738139 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:18.496100 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-20c30509-8fbc-4c4a-9e1b-e24d81738139 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001981 Aug 24 04:47:18.496647 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 10/19] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:18.930088 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-0aa50c43-34ad-4f78-a777-2170df697ccb admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:18.960390 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-0aa50c43-34ad-4f78-a777-2170df697ccb admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456027 Aug 24 04:47:18.961094 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 10/20] 10.222.0.97 () {60 vars in 1292 bytes} [Wed Aug 24 04:47:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:47:21.607754 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-20c30509-8fbc-4c4a-9e1b-e24d81738139 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:21.608761 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-20c30509-8fbc-4c4a-9e1b-e24d81738139 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 24 04:47:21.609440 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 11/21] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:47:22.048008 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-06ab1078-2a36-4024-a945-d04e7a4a5b41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:22.069421 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-06ab1078-2a36-4024-a945-d04e7a4a5b41 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.453763 Aug 24 04:47:22.069969 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 11/22] 10.222.0.97 () {64 vars in 1283 bytes} [Wed Aug 24 04:47:21 2022] POST /compute/v2.1/flavors => generated 402 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:47:22.083992 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-a9dc9ac9-57ba-4612-95cb-fd2ecc3411e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:22.112438 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-a9dc9ac9-57ba-4612-95cb-fd2ecc3411e7 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033991 Aug 24 04:47:22.113122 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 12/23] 10.222.0.97 () {64 vars in 1333 bytes} [Wed Aug 24 04:47:22 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:24.480030 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-06ab1078-2a36-4024-a945-d04e7a4a5b41 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:24.481653 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-06ab1078-2a36-4024-a945-d04e7a4a5b41 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Aug 24 04:47:24.482094 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 12/24] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:24.882733 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-214c7402-ae79-4fc9-addd-f4565fc13aba admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "vcpus": 1, "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:24.901812 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-214c7402-ae79-4fc9-addd-f4565fc13aba admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.413435 Aug 24 04:47:24.902354 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 13/25] 10.222.0.97 () {64 vars in 1283 bytes} [Wed Aug 24 04:47:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 04:47:24.914390 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-4cfd9434-3e78-4c05-b7c4-1c9998a055c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:24.939837 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-4cfd9434-3e78-4c05-b7c4-1c9998a055c4 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029052 Aug 24 04:47:24.940549 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 13/26] 10.222.0.97 () {64 vars in 1333 bytes} [Wed Aug 24 04:47:24 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:27.331527 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-214c7402-ae79-4fc9-addd-f4565fc13aba admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:27.332542 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-214c7402-ae79-4fc9-addd-f4565fc13aba admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 24 04:47:27.332943 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 14/27] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:27.699816 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-2d324e1d-813f-421e-8d24-145aa5857050 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "os-flavor-access:is_public": true, "ram": 4096, "disk": 40, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:27.720402 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-2d324e1d-813f-421e-8d24-145aa5857050 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.380728 Aug 24 04:47:27.720943 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 14/28] 10.222.0.97 () {64 vars in 1283 bytes} [Wed Aug 24 04:47:27 2022] POST /compute/v2.1/flavors => generated 406 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:47:27.736290 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-4659c5f4-adc9-49f0-af06-c4354c72a068 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:27.766428 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-4659c5f4-adc9-49f0-af06-c4354c72a068 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036407 Aug 24 04:47:27.767405 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 15/29] 10.222.0.97 () {64 vars in 1333 bytes} [Wed Aug 24 04:47:27 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:30.170655 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-2d324e1d-813f-421e-8d24-145aa5857050 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:30.172370 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-2d324e1d-813f-421e-8d24-145aa5857050 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Aug 24 04:47:30.178045 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 15/30] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:30 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:30.655384 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-8a978ef3-6838-4764-829f-6552efb6f84c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "id": "4", "ram": 8192}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:30.663225 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:30.678750 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-8a978ef3-6838-4764-829f-6552efb6f84c admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.499405 Aug 24 04:47:30.679215 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 16/31] 10.222.0.97 () {64 vars in 1283 bytes} [Wed Aug 24 04:47:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:47:30.691276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-e2d8ebb0-f137-4534-9632-9f6c86e8de78 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:30.720575 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-e2d8ebb0-f137-4534-9632-9f6c86e8de78 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032911 Aug 24 04:47:30.721155 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 16/32] 10.222.0.97 () {64 vars in 1333 bytes} [Wed Aug 24 04:47:30 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:47:33.104397 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-8a978ef3-6838-4764-829f-6552efb6f84c admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:33.105415 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-8a978ef3-6838-4764-829f-6552efb6f84c admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 04:47:33.105817 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 17/33] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:33.532366 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-cba50ba8-774c-4ccf-8975-dc89fec2aa65 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "disk": 160, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:33.554179 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-cba50ba8-774c-4ccf-8975-dc89fec2aa65 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.441910 Aug 24 04:47:33.555687 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 17/34] 10.222.0.97 () {64 vars in 1283 bytes} [Wed Aug 24 04:47:33 2022] POST /compute/v2.1/flavors => generated 408 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:47:33.567775 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-4a70be96-f748-46df-9030-8acfa45af05f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:33.595374 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-4a70be96-f748-46df-9030-8acfa45af05f admin admin] 10.222.0.97 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031563 Aug 24 04:47:33.599051 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 18/35] 10.222.0.97 () {64 vars in 1333 bytes} [Wed Aug 24 04:47:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:47:52.348142 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-cba50ba8-774c-4ccf-8975-dc89fec2aa65 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:52.349146 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-cba50ba8-774c-4ccf-8975-dc89fec2aa65 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 24 04:47:52.349542 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 18/36] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:52.360094 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:52.743564 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-2de875fd-13b8-4709-986c-7c8c4b78071a admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:52.761649 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-2de875fd-13b8-4709-986c-7c8c4b78071a admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405979 Aug 24 04:47:52.762188 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 19/37] 10.222.0.97 () {60 vars in 1292 bytes} [Wed Aug 24 04:47:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:47:53.820596 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-cba50ba8-774c-4ccf-8975-dc89fec2aa65 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:53.821600 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-cba50ba8-774c-4ccf-8975-dc89fec2aa65 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 24 04:47:53.821998 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 19/38] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:54.343536 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-58b076e8-8f67-4361-b8ed-d65378f79a30 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:54.349023 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.wsgi [None req-58b076e8-8f67-4361-b8ed-d65378f79a30 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-58b076e8-8f67-4361-b8ed-d65378f79a30 admin admin] Request method failure captured: Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Accept: application/json Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Accept-Encoding: gzip, deflate Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Connection: keep-alive Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Content-Length: 0 Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Host: 10.222.0.97 Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Openstack-Api-Version: compute 2.90 Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Openstack-System-Scope: None Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: User-Agent: python-novaclient Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Auth-Token: gAAAAABjBa15QGY8PIS55RwM-G_X70Ew0QvbGruNemHK63fnIMau2nwirC2X8n1vKJ707uVGqO-gm5g2Pitc1neMC1VSDN8LGY9t8-pGrIeU75POj13_9S1Fvquj74gYIfdUGq5YbWC2b2kTTNsIgLdiHJRKZPVqujowNLjwE-tH3A1xHt3uZpA Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Domain-Id: None Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Domain-Name: None Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Identity-Status: Confirmed Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Is-Admin-Project: True Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Domain-Id: default Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Domain-Name: Default Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Name: admin Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Role: member,reader,admin Aug 24 04:47:54.353063 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Roles: member,reader,admin Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2f8e0fcfca8242cb99a63f814736732d", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Tenant: admin Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Tenant-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Tenant-Name: admin Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User: admin Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Domain-Id: default Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Domain-Name: Default Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Id: 1b471bf6074b4304b418215fcfca5ffb Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Name: admin Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: method: > Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: exception: Flavor 42 could not be found. Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: action_args: {'id': '42'} Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:47:54.354587 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:54.355575 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:54.357092 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-58b076e8-8f67-4361-b8ed-d65378f79a30 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:47:54.358330 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-58b076e8-8f67-4361-b8ed-d65378f79a30 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394956 Aug 24 04:47:54.358330 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 20/39] 10.222.0.97 () {60 vars in 1190 bytes} [Wed Aug 24 04:47:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:54.364083 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-0f5b6f0b-3910-453e-b750-8b7df08322ce admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:54.368175 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:54.387704 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-0f5b6f0b-3910-453e-b750-8b7df08322ce admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027160 Aug 24 04:47:54.388255 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 20/40] 10.222.0.97 () {60 vars in 1210 bytes} [Wed Aug 24 04:47:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 04:47:54.398552 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-d3ddf583-5291-4095-9aa6-d0f02aeb0035 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:54.422131 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-d3ddf583-5291-4095-9aa6-d0f02aeb0035 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027760 Aug 24 04:47:54.422663 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 21/41] 10.222.0.97 () {60 vars in 1210 bytes} [Wed Aug 24 04:47:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:47:54.432448 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-4800ba0c-b662-4f7d-afb5-24d63ed08839 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:54.438298 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.wsgi [None req-4800ba0c-b662-4f7d-afb5-24d63ed08839 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-4800ba0c-b662-4f7d-afb5-24d63ed08839 admin admin] Request method failure captured: Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Accept: application/json Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Accept-Encoding: gzip, deflate Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Connection: keep-alive Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Content-Length: 0 Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Host: 10.222.0.97 Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Openstack-Api-Version: compute 2.90 Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Openstack-System-Scope: None Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: User-Agent: python-novaclient Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Auth-Token: gAAAAABjBa15QGY8PIS55RwM-G_X70Ew0QvbGruNemHK63fnIMau2nwirC2X8n1vKJ707uVGqO-gm5g2Pitc1neMC1VSDN8LGY9t8-pGrIeU75POj13_9S1Fvquj74gYIfdUGq5YbWC2b2kTTNsIgLdiHJRKZPVqujowNLjwE-tH3A1xHt3uZpA Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Domain-Id: None Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Domain-Name: None Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Identity-Status: Confirmed Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Is-Admin-Project: True Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Domain-Id: default Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Domain-Name: Default Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Name: admin Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Role: member,reader,admin Aug 24 04:47:54.441520 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Roles: member,reader,admin Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2f8e0fcfca8242cb99a63f814736732d", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Tenant: admin Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Tenant-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Tenant-Name: admin Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User: admin Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Domain-Id: default Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Domain-Name: Default Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Id: 1b471bf6074b4304b418215fcfca5ffb Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Name: admin Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: method: > Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: exception: Flavor 42 could not be found. Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: action_args: {'id': '42'} Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:47:54.443071 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:54.444118 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:54.446276 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-4800ba0c-b662-4f7d-afb5-24d63ed08839 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:47:54.447537 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-4800ba0c-b662-4f7d-afb5-24d63ed08839 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014644 Aug 24 04:47:54.447537 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 21/42] 10.222.0.97 () {60 vars in 1190 bytes} [Wed Aug 24 04:47:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:55.435310 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-d3ddf583-5291-4095-9aa6-d0f02aeb0035 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:55.436317 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-d3ddf583-5291-4095-9aa6-d0f02aeb0035 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Aug 24 04:47:55.436710 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 22/43] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:55.966851 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-46261d91-47fc-43df-a330-fc654bed6469 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:55.972121 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.wsgi [None req-46261d91-47fc-43df-a330-fc654bed6469 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-46261d91-47fc-43df-a330-fc654bed6469 admin admin] Request method failure captured: Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Accept: application/json Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Accept-Encoding: gzip, deflate Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Connection: keep-alive Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Content-Length: 0 Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Host: 10.222.0.97 Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Openstack-Api-Version: compute 2.90 Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Openstack-System-Scope: None Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: User-Agent: python-novaclient Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Auth-Token: gAAAAABjBa17-uCivjoAgrCf7e26SpbX_vMnNd-gveRdHlBmBP3Jhs0gUbYclJikGjKvUXBs8catqwGaY2Zbld9z7TiRs9NgqDfBg00lo5qkfbulFrAujdl5JfgapgfRkofuFGvIENxAf5UoEVv0rND-dAZnv1EUgUTeq541ekCMhCNfmTiu6Ec Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Domain-Id: None Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Domain-Name: None Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Identity-Status: Confirmed Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Is-Admin-Project: True Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Domain-Id: default Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Domain-Name: Default Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Name: admin Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Role: member,reader,admin Aug 24 04:47:55.973635 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Roles: member,reader,admin Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2f8e0fcfca8242cb99a63f814736732d", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Tenant: admin Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Tenant-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Tenant-Name: admin Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User: admin Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Domain-Id: default Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Domain-Name: Default Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Id: 1b471bf6074b4304b418215fcfca5ffb Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Name: admin Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: method: > Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: exception: Flavor 84 could not be found. Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: action_args: {'id': '84'} Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:47:55.975176 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:55.976386 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:55.978013 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-46261d91-47fc-43df-a330-fc654bed6469 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:47:55.979430 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-46261d91-47fc-43df-a330-fc654bed6469 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.401568 Aug 24 04:47:55.979430 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 22/44] 10.222.0.97 () {60 vars in 1190 bytes} [Wed Aug 24 04:47:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:55.984871 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-e27e4290-d226-4500-b523-fe8eaf0be9f7 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:55.999653 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-e27e4290-d226-4500-b523-fe8eaf0be9f7 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018396 Aug 24 04:47:56.000170 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 23/45] 10.222.0.97 () {60 vars in 1210 bytes} [Wed Aug 24 04:47:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:47:56.009957 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-837db083-6115-4f9d-b758-f1993805d386 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:56.026869 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-837db083-6115-4f9d-b758-f1993805d386 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020896 Aug 24 04:47:56.027430 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 23/46] 10.222.0.97 () {60 vars in 1210 bytes} [Wed Aug 24 04:47:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:47:56.037452 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-0adb7d8a-e554-4e33-b23f-c0ac6b45431b admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:56.043027 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.wsgi [None req-0adb7d8a-e554-4e33-b23f-c0ac6b45431b admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-0adb7d8a-e554-4e33-b23f-c0ac6b45431b admin admin] Request method failure captured: Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Accept: application/json Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Accept-Encoding: gzip, deflate Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Connection: keep-alive Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Content-Length: 0 Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Host: 10.222.0.97 Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Openstack-Api-Version: compute 2.90 Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Openstack-System-Scope: None Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: User-Agent: python-novaclient Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Auth-Token: gAAAAABjBa17-uCivjoAgrCf7e26SpbX_vMnNd-gveRdHlBmBP3Jhs0gUbYclJikGjKvUXBs8catqwGaY2Zbld9z7TiRs9NgqDfBg00lo5qkfbulFrAujdl5JfgapgfRkofuFGvIENxAf5UoEVv0rND-dAZnv1EUgUTeq541ekCMhCNfmTiu6Ec Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Domain-Id: None Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Domain-Name: None Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Identity-Status: Confirmed Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Is-Admin-Project: True Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Domain-Id: default Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Domain-Name: Default Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Name: admin Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Role: member,reader,admin Aug 24 04:47:56.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Roles: member,reader,admin Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2f8e0fcfca8242cb99a63f814736732d", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Tenant: admin Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Tenant-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Tenant-Name: admin Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User: admin Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Domain-Id: default Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Domain-Name: Default Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Id: 1b471bf6074b4304b418215fcfca5ffb Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Name: admin Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: method: > Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: exception: Flavor 84 could not be found. Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: action_args: {'id': '84'} Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:47:56.046030 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:56.047024 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:56.048307 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-0adb7d8a-e554-4e33-b23f-c0ac6b45431b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:47:56.049336 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-0adb7d8a-e554-4e33-b23f-c0ac6b45431b admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012053 Aug 24 04:47:56.049336 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 24/47] 10.222.0.97 () {60 vars in 1190 bytes} [Wed Aug 24 04:47:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:57.011871 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-837db083-6115-4f9d-b758-f1993805d386 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:57.012865 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-837db083-6115-4f9d-b758-f1993805d386 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Aug 24 04:47:57.013251 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 24/48] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:47:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:47:57.531204 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-8f2174f0-cae6-475a-93dc-fd0d0d2c906f admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:57.536963 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.wsgi [None req-8f2174f0-cae6-475a-93dc-fd0d0d2c906f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-8f2174f0-cae6-475a-93dc-fd0d0d2c906f admin admin] Request method failure captured: Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Accept: application/json Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Accept-Encoding: gzip, deflate Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Connection: keep-alive Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Content-Length: 0 Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Host: 10.222.0.97 Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Openstack-Api-Version: compute 2.90 Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Openstack-System-Scope: None Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: User-Agent: python-novaclient Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Auth-Token: gAAAAABjBa18DDUP3sYI3_HUuvFvUC3UCAQQCUGQ5ok3aXHN82vid-d8OBPlgceZO_fkbJer5_jqrzFaxKyEi5NGcygNRm_QrrzK55ygUbbxszTEZ_heMlSpBdU7Z6Y0eZYES95bfQNEACk-p19lzX2QRfv5wfuBJgke-PFXlghelnDHD6FRutw Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Domain-Id: None Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Domain-Name: None Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Identity-Status: Confirmed Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Is-Admin-Project: True Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Domain-Id: default Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Domain-Name: Default Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Project-Name: admin Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Role: member,reader,admin Aug 24 04:47:57.539165 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Roles: member,reader,admin Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2f8e0fcfca8242cb99a63f814736732d", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Tenant: admin Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Tenant-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-Tenant-Name: admin Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User: admin Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Domain-Id: default Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Domain-Name: Default Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Id: 1b471bf6074b4304b418215fcfca5ffb Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: X-User-Name: admin Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: method: > Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: exception: Flavor 451 could not be found. Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: action_args: {'id': '451'} Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:47:57.540555 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:57.541734 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: ERROR nova.api.openstack.wsgi Aug 24 04:47:57.543172 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-8f2174f0-cae6-475a-93dc-fd0d0d2c906f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:47:57.544474 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-8f2174f0-cae6-475a-93dc-fd0d0d2c906f admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390916 Aug 24 04:47:57.544474 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 25/49] 10.222.0.97 () {60 vars in 1193 bytes} [Wed Aug 24 04:47:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:57.551576 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-36b4aa20-9d68-4772-b187-27f52585540f admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:57.568487 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-36b4aa20-9d68-4772-b187-27f52585540f admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021133 Aug 24 04:47:57.569038 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 25/50] 10.222.0.97 () {60 vars in 1210 bytes} [Wed Aug 24 04:47:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:47:57.578507 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:57.593226 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018251 Aug 24 04:47:57.593750 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 26/51] 10.222.0.97 () {60 vars in 1210 bytes} [Wed Aug 24 04:47:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:47:57.604002 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-1edda1a8-2173-44d3-8892-35254afc5541 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:57.609185 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.wsgi [None req-1edda1a8-2173-44d3-8892-35254afc5541 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-1edda1a8-2173-44d3-8892-35254afc5541 admin admin] Request method failure captured: Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Accept: application/json Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Accept-Encoding: gzip, deflate Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Connection: keep-alive Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Content-Length: 0 Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Host: 10.222.0.97 Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Openstack-Api-Version: compute 2.90 Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Openstack-System-Scope: None Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: User-Agent: python-novaclient Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Auth-Token: gAAAAABjBa18DDUP3sYI3_HUuvFvUC3UCAQQCUGQ5ok3aXHN82vid-d8OBPlgceZO_fkbJer5_jqrzFaxKyEi5NGcygNRm_QrrzK55ygUbbxszTEZ_heMlSpBdU7Z6Y0eZYES95bfQNEACk-p19lzX2QRfv5wfuBJgke-PFXlghelnDHD6FRutw Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Domain-Id: None Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Domain-Name: None Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Identity-Status: Confirmed Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Is-Admin-Project: True Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Domain-Id: default Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Domain-Name: Default Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Project-Name: admin Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Role: member,reader,admin Aug 24 04:47:57.610668 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Roles: member,reader,admin Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_2f8e0fcfca8242cb99a63f814736732d", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/2f8e0fcfca8242cb99a63f814736732d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Tenant: admin Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Tenant-Id: 2f8e0fcfca8242cb99a63f814736732d Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-Tenant-Name: admin Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User: admin Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Domain-Id: default Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Domain-Name: Default Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Id: 1b471bf6074b4304b418215fcfca5ffb Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: X-User-Name: admin Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: method: > Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: exception: Flavor 451 could not be found. Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: action_args: {'id': '451'} Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:47:57.612306 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:57.613236 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: ERROR nova.api.openstack.wsgi Aug 24 04:47:57.614567 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-1edda1a8-2173-44d3-8892-35254afc5541 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105524) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:47:57.615864 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-1edda1a8-2173-44d3-8892-35254afc5541 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012584 Aug 24 04:47:57.615864 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 26/52] 10.222.0.97 () {60 vars in 1193 bytes} [Wed Aug 24 04:47:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:58.637998 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:47:58.639034 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 24 04:47:58.639426 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 27/53] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:47:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:47:59.204805 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-ec9b1ded-65a2-4f08-9132-b200a9c1dad3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:47:59.225612 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-ec9b1ded-65a2-4f08-9132-b200a9c1dad3 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.439752 Aug 24 04:47:59.226714 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 27/54] 10.222.0.97 () {64 vars in 1235 bytes} [Wed Aug 24 04:47:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:48:00.203121 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:00.204903 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002278 Aug 24 04:48:00.205572 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 28/55] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:48:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:00.730745 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-fb958993-7883-49ee-99fd-ab8da0e7efbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:00.750148 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-fb958993-7883-49ee-99fd-ab8da0e7efbb admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.406227 Aug 24 04:48:00.750931 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 28/56] 10.222.0.97 () {64 vars in 1235 bytes} [Wed Aug 24 04:48:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:48:01.733904 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:01.734856 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 24 04:48:01.735261 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 29/57] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:48:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:02.264341 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-17b189c7-9fab-4c71-9fcf-86b66636c078 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:02.283613 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-17b189c7-9fab-4c71-9fcf-86b66636c078 admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.406434 Aug 24 04:48:02.284160 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 29/58] 10.222.0.97 () {64 vars in 1235 bytes} [Wed Aug 24 04:48:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:48:03.247518 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:03.248540 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Aug 24 04:48:03.248930 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 30/59] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:48:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:03.773483 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-8be0a92f-db10-4639-9870-c2aa6d19f47c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:48:03.792304 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-8be0a92f-db10-4639-9870-c2aa6d19f47c admin admin] 10.222.0.97 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.402317 Aug 24 04:48:03.792864 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 30/60] 10.222.0.97 () {64 vars in 1235 bytes} [Wed Aug 24 04:48:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:48:04.764875 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:04.765876 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 24 04:48:04.766270 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 31/61] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:48:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:05.287233 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-cdcedddf-f555-4fe1-8aed-b775917c3b19 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:05.309706 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-cdcedddf-f555-4fe1-8aed-b775917c3b19 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403986 Aug 24 04:48:05.310245 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 31/62] 10.222.0.97 () {60 vars in 1202 bytes} [Wed Aug 24 04:48:04 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:48:58.641869 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:58.643184 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-59618f0b-2a07-4abd-bc58-e57a8a8ac3a7 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001978 Aug 24 04:48:58.643635 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 32/63] 10.222.0.97 () {54 vars in 931 bytes} [Wed Aug 24 04:48:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:48:58.654901 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:59.090289 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-0a9d45a7-8c72-4d95-853e-fe54ec444265 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:59.110183 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-0a9d45a7-8c72-4d95-853e-fe54ec444265 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.459760 Aug 24 04:48:59.110732 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 32/64] 10.222.0.97 () {60 vars in 1292 bytes} [Wed Aug 24 04:48:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:48:59.133201 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG dbcounter [-] [105525] Writing DB stats nova_api:SELECT=14 {{(pid=105525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:59.137000 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-b0284694-8208-408c-827d-6d79e0459915 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:59.144820 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-b0284694-8208-408c-827d-6d79e0459915 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013700 Aug 24 04:48:59.145343 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 33/65] 10.222.0.97 () {60 vars in 1283 bytes} [Wed Aug 24 04:48:59 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:59.157792 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-0c5c20ae-238f-4ae4-b7b3-78c29d5a8f89 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:59.166072 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-0c5c20ae-238f-4ae4-b7b3-78c29d5a8f89 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011883 Aug 24 04:48:59.166881 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 33/66] 10.222.0.97 () {60 vars in 1286 bytes} [Wed Aug 24 04:48:59 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:59.179048 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-51f90c5a-74af-4d10-a610-cc4e192a12f6 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:59.186659 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-51f90c5a-74af-4d10-a610-cc4e192a12f6 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011833 Aug 24 04:48:59.187152 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 34/67] 10.222.0.97 () {60 vars in 1286 bytes} [Wed Aug 24 04:48:59 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:48:59.198521 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-4726a54b-3dbc-4ab2-8fe1-0418a3f1ed08 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:48:59.206182 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-4726a54b-3dbc-4ab2-8fe1-0418a3f1ed08 admin admin] 10.222.0.97 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011258 Aug 24 04:48:59.206886 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 34/68] 10.222.0.97 () {60 vars in 1283 bytes} [Wed Aug 24 04:48:59 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:51:57.069339 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-51f90c5a-74af-4d10-a610-cc4e192a12f6 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:57.070345 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-51f90c5a-74af-4d10-a610-cc4e192a12f6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 24 04:51:57.070793 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 35/69] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:51:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:57.213211 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_api:SELECT=6 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:57.372564 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-4b730168-c585-4de9-8a7a-0ce17870caec admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:57.374961 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:51:57.374961 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: warnings.warn(msg) Aug 24 04:51:57.376089 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-4b730168-c585-4de9-8a7a-0ce17870caec admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:57.376568 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-4b730168-c585-4de9-8a7a-0ce17870caec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:57.377000 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-4b730168-c585-4de9-8a7a-0ce17870caec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:57.377715 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-4b730168-c585-4de9-8a7a-0ce17870caec admin admin] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:57.378163 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-4b730168-c585-4de9-8a7a-0ce17870caec admin admin] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:57.378582 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-4b730168-c585-4de9-8a7a-0ce17870caec admin admin] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:57.412021 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-4b730168-c585-4de9-8a7a-0ce17870caec admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200221 Aug 24 04:51:57.412568 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 35/70] 10.222.0.97 () {60 vars in 1193 bytes} [Wed Aug 24 04:51:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:51:58.246969 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-51f90c5a-74af-4d10-a610-cc4e192a12f6 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:58.247976 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-51f90c5a-74af-4d10-a610-cc4e192a12f6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 04:51:58.248374 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 36/71] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:51:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:51:58.438756 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-b6c0b9e0-2986-4497-a79a-c79fe5686f26 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:51:58.441190 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:51:58.441190 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: warnings.warn(msg) Aug 24 04:51:58.442952 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-b6c0b9e0-2986-4497-a79a-c79fe5686f26 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:58.443425 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-b6c0b9e0-2986-4497-a79a-c79fe5686f26 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:58.443853 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-b6c0b9e0-2986-4497-a79a-c79fe5686f26 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:58.444559 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-b6c0b9e0-2986-4497-a79a-c79fe5686f26 admin admin] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:51:58.444999 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-b6c0b9e0-2986-4497-a79a-c79fe5686f26 admin admin] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:51:58.445411 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-b6c0b9e0-2986-4497-a79a-c79fe5686f26 admin admin] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:51:58.464496 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-b6c0b9e0-2986-4497-a79a-c79fe5686f26 admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077434 Aug 24 04:51:58.464963 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 36/72] 10.222.0.97 () {60 vars in 1193 bytes} [Wed Aug 24 04:51:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 04:52:09.723005 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-51f90c5a-74af-4d10-a610-cc4e192a12f6 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:09.724617 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-51f90c5a-74af-4d10-a610-cc4e192a12f6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Aug 24 04:52:09.725006 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 37/73] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:52:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:09.868243 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_cell0:SELECT=4 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:09.868966 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_cell1:SELECT=4 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:09.869680 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG dbcounter [-] [105524] Writing DB stats nova_api:SELECT=8 {{(pid=105524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:09.919510 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-cf59b98e-d20b-4e4c-b654-d7ab03f025e7 admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:09.921893 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:52:09.921893 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: warnings.warn(msg) Aug 24 04:52:09.923045 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-cf59b98e-d20b-4e4c-b654-d7ab03f025e7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:09.923523 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-cf59b98e-d20b-4e4c-b654-d7ab03f025e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:09.923954 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-cf59b98e-d20b-4e4c-b654-d7ab03f025e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.924670 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-cf59b98e-d20b-4e4c-b654-d7ab03f025e7 admin admin] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:09.925119 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-cf59b98e-d20b-4e4c-b654-d7ab03f025e7 admin admin] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:09.925546 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-cf59b98e-d20b-4e4c-b654-d7ab03f025e7 admin admin] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:09.950266 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-cf59b98e-d20b-4e4c-b654-d7ab03f025e7 admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.086889 Aug 24 04:52:09.950832 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 37/74] 10.222.0.97 () {60 vars in 1193 bytes} [Wed Aug 24 04:52:09 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:52:10.773939 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: DEBUG nova.api.openstack.wsgi [None req-51f90c5a-74af-4d10-a610-cc4e192a12f6 admin admin] Calling method '>' {{(pid=105525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:10.774962 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: INFO nova.api.openstack.requestlog [None req-51f90c5a-74af-4d10-a610-cc4e192a12f6 admin admin] 10.222.0.97 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Aug 24 04:52:10.775359 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: [pid: 105525|app: 0|req: 38/75] 10.222.0.97 () {56 vars in 1074 bytes} [Wed Aug 24 04:52:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:52:10.967296 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG nova.api.openstack.wsgi [None req-3b52ce20-b541-475b-b9c7-b1ef9e65db1a admin admin] Calling method '>' {{(pid=105524) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:52:10.969681 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:52:10.969681 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: warnings.warn(msg) Aug 24 04:52:10.970797 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-3b52ce20-b541-475b-b9c7-b1ef9e65db1a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:10.971281 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-3b52ce20-b541-475b-b9c7-b1ef9e65db1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:10.971707 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-3b52ce20-b541-475b-b9c7-b1ef9e65db1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:10.972425 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-3b52ce20-b541-475b-b9c7-b1ef9e65db1a admin admin] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:52:10.972870 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-3b52ce20-b541-475b-b9c7-b1ef9e65db1a admin admin] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:52:10.973288 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: DEBUG oslo_concurrency.lockutils [None req-3b52ce20-b541-475b-b9c7-b1ef9e65db1a admin admin] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105524) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:52:10.994526 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: INFO nova.api.openstack.requestlog [None req-3b52ce20-b541-475b-b9c7-b1ef9e65db1a admin admin] 10.222.0.97 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079033 Aug 24 04:52:10.995033 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: [pid: 105524|app: 0|req: 38/76] 10.222.0.97 () {60 vars in 1193 bytes} [Wed Aug 24 04:52:10 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 04:53:10.732239 dv-cinder-854266-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 04:53:10.734016 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: Wed Aug 24 04:53:10 2022 - graceful shutdown triggered... Aug 24 04:53:10.734413 dv-cinder-854266-1-iscsi devstack@n-api.service[105524]: Gracefully killing worker 1 (pid: 105524)... Aug 24 04:53:10.737924 dv-cinder-854266-1-iscsi devstack@n-api.service[105525]: Gracefully killing worker 2 (pid: 105525)... Aug 24 04:53:11.734799 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: worker 1 buried after 1 seconds Aug 24 04:53:11.734799 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: worker 2 buried after 1 seconds Aug 24 04:53:11.734799 dv-cinder-854266-1-iscsi devstack@n-api.service[105523]: goodbye to uWSGI. Aug 24 04:53:11.736295 dv-cinder-854266-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 04:53:11.736830 dv-cinder-854266-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 04:53:11.739921 dv-cinder-854266-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 04:53:11.750829 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 04:53:11 2022] *** Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: nodename: dv-cinder-854266-1-iscsi Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: machine: x86_64 Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: clock source: unix Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: pcre jit disabled Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: detected number of CPU cores: 4 Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: current working directory: / Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: detected binary path: /usr/bin/uwsgi-core Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: your processes number limit is 47680 Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: your memory page size is 4096 bytes Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: detected max file descriptor number: 2048 Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: lock engine: pthread robust mutexes Aug 24 04:53:11.753054 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: thunder lock: enabled Aug 24 04:53:11.754518 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 04:53:11.754518 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 04:53:11.795479 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: Python main interpreter initialized at 0x5633f7dcf9c0 Aug 24 04:53:11.795479 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: python threads support enabled Aug 24 04:53:11.795479 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: your server socket listen backlog is limited to 100 connections Aug 24 04:53:11.795479 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: your mercy for graceful operations on workers is 90 seconds Aug 24 04:53:11.795911 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 04:53:11.795911 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: *** Operational MODE: preforking *** Aug 24 04:53:11.796199 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: *** uWSGI is running in multiple interpreter mode *** Aug 24 04:53:11.796199 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: spawned uWSGI master process (pid: 120538) Aug 24 04:53:11.796405 dv-cinder-854266-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 04:53:11.796990 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: spawned uWSGI worker 1 (pid: 120557, cores: 1) Aug 24 04:53:11.797503 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: spawned uWSGI worker 2 (pid: 120558, cores: 1) Aug 24 04:53:11.797793 dv-cinder-854266-1-iscsi devstack@n-api.service[120538]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 04:53:12.455915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:53:12.473137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 04:53:13.610867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:53:13.610867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: from cryptography.utils import int_from_bytes Aug 24 04:53:13.611501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:53:13.611501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: from cryptography.utils import int_from_bytes Aug 24 04:53:13.642847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:53:13.642847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: from cryptography.utils import int_from_bytes Aug 24 04:53:13.643466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:53:13.643466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: from cryptography.utils import int_from_bytes Aug 24 04:53:16.035114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:53:16.036429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:53:16.036630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:53:16.037003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:53:16.037268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:53:16.037669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.038004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.038333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.038662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.039180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.039510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.039846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.040178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.040521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.041007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.041546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.042099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-1-iscsi {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.042438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.042786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.043374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.043707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.044022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.044355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.044671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.045189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.046710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.046710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.046710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.046710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.047058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.047274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.047557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.047873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.048212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.048541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.048946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-1-iscsi {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.049278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.049595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.049917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.050351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.050735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.051062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.051385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.051904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.052224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.052735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.053069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.053447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.053712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.054029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.054340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.054656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.055006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.055321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.055634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.055891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.056209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.056539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.056865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.057196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.057454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.057711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.058037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.058367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.058714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.059021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.059335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.059648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.059961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.060277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.060588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.060899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.061223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.061543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.061872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.062186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.062512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.062962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.063218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.063531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.063881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.064207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.064526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.064850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.065176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.065490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.065804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.066116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.067007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.067412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.067709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.067973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.068326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.068627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.068954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.069267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.069580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.069892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.070199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.070511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.070851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.071165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.071479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.071792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.072104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.072419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.072738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.073044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.073370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.073697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.074006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.074545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.074892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.075210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.075538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.075854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.076168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.076495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.076809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.077121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.077443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.077757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.078076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.078397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.078723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.079032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.079537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.079849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.080159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.080470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.080784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.081094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.081404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.081714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.082646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.082973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:53:16.083562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.083663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:53:16.083761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.083761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.083913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:53:16.083994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.084081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:53:16.084223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.084326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:53:16.084533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.084705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.084859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.085033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.085229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.085358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.085570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.085668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.085926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.086128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.086306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.086443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.086646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.086797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.087011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.087111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.087337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.087681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.087789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.087881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.087965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.088061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.088284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.088380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854266-1-iscsi {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.088603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.088713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.088907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.089009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.089222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.089344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.089545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.089647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.089855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.089971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.090177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.090273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.090483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.090578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.090836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.091012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.091163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.091324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.091480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.091632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.091807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.091942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.092144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.092279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.092476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.092597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.092794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.092941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.093146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.093245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.093497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.093596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.093817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.093918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.094123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.094213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.094468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.094565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854266-1-iscsi {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.094813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.094910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.095132 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.095231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.095444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.095541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.095767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.095857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.096103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.096193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.096420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.096523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.096742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.096847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.097061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.097162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.097367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.097463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.097774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.097951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.098108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.098283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.098430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.098530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.098666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.098829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.099019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.099133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.099347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.099488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.099645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.099736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.099966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.100095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.100274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.100381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.100581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.100677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.100835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.100948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.101141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.101240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.101464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.101555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.101783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.101945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.102107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.102244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.102370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.102536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.102797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.102951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.103092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.103272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.103444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.103600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.103773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.103876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.103968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.104051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.104132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.104316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.104454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.104632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.104756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.104998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.105306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.105610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.105736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.105926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.106033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.106242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.106346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.106561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.106666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.106895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.107004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.107216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.107327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.107538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.107633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.97 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.107865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.97 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.107970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.108153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.108263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.108484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.108583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.108798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.108922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.109108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.109220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.109428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.109544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.109747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.109845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.110058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.110172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.110364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.110471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.110673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.110812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.111016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.111159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.111334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.111434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.111647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.111754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.111891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.112088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.112268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.112415 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.112589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.112793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.112929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.113033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.113119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.113314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.113491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.113650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.113805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.114004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.114156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.114345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.114497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.114662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.114827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.115001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.115105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.115309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.115430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.115650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.115752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.115962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.116099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.116335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.116555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.116664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.116874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.116972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.117187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.117290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.117519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.117615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.117841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.117959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.118165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.118315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.118444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.118645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.118790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.118926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.119083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.119264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.119404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.119547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.119838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.120170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.120313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.120420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.120545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.120653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.120830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.121106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.121214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.121338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.121510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.121655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.121817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.121981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.122183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.122345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.122485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.122633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.122869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.123009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.123155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.123302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.123448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.123593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.123737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.123884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.124043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.124137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.124221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.124221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.124379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.124467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.124566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.124708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.124811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.125034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.125201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.125353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.125508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.125667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.125847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.125946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.126190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.126291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.126517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.126609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.126844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.126948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.127165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:53:16.127273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.127487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.127585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.127806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.127904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.128124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.128230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.128442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.128534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.128759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.129346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.129629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.129889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.130073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.130204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.130322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.130514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.130619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.130857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.130962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.131187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.131333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.131500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.131606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.131814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.131904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.132127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.132262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.132445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.132537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.132766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.132858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.133095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.133185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.133414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.133512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.133730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.133821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.134050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.134143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.134361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.134461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.134679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.134789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.135013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.135105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.135327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.135428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.135640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.135745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.135961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.136057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.136280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.136379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.136598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.136696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.136910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.137016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.137233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.137323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.137541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.137639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.137850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.137954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.138157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.138254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.138474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.138562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.138827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.138940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.139144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.139267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.139457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.139560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.139768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.139869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.140079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.140211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.140390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.140523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.140706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.141023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.141360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.141508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.141673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.141791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.141990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.142110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.142303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.142429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.142617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.142750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.142958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.143076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.143272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.143405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.143585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.143702 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.143890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.144016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.144238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.145076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.145271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.145482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.145680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.145802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.145910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.146123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.146237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.146355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.146464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.146663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.146815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.147005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.147136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.147472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.147650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.147768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.147897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.148046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.148162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.148311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.148401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.148572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.148672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.148889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.149038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.149208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.149307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.149526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.149624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.149832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.149998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.150147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.150239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.150466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.150564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.150802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.151081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.151175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.151425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.151544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.151733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.151845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.152051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.152148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.152362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.152466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.152676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.152787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.152988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.153085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.153301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.153397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.153626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.153732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.153940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.154050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.154253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.154365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.154566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.154673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.154915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.155011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.155229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.155331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.155538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.155640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.155851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.155955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.156160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.156263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.156463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.156562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.156773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.156867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.157079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.157171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.157382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.157473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.157683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.157829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.157994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.158096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.158296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.158393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.158599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.158774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.158928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.159029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.159231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.159324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.159534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.159634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.159856 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.159954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.160198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.160358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.160517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.160688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.160885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.160980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.161146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.161260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.161496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.161610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.161830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.161928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.162177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.162272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.162488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.162591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.162821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.162928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.163151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.163254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.163461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.163578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.163771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.163870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.164080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.164174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.164396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.164496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.164710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.164800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.165016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.165115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.165331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.165423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.165642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.165745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.165955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.166054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.166264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.166372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.166583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.166731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.166907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.167048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.167232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.167358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.167520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.167638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.168159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.168343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.168467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.168575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.168683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.168790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.169003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.169145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.169306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.169423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.169613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.169732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.169929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.170047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.170237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.170360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.170555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.170670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.170889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.171016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.171201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.171326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.171506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.171641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.171954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.172127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.172463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.172793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.173108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.173419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.173729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.174044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.174353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.174662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.174981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.175159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.175317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.175442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.175641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.175868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.176038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.176246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.176462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.176626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.176816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.176944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.177165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.177293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.177490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.177608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.177819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.177936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.178129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.178274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.178529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.178646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.178810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.178923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.179042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.179337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.179456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.179662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.179778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.179972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.180105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.180281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.180407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.180589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.180707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.180903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.181030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.181218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.181343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.181537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.181664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.181861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.182093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.182238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.182517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.182861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.182998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.183203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.183363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.183496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.183784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.183914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.184108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.184276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.184408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.184722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.184861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.185028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.185204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.185345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.185632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.185771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.185953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.186117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.186256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.186582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.186806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.186952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.187260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.187393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.187568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.187758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.187890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.188186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.188323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.188607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.188759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.188896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.189075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.189214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.189418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.189576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.189744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.189965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.190116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.190287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.190446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.190587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.190784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.190934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.191075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.191786 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.192021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.192391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.192743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.192905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.192905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.193192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.193334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.193485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.193627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.193774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.193915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.194055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.194201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.194356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.194511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.194659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.194850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.194992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.195140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.195290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.195438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.195587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.195737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.195876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.196016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.196164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.196312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.196462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.196611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.196904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.197070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.197212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.197351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.197519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.197669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.197840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.197996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.198148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.198290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.198438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.198596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.198882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.199043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.199185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.199333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.199473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.199621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.199770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.200017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.200176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.200359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.200515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.200678 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.200832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.200974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.201122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.201270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.201410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.201559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.201709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.201883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.202032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.202232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.202476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.202634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.202923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.203161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.203342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.203506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.203649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.203790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.203944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.204093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.204267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.204424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.204573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.204721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.204904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.205075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.205216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.205370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.205520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.205660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.205800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.205939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.206130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.206288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.206459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.206608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.206802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.207638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.207891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.208151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.208364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.208521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.208663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.208804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.209088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.209245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.209387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.209535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.209683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.209824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.209824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.210127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.210127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.210396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.210535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.210711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.210711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.211016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.211164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.211305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.211453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.211613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.211762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.211921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.212063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.212203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.212351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.212519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.212748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.212924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.213101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.213243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.213399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.213556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.213705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.213854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.214013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.214163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.214316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.214465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.214619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.214785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.214927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.215078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.215228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.215369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.215664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.215837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.215992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.216133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.216288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.216431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.216572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.216720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.216868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.217010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.217159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.217299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.217440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.217588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.217729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.217893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.218036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.218223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.218458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.218628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.218826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.218986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.218986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.219389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.219389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.219688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.219936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.220108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.220274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.220423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.220572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.220714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.220853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.221007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.221155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.221295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.221442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.221593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.221815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.221960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.222101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.222252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.222393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.222603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.223083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.223315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.223472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.223472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.223749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.223900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.224051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.224201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.224352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.224505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.224645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.224791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.224942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.225090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.225239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.225388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.225528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.225677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.225825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.225966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.226114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.226262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.226423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.226578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.226816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.226964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.227106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.227254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.227254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.227538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.227680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.227820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.227959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.228108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.228260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.228425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.228573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.228713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.228853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.229000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.229151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.229435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.229583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.229732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.229732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.230009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.230164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.230306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.230457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.230605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.230778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.230934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.231091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.231241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.231388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.231538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.231703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.231845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.231985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.232125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.232273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.232431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.232582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.232582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.232850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.233023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.233250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.233250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.233534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.233682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.233830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.233978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.234120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.234277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.234439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.234589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.234760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.234908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.235050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.235207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.235350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.235499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.235648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.235789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.235937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.236091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.236251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.236394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.236543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.236730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.236880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.237189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.237346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.237498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.237640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.237815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.237974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.238139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.238364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.238567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.238881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.238881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.239241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.239524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.239686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.239836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.239978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.240134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.240285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.240427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.240579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.240728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.240869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.241019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.241168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.241309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.241450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.241589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.241741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.241903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.242052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.242201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.242350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.242502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.242642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.242879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.243031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.243173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.243426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.243576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.243799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.243799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.244078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.244221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.244221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.244514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.244514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.244800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.244942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.245090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.245237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.245378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.245527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.245669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.245808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.245956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.246096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.246236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.246404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.246562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.246723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.246871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.247024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.247180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.247454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.247742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.247742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.248035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.248175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.248330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.248472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.248623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.248763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.248902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.249052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.249207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.249356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.249554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.249799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.249947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.250089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.250243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.250385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.250536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.250706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.250857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.251015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.251207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.251366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.251509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.251648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.251789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.251945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.252091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.252233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.252407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.252571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.252721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.252875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.253024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.253179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.253330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.253627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.254480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.254847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.254847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.255323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.255484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.255629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.255629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.255932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.256075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.256216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.256358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.256507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.256657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.256800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.256941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.257082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.257223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.257363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.257528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.257677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.257818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.257958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.258098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.258238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.258387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.258530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.258678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.258846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.258998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.259150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.259302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.259462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.259656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.259820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.260067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.260229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.260372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.260522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.260664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.260805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.260954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.261110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.261252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.261401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.261561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.261705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.261845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.261995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.262137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.262286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.262427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.262575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.262779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.262935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.263093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.263250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.263405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.263591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.263859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.264013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.264159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.264316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.264464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.264611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.264773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.264922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.265089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.265325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.265485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.265642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.265816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.265972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.266121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.266276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.266431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.266595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.266772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.266936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.267138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.267302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.267458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.267615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.267773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.267929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.268077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.268224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.268371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.268527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.268675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.268829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.268979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.269126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.269272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.269457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.270230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.270626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.270915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.271101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.271101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.271407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.271564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.271722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.271872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.272028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.272187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.272342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.272498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.272671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.272824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.272971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.273134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.273290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.273439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.273593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.273593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.273907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.274149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.274304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.274453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.274607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.274833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.275071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.275230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.275386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.275541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.275697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.275844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.276004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.276152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.276300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.276446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.276592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.276745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.276917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.277066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.277220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.277376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.277523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.277686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.277834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.277981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.278127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.278274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.278422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.278584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.278762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.278926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.279075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.279222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.279370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.279532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.279681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.279826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.279980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.280135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.280336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.280498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.280498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.280919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.280919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.281201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.281201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.281500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.281649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.281803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.281958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.282114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.282272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.282427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.282583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.282820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.282974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.283129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.283292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.283441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.283595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.283744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.283744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.284040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.284297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.284297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.284602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.284752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.284918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.285585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.285756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.285997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.286237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.286237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.286673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.286871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.287023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.287023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.287320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.287468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.287468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.287772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.287923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.288076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.288231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.288377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.288532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.288688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.288836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.288989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.289137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.289283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.289448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.289606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.289754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.289901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.290055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.290201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.290405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.290558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.290738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.290988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.291142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.291302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.291453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.291600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.291769 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.291926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.292077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.292237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.292387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.292533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.292685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.293095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.293250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.293406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.293555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.293709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.293871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.293871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.294167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.294334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.294334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.294730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.294886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.295045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.295205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.295353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.295508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.295656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.295820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.295969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.296129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.296286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.296434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.296581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.296727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.296936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.297089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.297245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.297393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.297547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.297702 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.297868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.298017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.298165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.298328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.298485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.298640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.298825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.298974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.299130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.299276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.299431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.299593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.299758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.299907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.300054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.300207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.300354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.300559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.301309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.301675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.301933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.302110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.302267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.302429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.302591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.302798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.302962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.303138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.303299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.303448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.303603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.303758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.303906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.304052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.304052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.304349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.304512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.304783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.304939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.305095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.305253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.305401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.305548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.305696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.305844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.305990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.306212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.306370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.306526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.306709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.306882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.307047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.307197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.307345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.307499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.307499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120557) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:53:16.308397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.308799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.309152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.309508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.310271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.310271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.310624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.310846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.311168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.311494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.311828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.312150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.312465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.312779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.313100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.313420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.313734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.314055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.314369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.315209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.315209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.315544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.315693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.315948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.316261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.316602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.316915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.317223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.317538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.317956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.318403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.318780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.319067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.319378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.319779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.319998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.320329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.320639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.320996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.321322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.321648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.321977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.322293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.322611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.323013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.323337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.323907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.324249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.324576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.324916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.325264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.325562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.325872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.326182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.326508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.326849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.327168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.327482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.327795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.328108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.328531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.328854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.329169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.329490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.329795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.330109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.330422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.330772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.331088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.331413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.331760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.332404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.332725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.333049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.333372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.333688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.334003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.334318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.334633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.334983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.335319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.335641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.335948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.336383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.336705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.337030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.337355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.337671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.337998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.338351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.338665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.339029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.339346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.339680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.340023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.340354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.340680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.340990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.341299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.341612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.341924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.342244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.342552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.342883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.343190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.343563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.343873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.344180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.344486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.344790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.345100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.345405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.345731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.346009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.346314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.346620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.346988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.347296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.348311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.348809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.349013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.349217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.349523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.349859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.350199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.350517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.350885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.351183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.351508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.351820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.352148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.352475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.352793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.353105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.353441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.353755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.354070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.354383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.354706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.355056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.355370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.355867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.356137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.356450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.356905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.357101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.357406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.357724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.358038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.358370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.358719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.359012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.359325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.359638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.359950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.360766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.360766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.361100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.361259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.361469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.361795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.362126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.362442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.362803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.363118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.364152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.364477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.364927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.365267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.365587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.365905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.366214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:53:16.366461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120558) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:53:16.370635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO dbcounter [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Registered counter for database nova_api Aug 24 04:53:16.391795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_db.sqlalchemy.engines [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:53:16.399320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writer thread running {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:53:16.429348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO dbcounter [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Registered counter for database nova_api Aug 24 04:53:16.450025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:53:16.456862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writer thread running {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:53:16.457033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.context [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d9a825ce-3fb0-4120-988e-13c2ad98da6a(cell1) {{(pid=120557) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:53:16.461446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:16.461922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:16.463497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:16.464234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:16.464659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:16.466647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:16.468668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO dbcounter [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Registered counter for database nova_cell0 Aug 24 04:53:16.472643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO dbcounter [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Registered counter for database nova_cell1 Aug 24 04:53:16.480246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_db.sqlalchemy.engines [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:53:16.481550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_db.sqlalchemy.engines [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:53:16.489692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writer thread running {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:53:16.490032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writer thread running {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:53:16.513187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.context [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d9a825ce-3fb0-4120-988e-13c2ad98da6a(cell1) {{(pid=120558) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 04:53:16.517202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:16.517677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:16.519279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:16.520346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:53:16.520799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:53:16.522797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:53:16.524782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO dbcounter [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Registered counter for database nova_cell0 Aug 24 04:53:16.528864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO dbcounter [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Registered counter for database nova_cell1 Aug 24 04:53:16.536530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:53:16.538675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:53:16.545408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writer thread running {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:53:16.548055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writer thread running {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:53:16.642344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO dbcounter [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Registered counter for database nova_cell0 Aug 24 04:53:16.649370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_db.sqlalchemy.engines [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120557) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:53:16.653775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writer thread running {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:53:16.696005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO dbcounter [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Registered counter for database nova_cell0 Aug 24 04:53:16.702585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_db.sqlalchemy.engines [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120558) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:53:16.707189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writer thread running {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:53:16.986580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: WARNING keystonemiddleware.auth_token [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:53:16.994995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: WARNING keystonemiddleware.auth_token [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:53:17.026743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: WARNING keystonemiddleware.auth_token [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:53:17.034178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: WARNING keystonemiddleware.auth_token [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:53:17.347309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: WARNING keystonemiddleware.auth_token [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:53:17.354284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: WARNING keystonemiddleware.auth_token [None req-04d6a66b-1023-41b8-8ee5-51031286eb06 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:53:17.359681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633f7dcf9c0 pid: 120557 (default app) Aug 24 04:53:17.379929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: WARNING keystonemiddleware.auth_token [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 04:53:17.385918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: WARNING keystonemiddleware.auth_token [None req-8fb334da-046c-49b0-84be-4e0d8acbfda0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 04:53:17.391255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633f7dcf9c0 pid: 120558 (default app) Aug 24 04:53:53.214202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=3 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:53.215761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=3 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:53.216671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=3 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:53.218250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=3 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:53.244707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=3 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:53.246512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=3 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:53.247496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=3 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:53.249020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=3 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:54.634333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-961eb2dd-f887-46bc-8a10-731a795afa7c tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Action: 'create', calling method: .version_select at 0x7f3591a4c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2053363301"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:54.763369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-043bda2e-85c3-4089-8b7c-64af17888ef9 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Action: 'create', calling method: .version_select at 0x7f3591a4d5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1046114410", "metadata": {"Type": "work"}}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-043bda2e-85c3-4089-8b7c-64af17888ef9 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Request method failure captured: Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 122 Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7gHmIBz_Ike6EZ6U7vabYFfMCldexPMQPPMhULqbzj74CV26vbP5qZOONJ0fZ7vybvDcjP7zBQ7f2BC4URng_AMp71nw0MF2qtlGLnfOducYX09pzaxDVV5qR8OeYQc_qe9_MtMNIucEF1EywYQqWP8unotcdLNWPCDdHziM9H6wI Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:53:54.780586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_a007a3b3a9c544f588d820352e19e7e3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 180c394891154ab0bd670ea64f51e08f Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1046114410", "metadata": {"Type": "work"}}} Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: Aug 24 04:53:54.782460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1046114410', 'metadata': {'Type': 'work'}}}} Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:54.783490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:53:54.785092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:53:54.786730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 04:53:54.786730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.789292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-043bda2e-85c3-4089-8b7c-64af17888ef9 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:54.796392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-043bda2e-85c3-4089-8b7c-64af17888ef9 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.600152 Aug 24 04:53:54.799014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1/1] 10.222.0.97 () {60 vars in 1156 bytes} [Wed Aug 24 04:53:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1604 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:53:54.809963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e8ba5452-44ca-4e18-9dda-35d5ef1d7460 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Action: 'create', calling method: .version_select at 0x7f3591a4ddc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1597509194", "metadata": {"Type": "work"}}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e8ba5452-44ca-4e18-9dda-35d5ef1d7460 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Request method failure captured: Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 120 Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7gHmIBz_Ike6EZ6U7vabYFfMCldexPMQPPMhULqbzj74CV26vbP5qZOONJ0fZ7vybvDcjP7zBQ7f2BC4URng_AMp71nw0MF2qtlGLnfOducYX09pzaxDVV5qR8OeYQc_qe9_MtMNIucEF1EywYQqWP8unotcdLNWPCDdHziM9H6wI Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:53:54.822564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_a007a3b3a9c544f588d820352e19e7e3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 180c394891154ab0bd670ea64f51e08f Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1597509194", "metadata": {"Type": "work"}}} Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: Aug 24 04:53:54.823871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1597509194', 'metadata': {'Type': 'work'}}}} Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi '0' Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:54.824641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:53:54.825911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:53:54.827069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 04:53:54.827069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.828615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e8ba5452-44ca-4e18-9dda-35d5ef1d7460 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:54.828615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e8ba5452-44ca-4e18-9dda-35d5ef1d7460 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022890 Aug 24 04:53:54.834978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 2/2] 10.222.0.97 () {60 vars in 1156 bytes} [Wed Aug 24 04:53:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:53:54.859370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eb621d91-d1c7-4907-bbc3-7d6a662c4723 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Action: 'create', calling method: .version_select at 0x7f3591987280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1117597232", "metadata": {"Type": "work"}}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eb621d91-d1c7-4907-bbc3-7d6a662c4723 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Request method failure captured: Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 119 Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7gHmIBz_Ike6EZ6U7vabYFfMCldexPMQPPMhULqbzj74CV26vbP5qZOONJ0fZ7vybvDcjP7zBQ7f2BC4URng_AMp71nw0MF2qtlGLnfOducYX09pzaxDVV5qR8OeYQc_qe9_MtMNIucEF1EywYQqWP8unotcdLNWPCDdHziM9H6wI Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:53:54.883068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_a007a3b3a9c544f588d820352e19e7e3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 180c394891154ab0bd670ea64f51e08f Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1117597232", "metadata": {"Type": "work"}}} Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: Aug 24 04:53:54.884666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1117597232', 'metadata': {'Type': 'work'}}}} Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise error Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi '' Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:54.885618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 04:53:54.888270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 04:53:54.891212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 04:53:54.891212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:54.899409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eb621d91-d1c7-4907-bbc3-7d6a662c4723 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:54.903499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-eb621d91-d1c7-4907-bbc3-7d6a662c4723 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.058370 Aug 24 04:53:54.910167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 3/3] 10.222.0.97 () {60 vars in 1156 bytes} [Wed Aug 24 04:53:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 04:53:54.917982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-45bcd56d-2055-48e9-a0a6-57f4b9b06219 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Calling method '.version_select at 0x7f3591987c10>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:55.408930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-45bcd56d-2055-48e9-a0a6-57f4b9b06219 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] HTTP exception thrown: Volume tempest-invalid-642880769 could not be found. Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-45bcd56d-2055-48e9-a0a6-57f4b9b06219 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Request method failure captured: Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-642880769 HTTP/1.1 Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7gHmIBz_Ike6EZ6U7vabYFfMCldexPMQPPMhULqbzj74CV26vbP5qZOONJ0fZ7vybvDcjP7zBQ7f2BC4URng_AMp71nw0MF2qtlGLnfOducYX09pzaxDVV5qR8OeYQc_qe9_MtMNIucEF1EywYQqWP8unotcdLNWPCDdHziM9H6wI Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:53:55.413381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_a007a3b3a9c544f588d820352e19e7e3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 180c394891154ab0bd670ea64f51e08f Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Volume tempest-invalid-642880769 could not be found. Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': 'tempest-invalid-642880769'} Aug 24 04:53:55.414749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-642880769 could not be found. (HTTP 404) (Request-ID: req-124354b7-ca68-4292-99d4-1996a96dcf01) Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:55.415628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:53:55.416793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-642880769 could not be found. Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:55.417909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-642880769 could not be found. Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-642880769 could not be found. Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-45bcd56d-2055-48e9-a0a6-57f4b9b06219 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Returning 404 to user: Volume tempest-invalid-642880769 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:55.419476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-45bcd56d-2055-48e9-a0a6-57f4b9b06219 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/tempest-invalid-642880769" status: 404 len: 98 microversion: 2.1 time: 0.503097 Aug 24 04:53:55.427998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 4/4] 10.222.0.97 () {58 vars in 1215 bytes} [Wed Aug 24 04:53:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-642880769 => generated 98 bytes in 517 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:53:55.433399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e772c973-c6b8-44e8-b9b9-8efe93b79c5d tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004194 Aug 24 04:53:55.438300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 5/5] 10.222.0.97 () {58 vars in 1140 bytes} [Wed Aug 24 04:53:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 04:53:55.443820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-115debd7-3589-4632-8b86-ddd382d5a54d tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004041 Aug 24 04:53:55.449182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 6/6] 10.222.0.97 () {58 vars in 1137 bytes} [Wed Aug 24 04:53:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 04:53:55.453906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7367bff6-3866-4830-9c89-7c2298dcb3d8 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Calling method '.version_select at 0x7f35918be5e0>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:55.668480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-7367bff6-3866-4830-9c89-7c2298dcb3d8 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] HTTP exception thrown: Volume 2567bbcb-63f1-4082-ac35-96abd7bdb03c could not be found. Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7367bff6-3866-4830-9c89-7c2298dcb3d8 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Request method failure captured: Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/os-volumes/2567bbcb-63f1-4082-ac35-96abd7bdb03c HTTP/1.1 Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7gHmIBz_Ike6EZ6U7vabYFfMCldexPMQPPMhULqbzj74CV26vbP5qZOONJ0fZ7vybvDcjP7zBQ7f2BC4URng_AMp71nw0MF2qtlGLnfOducYX09pzaxDVV5qR8OeYQc_qe9_MtMNIucEF1EywYQqWP8unotcdLNWPCDdHziM9H6wI Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:53:55.671478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_a007a3b3a9c544f588d820352e19e7e3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 180c394891154ab0bd670ea64f51e08f Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Volume 2567bbcb-63f1-4082-ac35-96abd7bdb03c could not be found. Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '2567bbcb-63f1-4082-ac35-96abd7bdb03c'} Aug 24 04:53:55.672850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2567bbcb-63f1-4082-ac35-96abd7bdb03c could not be found. (HTTP 404) (Request-ID: req-1a1798f4-111f-42af-9e02-21a332cb7a3b) Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:55.673782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:53:55.675166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2567bbcb-63f1-4082-ac35-96abd7bdb03c could not be found. Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 04:53:55.677984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2567bbcb-63f1-4082-ac35-96abd7bdb03c could not be found. Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2567bbcb-63f1-4082-ac35-96abd7bdb03c could not be found. Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7367bff6-3866-4830-9c89-7c2298dcb3d8 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Returning 404 to user: Volume 2567bbcb-63f1-4082-ac35-96abd7bdb03c could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:55.680710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7367bff6-3866-4830-9c89-7c2298dcb3d8 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/2567bbcb-63f1-4082-ac35-96abd7bdb03c" status: 404 len: 109 microversion: 2.1 time: 0.223566 Aug 24 04:53:55.682757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 7/7] 10.222.0.97 () {58 vars in 1248 bytes} [Wed Aug 24 04:53:55 2022] DELETE /compute/v2.1/os-volumes/2567bbcb-63f1-4082-ac35-96abd7bdb03c => generated 109 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:53:55.689710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1927f8fe-46ff-4abf-bd4a-218399554a31 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Calling method '.version_select at 0x7f35918be700>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:55.788165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-1927f8fe-46ff-4abf-bd4a-218399554a31 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] HTTP exception thrown: Volume a0796b18-7978-4a0e-99c6-6e9daed33e66 could not be found. Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1927f8fe-46ff-4abf-bd4a-218399554a31 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Request method failure captured: Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/os-volumes/a0796b18-7978-4a0e-99c6-6e9daed33e66 HTTP/1.1 Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7gHmIBz_Ike6EZ6U7vabYFfMCldexPMQPPMhULqbzj74CV26vbP5qZOONJ0fZ7vybvDcjP7zBQ7f2BC4URng_AMp71nw0MF2qtlGLnfOducYX09pzaxDVV5qR8OeYQc_qe9_MtMNIucEF1EywYQqWP8unotcdLNWPCDdHziM9H6wI Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:53:55.793491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_a007a3b3a9c544f588d820352e19e7e3", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/a007a3b3a9c544f588d820352e19e7e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: a007a3b3a9c544f588d820352e19e7e3 Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-VolumesNegativeTest-219352148 Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 180c394891154ab0bd670ea64f51e08f Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-VolumesNegativeTest-219352148-project Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Volume a0796b18-7978-4a0e-99c6-6e9daed33e66 could not be found. Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': 'a0796b18-7978-4a0e-99c6-6e9daed33e66'} Aug 24 04:53:55.794879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a0796b18-7978-4a0e-99c6-6e9daed33e66 could not be found. (HTTP 404) (Request-ID: req-f878349e-f11b-494a-a7a2-1d4864c2183a) Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:55.795741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:53:55.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a0796b18-7978-4a0e-99c6-6e9daed33e66 could not be found. Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 04:53:55.798153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a0796b18-7978-4a0e-99c6-6e9daed33e66 could not be found. Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a0796b18-7978-4a0e-99c6-6e9daed33e66 could not be found. Aug 24 04:53:55.800351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:53:55.806889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1927f8fe-46ff-4abf-bd4a-218399554a31 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] Returning 404 to user: Volume a0796b18-7978-4a0e-99c6-6e9daed33e66 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:53:55.808101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1927f8fe-46ff-4abf-bd4a-218399554a31 tempest-VolumesNegativeTest-219352148 tempest-VolumesNegativeTest-219352148-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/a0796b18-7978-4a0e-99c6-6e9daed33e66" status: 404 len: 109 microversion: 2.1 time: 0.125728 Aug 24 04:53:55.808941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 8/8] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 04:53:55 2022] GET /compute/v2.1/os-volumes/a0796b18-7978-4a0e-99c6-6e9daed33e66 => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:53:56.274868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-961eb2dd-f887-46bc-8a10-731a795afa7c tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.036140 Aug 24 04:53:56.275819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1/9] 10.222.0.97 () {60 vars in 1155 bytes} [Wed Aug 24 04:53:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3039 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 04:53:56.302880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8540b97-b1f2-4079-8491-28e7b09b1993 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f3591987280>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:56.411650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c8540b97-b1f2-4079-8491-28e7b09b1993 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71" status: 200 len: 345 microversion: 2.1 time: 0.124636 Aug 24 04:53:56.414406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 9/10] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 04:53:56 2022] GET /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:56.636110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cabf12f3-3d03-4eb4-a65b-1eee10df7348 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f359191f4c0>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:56.725849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cabf12f3-3d03-4eb4-a65b-1eee10df7348 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/32d4e92d-acac-442f-b3f7-af338968a8fc" status: 200 len: 348 microversion: 2.1 time: 0.096225 Aug 24 04:53:56.740409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 2/11] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 04:53:56 2022] GET /compute/v2.1/os-volumes/32d4e92d-acac-442f-b3f7-af338968a8fc => generated 348 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:57.430362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-afb77f18-ce95-46c3-915b-456d4bedab64 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f35918bec10>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:57.555284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-afb77f18-ce95-46c3-915b-456d4bedab64 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71" status: 200 len: 346 microversion: 2.1 time: 0.131686 Aug 24 04:53:57.555986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 10/12] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 04:53:57 2022] GET /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71 => generated 346 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:57.568718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-759df72d-4c07-4a6c-9bb1-623538471c20 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Action: 'create', calling method: .version_select at 0x7f359191fb80>, body: {"snapshot": {"volume_id": "68f6ee58-8fc1-4097-aaf0-c65e061dad71", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-244469854"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:53:58.076596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-759df72d-4c07-4a6c-9bb1-623538471c20 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.511661 Aug 24 04:53:58.077161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 3/13] 10.222.0.97 () {60 vars in 1162 bytes} [Wed Aug 24 04:53:57 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:58.089908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-70c31f7f-453b-40a4-846a-eb69e31576cf tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f35918be280>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:58.379854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-70c31f7f-453b-40a4-846a-eb69e31576cf tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 200 len: 286 microversion: 2.1 time: 0.294710 Aug 24 04:53:58.380493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 11/14] 10.222.0.97 () {58 vars in 1251 bytes} [Wed Aug 24 04:53:58 2022] GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 286 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:58.391307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4b030090-860a-4a6c-930b-b417072b17e2 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f3591934c10>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:58.494451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4b030090-860a-4a6c-930b-b417072b17e2 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.106756 Aug 24 04:53:58.495425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 4/15] 10.222.0.97 () {58 vars in 1140 bytes} [Wed Aug 24 04:53:58 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:58.507543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b043f9df-d8a0-4903-9ac6-5e616dbcf648 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f35918bf310>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:58.553735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-97be6de2-0a3c-41b0-8157-a624437272f1 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f359191fc10>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:58.611957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b043f9df-d8a0-4903-9ac6-5e616dbcf648 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 200 len: 286 microversion: 2.1 time: 0.108352 Aug 24 04:53:58.613127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 12/16] 10.222.0.97 () {58 vars in 1251 bytes} [Wed Aug 24 04:53:58 2022] GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:58.666950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-97be6de2-0a3c-41b0-8157-a624437272f1 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/e29a57b4-b570-4b6e-ae49-65a33d07390a" status: 200 len: 351 microversion: 2.1 time: 0.118470 Aug 24 04:53:58.668564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 5/17] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 04:53:58 2022] GET /compute/v2.1/os-volumes/e29a57b4-b570-4b6e-ae49-65a33d07390a => generated 351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:53:59.631252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-726ed29f-4eb3-4928-a099-32605c9fbde0 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f35918be4c0>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:53:59.738135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-726ed29f-4eb3-4928-a099-32605c9fbde0 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 200 len: 286 microversion: 2.1 time: 0.115984 Aug 24 04:53:59.739582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 13/18] 10.222.0.97 () {58 vars in 1251 bytes} [Wed Aug 24 04:53:59 2022] GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:00.751713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b6587501-fd3c-4cb4-93c8-5033437b89e4 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f359191f790>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:00.826571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b6587501-fd3c-4cb4-93c8-5033437b89e4 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 200 len: 286 microversion: 2.1 time: 0.078582 Aug 24 04:54:00.832090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 6/19] 10.222.0.97 () {58 vars in 1251 bytes} [Wed Aug 24 04:54:00 2022] GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:01.840099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8e17f8e8-85d2-468f-8bea-9b6810b40767 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f3591908b80>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:01.919324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8e17f8e8-85d2-468f-8bea-9b6810b40767 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 200 len: 286 microversion: 2.1 time: 0.083028 Aug 24 04:54:01.925809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 14/20] 10.222.0.97 () {58 vars in 1251 bytes} [Wed Aug 24 04:54:01 2022] GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:02.933683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9f543376-5cdf-45e9-9edd-2aac6bf2e857 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f3591a4c5e0>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:02.986906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9f543376-5cdf-45e9-9edd-2aac6bf2e857 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 200 len: 286 microversion: 2.1 time: 0.057139 Aug 24 04:54:02.988478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 7/21] 10.222.0.97 () {58 vars in 1251 bytes} [Wed Aug 24 04:54:02 2022] GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:04.001568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1654a5d0-f025-4ef6-b0b4-48233d0b6706 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f359191f940>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:04.048866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1654a5d0-f025-4ef6-b0b4-48233d0b6706 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 200 len: 286 microversion: 2.1 time: 0.052339 Aug 24 04:54:04.049841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 8/22] 10.222.0.97 () {58 vars in 1251 bytes} [Wed Aug 24 04:54:03 2022] GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 286 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:04.101698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-859575216", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "networks": [{"uuid": "36ee5974-a55a-4a8f-951f-e0033bd3f067"}]}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:04.372903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] validate_networks() for [('36ee5974-a55a-4a8f-951f-e0033bd3f067', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:54:05.061479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3e8e20d9-129a-47f4-9c39-15954143a760 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f35922f68b0>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:05.166040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3e8e20d9-129a-47f4-9c39-15954143a760 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 200 len: 287 microversion: 2.1 time: 0.108405 Aug 24 04:54:05.166803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 9/23] 10.222.0.97 () {58 vars in 1251 bytes} [Wed Aug 24 04:54:05 2022] GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:05.178239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-489290a1-562c-4d12-9d77-a7d28c2bd37d tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f35919344c0>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:05.350936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-489290a1-562c-4d12-9d77-a7d28c2bd37d tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "DELETE /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 202 len: 0 microversion: 2.1 time: 0.176665 Aug 24 04:54:05.351496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 10/24] 10.222.0.97 () {58 vars in 1254 bytes} [Wed Aug 24 04:54:05 2022] DELETE /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:54:05.360381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-04aa93e9-557f-4f62-8882-ade452f0eeb3 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f3591939310>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:05.430304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-04aa93e9-557f-4f62-8882-ade452f0eeb3 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 200 len: 286 microversion: 2.1 time: 0.073977 Aug 24 04:54:05.431039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 11/25] 10.222.0.97 () {58 vars in 1251 bytes} [Wed Aug 24 04:54:05 2022] GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:05.890988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-668aa02a-2a3d-4109-ac0a-8535ec54a6ab tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f3591934280>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:06.014657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-668aa02a-2a3d-4109-ac0a-8535ec54a6ab tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/10c893ec-4f22-41a5-8643-ca60e15933bd" status: 200 len: 350 microversion: 2.1 time: 0.127667 Aug 24 04:54:06.015235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 12/26] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 04:54:05 2022] GET /compute/v2.1/os-volumes/10c893ec-4f22-41a5-8643-ca60e15933bd => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:06.036238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4aa9c624-977a-433b-b507-824b6543f0f8 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f359191f700>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:06.230983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4aa9c624-977a-433b-b507-824b6543f0f8 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.199738 Aug 24 04:54:06.241041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 13/27] 10.222.0.97 () {58 vars in 1134 bytes} [Wed Aug 24 04:54:06 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:06.246036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b9c54633-f523-4491-907e-3061376eef65 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f3591939550>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:06.432739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:54:06.434878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:54:06.436319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:54:06.437027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:54:06.438069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:54:06.450546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b9c54633-f523-4491-907e-3061376eef65 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.207991 Aug 24 04:54:06.458859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 14/28] 10.222.0.97 () {58 vars in 1149 bytes} [Wed Aug 24 04:54:06 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:06.473524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:06.474317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:06.475158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:06.476300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:06.477042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:06.477329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fefef287-e869-4a94-9702-42db38bd0cbc tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f3591939940>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:06.477909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:06.530839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-fefef287-e869-4a94-9702-42db38bd0cbc tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] HTTP exception thrown: Snapshot 55b30871-bb86-4907-8f5f-affb3fc86e23 could not be found. Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fefef287-e869-4a94-9702-42db38bd0cbc tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Request method failure captured: Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 HTTP/1.1 Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa7hEVHg-n0NNVhqpXS4wYVBOUNGkpqsL48Q7Y7ltQvlq4SoplwscUTRLYJ2VqCE_DzzKHyxOMO6YdtIQOMhdPQ-MqZ09UBQk6aUNMqiYPpDI1R6y-sjLeusSxwuHyThNe7yFb5pyzbVjXZ88iGkDdeMIr0EoQ8RvTlaQzxik4y-NGI Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: ec046466355240ebb774ef45308f8f63 Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 04:54:06.536172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ec046466355240ebb774ef45308f8f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ec046466355240ebb774ef45308f8f63", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ec046466355240ebb774ef45308f8f63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ec046466355240ebb774ef45308f8f63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: ec046466355240ebb774ef45308f8f63 Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-VolumesSnapshotsTestJSON-1436697938-project Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: e7819dd27f3441c1982dc28cdc0b7f92 Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1436697938-project Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Snapshot 55b30871-bb86-4907-8f5f-affb3fc86e23 could not be found. Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '55b30871-bb86-4907-8f5f-affb3fc86e23'} Aug 24 04:54:06.537378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 55b30871-bb86-4907-8f5f-affb3fc86e23 could not be found. (HTTP 404) (Request-ID: req-78f6ffb3-24bb-4837-b275-41e117577caf) Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:06.537989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:54:06.538854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 55b30871-bb86-4907-8f5f-affb3fc86e23 could not be found. Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 04:54:06.539695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 55b30871-bb86-4907-8f5f-affb3fc86e23 could not be found. Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 55b30871-bb86-4907-8f5f-affb3fc86e23 could not be found. Aug 24 04:54:06.541493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:06.542094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Getting quotas for project 4e5ec225f4ae4da89c5fb7762191e236. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:06.543539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fefef287-e869-4a94-9702-42db38bd0cbc tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Returning 404 to user: Snapshot 55b30871-bb86-4907-8f5f-affb3fc86e23 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:06.545346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fefef287-e869-4a94-9702-42db38bd0cbc tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23" status: 404 len: 111 microversion: 2.1 time: 0.084654 Aug 24 04:54:06.548724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 15/29] 10.222.0.97 () {58 vars in 1251 bytes} [Wed Aug 24 04:54:06 2022] GET /compute/v2.1/os-snapshots/55b30871-bb86-4907-8f5f-affb3fc86e23 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:06.550540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Getting quotas for user 7e13e73729374a93ab04ed49d985a5d7 and project 4e5ec225f4ae4da89c5fb7762191e236. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:06.563284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-351a3573-5cae-404a-b582-7073c38ac577 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f35919344c0>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:06.563568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:54:06.567992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:54:06.694601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-23c9e348-4ea0-4f75-8609-c34885d9b05d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.843767 Aug 24 04:54:06.702293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 15/30] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:54:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:54:06.716596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-df7df3ac-b0ce-49db-9abf-e60ee0ce9683 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f35917c6670>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:06.796581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-351a3573-5cae-404a-b582-7073c38ac577 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.245645 Aug 24 04:54:06.797622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 16/31] 10.222.0.97 () {58 vars in 1134 bytes} [Wed Aug 24 04:54:06 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:06.803526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-891627f8-6dd2-49b8-94fc-201cccc484a2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:06.804426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-891627f8-6dd2-49b8-94fc-201cccc484a2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:06.912077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-df7df3ac-b0ce-49db-9abf-e60ee0ce9683 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71" status: 202 len: 0 microversion: 2.1 time: 0.208243 Aug 24 04:54:06.913790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 16/32] 10.222.0.97 () {58 vars in 1248 bytes} [Wed Aug 24 04:54:06 2022] DELETE /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:54:06.931276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-893d9d8c-d242-4277-8f7c-adff9b984b33 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f35917c6d30>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:07.173138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-893d9d8c-d242-4277-8f7c-adff9b984b33 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.255999 Aug 24 04:54:07.174018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 17/33] 10.222.0.97 () {58 vars in 1167 bytes} [Wed Aug 24 04:54:06 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:07.180287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ea1aadbb-1e97-4851-a5c7-d59407be1b28 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f35917c6ca0>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:07.231976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-891627f8-6dd2-49b8-94fc-201cccc484a2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:07.258420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-ea1aadbb-1e97-4851-a5c7-d59407be1b28 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] HTTP exception thrown: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ea1aadbb-1e97-4851-a5c7-d59407be1b28 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Request method failure captured: Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71 HTTP/1.1 Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7hEVHg-n0NNVhqpXS4wYVBOUNGkpqsL48Q7Y7ltQvlq4SoplwscUTRLYJ2VqCE_DzzKHyxOMO6YdtIQOMhdPQ-MqZ09UBQk6aUNMqiYPpDI1R6y-sjLeusSxwuHyThNe7yFb5pyzbVjXZ88iGkDdeMIr0EoQ8RvTlaQzxik4y-NGI Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: ec046466355240ebb774ef45308f8f63 Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:54:07.260776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ec046466355240ebb774ef45308f8f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ec046466355240ebb774ef45308f8f63", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ec046466355240ebb774ef45308f8f63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ec046466355240ebb774ef45308f8f63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: ec046466355240ebb774ef45308f8f63 Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-VolumesSnapshotsTestJSON-1436697938-project Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: e7819dd27f3441c1982dc28cdc0b7f92 Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1436697938-project Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '68f6ee58-8fc1-4097-aaf0-c65e061dad71'} Aug 24 04:54:07.261811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. (HTTP 404) (Request-ID: req-8e2927ff-ffc6-4b6b-93f2-4e455affee2d) Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.262496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:54:07.263414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 04:54:07.264405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.265321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.270840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ea1aadbb-1e97-4851-a5c7-d59407be1b28 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Returning 404 to user: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:07.274226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ea1aadbb-1e97-4851-a5c7-d59407be1b28 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71" status: 404 len: 109 microversion: 2.1 time: 0.097647 Aug 24 04:54:07.275000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 18/34] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 04:54:07 2022] GET /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:07.288862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d26b6460-4908-44e4-8349-02ef460e862f tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f3590751c10>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:07.289490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-891627f8-6dd2-49b8-94fc-201cccc484a2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1214 microversion: 2.1 time: 0.490496 Aug 24 04:54:07.293703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 17/35] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:06 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1214 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:07.301485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cd6ae175-4592-450b-9d0d-7ae47e43cb81 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f3591939ee0>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:07.384611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-cd6ae175-4592-450b-9d0d-7ae47e43cb81 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] HTTP exception thrown: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cd6ae175-4592-450b-9d0d-7ae47e43cb81 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Request method failure captured: Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71 HTTP/1.1 Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa7hEVHg-n0NNVhqpXS4wYVBOUNGkpqsL48Q7Y7ltQvlq4SoplwscUTRLYJ2VqCE_DzzKHyxOMO6YdtIQOMhdPQ-MqZ09UBQk6aUNMqiYPpDI1R6y-sjLeusSxwuHyThNe7yFb5pyzbVjXZ88iGkDdeMIr0EoQ8RvTlaQzxik4y-NGI Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: ec046466355240ebb774ef45308f8f63 Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 04:54:07.389488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ec046466355240ebb774ef45308f8f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ec046466355240ebb774ef45308f8f63", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ec046466355240ebb774ef45308f8f63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ec046466355240ebb774ef45308f8f63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: ec046466355240ebb774ef45308f8f63 Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-VolumesSnapshotsTestJSON-1436697938-project Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: e7819dd27f3441c1982dc28cdc0b7f92 Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1436697938-project Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '68f6ee58-8fc1-4097-aaf0-c65e061dad71'} Aug 24 04:54:07.390836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. (HTTP 404) (Request-ID: req-b9c6140f-d7f7-404a-9588-11f98f481f91) Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.391599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 04:54:07.392702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 04:54:07.393754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.396617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.400146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cd6ae175-4592-450b-9d0d-7ae47e43cb81 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Returning 404 to user: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:07.401732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cd6ae175-4592-450b-9d0d-7ae47e43cb81 tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71" status: 404 len: 109 microversion: 2.1 time: 0.105223 Aug 24 04:54:07.405622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 18/36] 10.222.0.97 () {58 vars in 1248 bytes} [Wed Aug 24 04:54:07 2022] DELETE /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71 => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:07.413765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1a73a6eb-ea69-4efe-a828-01bcddd74d5a tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Calling method '.version_select at 0x7f3591862b80>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:07.461913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-1a73a6eb-ea69-4efe-a828-01bcddd74d5a tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] HTTP exception thrown: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1a73a6eb-ea69-4efe-a828-01bcddd74d5a tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Request method failure captured: Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71 HTTP/1.1 Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa7hEVHg-n0NNVhqpXS4wYVBOUNGkpqsL48Q7Y7ltQvlq4SoplwscUTRLYJ2VqCE_DzzKHyxOMO6YdtIQOMhdPQ-MqZ09UBQk6aUNMqiYPpDI1R6y-sjLeusSxwuHyThNe7yFb5pyzbVjXZ88iGkDdeMIr0EoQ8RvTlaQzxik4y-NGI Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: ec046466355240ebb774ef45308f8f63 Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 04:54:07.464417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ec046466355240ebb774ef45308f8f63"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ec046466355240ebb774ef45308f8f63", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ec046466355240ebb774ef45308f8f63"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ec046466355240ebb774ef45308f8f63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: ec046466355240ebb774ef45308f8f63 Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1436697938 Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-VolumesSnapshotsTestJSON-1436697938-project Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: e7819dd27f3441c1982dc28cdc0b7f92 Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1436697938-project Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '68f6ee58-8fc1-4097-aaf0-c65e061dad71'} Aug 24 04:54:07.465430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. (HTTP 404) (Request-ID: req-5eb83304-cdfc-4dbb-86ac-2b5f537571a1) Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.466042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 04:54:07.466968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 04:54:07.467841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. Aug 24 04:54:07.468673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:54:07.472259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1a73a6eb-ea69-4efe-a828-01bcddd74d5a tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] Returning 404 to user: Volume 68f6ee58-8fc1-4097-aaf0-c65e061dad71 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:54:07.478911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1a73a6eb-ea69-4efe-a828-01bcddd74d5a tempest-VolumesSnapshotsTestJSON-1436697938 tempest-VolumesSnapshotsTestJSON-1436697938-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71" status: 404 len: 109 microversion: 2.1 time: 0.065979 Aug 24 04:54:07.479680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 19/37] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 04:54:07 2022] GET /compute/v2.1/os-volumes/68f6ee58-8fc1-4097-aaf0-c65e061dad71 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:07.541644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d26b6460-4908-44e4-8349-02ef460e862f tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.265417 Aug 24 04:54:07.542465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 19/38] 10.222.0.97 () {58 vars in 1170 bytes} [Wed Aug 24 04:54:07 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:07.560287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a6086da3-9644-46e4-a9ac-0febbed61b83 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f35919344c0>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:07.771337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a6086da3-9644-46e4-a9ac-0febbed61b83 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.218812 Aug 24 04:54:07.772218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 20/39] 10.222.0.97 () {58 vars in 1155 bytes} [Wed Aug 24 04:54:07 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:07.790340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7ca7448e-94b3-42ef-b364-dc9b8dc5f9c1 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f3591880550>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:08.107787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1412350349", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:08.148439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7ca7448e-94b3-42ef-b364-dc9b8dc5f9c1 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.360798 Aug 24 04:54:08.149623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 21/40] 10.222.0.97 () {58 vars in 1188 bytes} [Wed Aug 24 04:54:07 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:08.166539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-93bc4456-862a-429a-8fec-678f7caa17e1 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] Calling method '.version_select at 0x7f3591862310>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:08.245741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] validate_networks() for [('86f6a8b1-f4ca-4ffb-b7d1-ff8bb67eebf3', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:54:08.358748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-93bc4456-862a-429a-8fec-678f7caa17e1 tempest-VolumesTestJSON-2110055154 tempest-VolumesTestJSON-2110055154-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.197550 Aug 24 04:54:08.379401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 22/41] 10.222.0.97 () {58 vars in 1155 bytes} [Wed Aug 24 04:54:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:08.405557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aa384f48-d734-4780-9f4e-ea77472c47e0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:08.410625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aa384f48-d734-4780-9f4e-ea77472c47e0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:08.819938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aa384f48-d734-4780-9f4e-ea77472c47e0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:08.833731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aa384f48-d734-4780-9f4e-ea77472c47e0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1214 microversion: 2.1 time: 0.449574 Aug 24 04:54:08.836812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 23/42] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:08 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1214 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:09.680488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:54:09.680984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:54:09.681375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:54:09.683170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:54:09.683493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:54:09.737039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:09.737747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:09.738363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:09.756692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:09.757203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:09.757654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:09.809041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Getting quotas for project 3c309287c4964e60a66398d9841b9c29. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:09.816203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Getting quotas for user 246605916c884dfab9aa75297e358d6f and project 3c309287c4964e60a66398d9841b9c29. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:09.833252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:54:09.842233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:54:09.860436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f725b8f-13a5-4c96-b7f1-eb67017c5229 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:09.861656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1f725b8f-13a5-4c96-b7f1-eb67017c5229 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:09.870522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f725b8f-13a5-4c96-b7f1-eb67017c5229 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:09.871274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f725b8f-13a5-4c96-b7f1-eb67017c5229 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:09.871853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f725b8f-13a5-4c96-b7f1-eb67017c5229 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:09.872977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f725b8f-13a5-4c96-b7f1-eb67017c5229 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:09.873793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f725b8f-13a5-4c96-b7f1-eb67017c5229 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:09.874353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f725b8f-13a5-4c96-b7f1-eb67017c5229 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:09.941396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c48cc499-daa7-454f-a5d3-59c0264a9cae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.169913 Aug 24 04:54:09.944212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 20/43] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:54:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 04:54:09.982060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9d9e21aa-f069-436b-a0e7-7c30dd5b00df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:09.987122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9d9e21aa-f069-436b-a0e7-7c30dd5b00df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:10.304582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9d9e21aa-f069-436b-a0e7-7c30dd5b00df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:10.359743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9d9e21aa-f069-436b-a0e7-7c30dd5b00df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1222 microversion: 2.1 time: 0.407371 Aug 24 04:54:10.372545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 21/44] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:09 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1222 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:10.574573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1f725b8f-13a5-4c96-b7f1-eb67017c5229 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:10.609576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1f725b8f-13a5-4c96-b7f1-eb67017c5229 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1210 microversion: 2.1 time: 0.755863 Aug 24 04:54:10.610166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 24/45] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:09 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1210 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:10.700719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1338102257", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:10.827971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] validate_networks() for [('86f6a8b1-f4ca-4ffb-b7d1-ff8bb67eebf3', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:54:11.644646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-16696e89-8ee3-4b4a-8e9f-9bfd42a8f62c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:11.652890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-16696e89-8ee3-4b4a-8e9f-9bfd42a8f62c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:11.710420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16696e89-8ee3-4b4a-8e9f-9bfd42a8f62c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:11.716629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16696e89-8ee3-4b4a-8e9f-9bfd42a8f62c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:11.718113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16696e89-8ee3-4b4a-8e9f-9bfd42a8f62c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:11.720629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16696e89-8ee3-4b4a-8e9f-9bfd42a8f62c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:11.722287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16696e89-8ee3-4b4a-8e9f-9bfd42a8f62c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:11.724523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16696e89-8ee3-4b4a-8e9f-9bfd42a8f62c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:12.034988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-16696e89-8ee3-4b4a-8e9f-9bfd42a8f62c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:12.048225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-16696e89-8ee3-4b4a-8e9f-9bfd42a8f62c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1272 microversion: 2.1 time: 0.415477 Aug 24 04:54:12.051834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 25/46] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:11 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1272 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:13.086561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fd65d8b6-564b-404e-a692-99a0310e89ad tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:13.092835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fd65d8b6-564b-404e-a692-99a0310e89ad tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:13.117344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd65d8b6-564b-404e-a692-99a0310e89ad tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:13.121606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd65d8b6-564b-404e-a692-99a0310e89ad tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:13.122424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd65d8b6-564b-404e-a692-99a0310e89ad tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:13.126969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd65d8b6-564b-404e-a692-99a0310e89ad tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:13.127882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd65d8b6-564b-404e-a692-99a0310e89ad tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:13.131383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd65d8b6-564b-404e-a692-99a0310e89ad tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:14.488470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fd65d8b6-564b-404e-a692-99a0310e89ad tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:14.497895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fd65d8b6-564b-404e-a692-99a0310e89ad tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1272 microversion: 2.1 time: 1.428073 Aug 24 04:54:14.515458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 26/47] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:13 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1272 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:15.541000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c7040692-9cfb-4187-85e2-d78d52c1d38b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:15.541668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c7040692-9cfb-4187-85e2-d78d52c1d38b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:15.557114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7040692-9cfb-4187-85e2-d78d52c1d38b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:15.563843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7040692-9cfb-4187-85e2-d78d52c1d38b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:15.565696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7040692-9cfb-4187-85e2-d78d52c1d38b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:15.572747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7040692-9cfb-4187-85e2-d78d52c1d38b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:15.574818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7040692-9cfb-4187-85e2-d78d52c1d38b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:15.575123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7040692-9cfb-4187-85e2-d78d52c1d38b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:15.998643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:54:16.000145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:54:16.001193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:54:16.002655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:54:16.003272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:54:16.022198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:16.023009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:16.023598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:16.029279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:16.030310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:16.030970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:16.088781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c7040692-9cfb-4187-85e2-d78d52c1d38b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:16.107404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c7040692-9cfb-4187-85e2-d78d52c1d38b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1272 microversion: 2.1 time: 0.570456 Aug 24 04:54:16.108684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Getting quotas for project 3c309287c4964e60a66398d9841b9c29. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:16.112803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 27/48] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:15 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1272 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:16.125592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Getting quotas for user 246605916c884dfab9aa75297e358d6f and project 3c309287c4964e60a66398d9841b9c29. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:16.181314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:54:16.184349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:54:16.310126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-354fb532-d159-414c-9672-f2c860968161 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.620762 Aug 24 04:54:16.312999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 22/49] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:54:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 5624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:54:16.323280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bd1c4f83-fc99-45c7-a0e1-66243110bb90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:16.324146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bd1c4f83-fc99-45c7-a0e1-66243110bb90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:16.975793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bd1c4f83-fc99-45c7-a0e1-66243110bb90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:17.008614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bd1c4f83-fc99-45c7-a0e1-66243110bb90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1222 microversion: 2.1 time: 0.669058 Aug 24 04:54:17.012519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 28/50] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:16 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1222 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:17.139505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c383264e-a033-4f59-84ff-2fee628e1319 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:17.140128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c383264e-a033-4f59-84ff-2fee628e1319 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:17.161491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c383264e-a033-4f59-84ff-2fee628e1319 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:17.165378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c383264e-a033-4f59-84ff-2fee628e1319 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:17.165853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c383264e-a033-4f59-84ff-2fee628e1319 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:17.166590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c383264e-a033-4f59-84ff-2fee628e1319 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:17.167074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c383264e-a033-4f59-84ff-2fee628e1319 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:17.167492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c383264e-a033-4f59-84ff-2fee628e1319 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:18.014237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c383264e-a033-4f59-84ff-2fee628e1319 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:18.031019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c383264e-a033-4f59-84ff-2fee628e1319 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.895172 Aug 24 04:54:18.031910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 23/51] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:17 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:18.040235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dfccef7c-8a0e-460d-a45c-ab32f802dba0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:18.041478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dfccef7c-8a0e-460d-a45c-ab32f802dba0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:18.054059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfccef7c-8a0e-460d-a45c-ab32f802dba0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:18.055392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfccef7c-8a0e-460d-a45c-ab32f802dba0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:18.056220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfccef7c-8a0e-460d-a45c-ab32f802dba0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:18.058353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfccef7c-8a0e-460d-a45c-ab32f802dba0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:18.059973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfccef7c-8a0e-460d-a45c-ab32f802dba0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:18.089848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfccef7c-8a0e-460d-a45c-ab32f802dba0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:18.342122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dfccef7c-8a0e-460d-a45c-ab32f802dba0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:18.371180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dfccef7c-8a0e-460d-a45c-ab32f802dba0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1218 microversion: 2.1 time: 0.337623 Aug 24 04:54:18.374129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 29/52] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:18 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1218 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:20.016914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ae48275c-5d80-4955-82e0-8be99dcd47d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Action: 'create', calling method: .version_select at 0x7f35917c6160>, body: {"keypair": {"name": "tempest-keypair-1624361171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK68EgohLk8I3o+AIpWDnyxcy8KAi4zqfsVnqDEKqTBxOrzvkJ95rm2b75l1s9D/doQyaTkqj/jCZETdvrOjpimDwox8LQKC4LyCVnfjyW1l0Eo9XOIzPJGwhxZ5Zh774w=="}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:20.034883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7690a257-9033-4b65-b326-a27649d24793 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: .version_select at 0x7f35917bb040>, body: {"keypair": {"name": "tempest-keypair-1370825006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAisZ7AbbwkWItuq4Kovmz4hsVNRvU8khvhWz4m3B0O/t/qChEhQCrc3rJ9EDzXKU096ChrOf6K6HPCMokiScDJOd1k4PTRE9NuEycj8nWJS6Rsnp3yC+XgcWfmplozBHw=="}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:20.206617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-ae48275c-5d80-4955-82e0-8be99dcd47d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Getting quotas for project c2394a6093e241469dd0900c8efad29c. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:20.247529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-ae48275c-5d80-4955-82e0-8be99dcd47d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Getting quotas for user 5c6fb51f911e40338628bd734299c0d0 and project c2394a6093e241469dd0900c8efad29c. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:20.335836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-7690a257-9033-4b65-b326-a27649d24793 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'key_pairs'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:20.364744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-7690a257-9033-4b65-b326-a27649d24793 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for user 4bc6971289b943aebec90909ffb8096a and project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'key_pairs'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:20.372183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ae48275c-5d80-4955-82e0-8be99dcd47d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.433086 Aug 24 04:54:20.384165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 24/53] 10.222.0.97 () {60 vars in 1159 bytes} [Wed Aug 24 04:54:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:20.399731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f8337a80-fcdd-4491-ab13-05c790bc2dd2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:20.403275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f8337a80-fcdd-4491-ab13-05c790bc2dd2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:20.429348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8337a80-fcdd-4491-ab13-05c790bc2dd2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:20.432997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8337a80-fcdd-4491-ab13-05c790bc2dd2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:20.433526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8337a80-fcdd-4491-ab13-05c790bc2dd2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:20.438150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8337a80-fcdd-4491-ab13-05c790bc2dd2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:20.438707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8337a80-fcdd-4491-ab13-05c790bc2dd2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:20.439159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8337a80-fcdd-4491-ab13-05c790bc2dd2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:20.579073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7690a257-9033-4b65-b326-a27649d24793 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.570389 Aug 24 04:54:20.583858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 30/54] 10.222.0.97 () {60 vars in 1159 bytes} [Wed Aug 24 04:54:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:20.604040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-72ee5d8c-f92b-4ede-a536-c93f1c08d6d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:20.609790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-72ee5d8c-f92b-4ede-a536-c93f1c08d6d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:20.634673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ee5d8c-f92b-4ede-a536-c93f1c08d6d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:20.637724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ee5d8c-f92b-4ede-a536-c93f1c08d6d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:20.638423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ee5d8c-f92b-4ede-a536-c93f1c08d6d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:20.641389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ee5d8c-f92b-4ede-a536-c93f1c08d6d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:20.642834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ee5d8c-f92b-4ede-a536-c93f1c08d6d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:20.643611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ee5d8c-f92b-4ede-a536-c93f1c08d6d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:21.208404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-72ee5d8c-f92b-4ede-a536-c93f1c08d6d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:21.224250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-72ee5d8c-f92b-4ede-a536-c93f1c08d6d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1280 microversion: 2.1 time: 0.636097 Aug 24 04:54:21.227081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 31/55] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:20 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1280 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:22.249098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8d642e1f-1e06-4904-8294-3197033043a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:22.249719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8d642e1f-1e06-4904-8294-3197033043a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:22.270942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d642e1f-1e06-4904-8294-3197033043a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:22.273968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d642e1f-1e06-4904-8294-3197033043a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:22.274604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d642e1f-1e06-4904-8294-3197033043a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:22.276598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d642e1f-1e06-4904-8294-3197033043a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:22.281215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d642e1f-1e06-4904-8294-3197033043a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:22.290272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d642e1f-1e06-4904-8294-3197033043a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:22.888479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f8337a80-fcdd-4491-ab13-05c790bc2dd2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:22.901775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f8337a80-fcdd-4491-ab13-05c790bc2dd2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 2.516389 Aug 24 04:54:22.905817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 25/56] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:20 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 2520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:23.356184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8d642e1f-1e06-4904-8294-3197033043a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:23.376425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8d642e1f-1e06-4904-8294-3197033043a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1280 microversion: 2.1 time: 1.131444 Aug 24 04:54:23.377098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 32/57] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:22 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1280 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:23.392158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-68217b9e-ade0-4246-af80-b8985e1c1374 req-bee393b7-bc44-415d-a772-83168995bb4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "753ff212-29b2-4316-8343-c0edb0407444", "tag": "453466b4-98b4-4211-aef1-6ab4ea3f27fd"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:23.427622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-68217b9e-ade0-4246-af80-b8985e1c1374 req-bee393b7-bc44-415d-a772-83168995bb4c service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:23.428159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-68217b9e-ade0-4246-af80-b8985e1c1374 req-bee393b7-bc44-415d-a772-83168995bb4c service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:23.428779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-68217b9e-ade0-4246-af80-b8985e1c1374 req-bee393b7-bc44-415d-a772-83168995bb4c service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:23.493486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-68217b9e-ade0-4246-af80-b8985e1c1374 req-bee393b7-bc44-415d-a772-83168995bb4c service nova] Creating event network-changed:453466b4-98b4-4211-aef1-6ab4ea3f27fd for instance 753ff212-29b2-4316-8343-c0edb0407444 on hv-cinder-85426 Aug 24 04:54:23.494032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-68217b9e-ade0-4246-af80-b8985e1c1374 req-bee393b7-bc44-415d-a772-83168995bb4c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120557) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 04:54:23.497439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-68217b9e-ade0-4246-af80-b8985e1c1374 req-bee393b7-bc44-415d-a772-83168995bb4c service nova] Acquired lock "compute-rpcapi-router" {{(pid=120557) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 04:54:23.499970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca80214a-2ace-4544-b3d5-368aeb7b980a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:23.500474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca80214a-2ace-4544-b3d5-368aeb7b980a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:23.501091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca80214a-2ace-4544-b3d5-368aeb7b980a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:23.501646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca80214a-2ace-4544-b3d5-368aeb7b980a None None] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:23.504282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca80214a-2ace-4544-b3d5-368aeb7b980a None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:23.506208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca80214a-2ace-4544-b3d5-368aeb7b980a None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:23.556506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.compute.rpcapi [None req-ca80214a-2ace-4544-b3d5-368aeb7b980a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 04:54:23.559534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca80214a-2ace-4544-b3d5-368aeb7b980a None None] Releasing lock "compute-rpcapi-router" {{(pid=120557) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 04:54:23.606880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ca80214a-2ace-4544-b3d5-368aeb7b980a None None] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.529401 Aug 24 04:54:23.608168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 26/58] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:23.929341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d808261f-b626-47b6-a002-bbea8be510bc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:23.930288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d808261f-b626-47b6-a002-bbea8be510bc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:23.946283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d808261f-b626-47b6-a002-bbea8be510bc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:23.947678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d808261f-b626-47b6-a002-bbea8be510bc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:23.950467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d808261f-b626-47b6-a002-bbea8be510bc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:23.951573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d808261f-b626-47b6-a002-bbea8be510bc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:23.952256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d808261f-b626-47b6-a002-bbea8be510bc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:23.953649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d808261f-b626-47b6-a002-bbea8be510bc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:24.398650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-784a5fbc-9976-4afa-bfd3-d5097fb1ca4a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:24.400267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-784a5fbc-9976-4afa-bfd3-d5097fb1ca4a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:24.418601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-784a5fbc-9976-4afa-bfd3-d5097fb1ca4a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:24.419679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-784a5fbc-9976-4afa-bfd3-d5097fb1ca4a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:24.423625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-784a5fbc-9976-4afa-bfd3-d5097fb1ca4a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:24.425110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-784a5fbc-9976-4afa-bfd3-d5097fb1ca4a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:24.425917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-784a5fbc-9976-4afa-bfd3-d5097fb1ca4a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:24.427279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-784a5fbc-9976-4afa-bfd3-d5097fb1ca4a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:24.542165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-784a5fbc-9976-4afa-bfd3-d5097fb1ca4a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:24.556000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-784a5fbc-9976-4afa-bfd3-d5097fb1ca4a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1280 microversion: 2.1 time: 0.161388 Aug 24 04:54:24.569456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d808261f-b626-47b6-a002-bbea8be510bc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:24.571627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 27/59] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:24 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1280 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:24.580797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d808261f-b626-47b6-a002-bbea8be510bc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.656695 Aug 24 04:54:24.595142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 33/60] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:23 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:25.577813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5975ca6f-7440-4660-a98e-5483cf5eebef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:25.578805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5975ca6f-7440-4660-a98e-5483cf5eebef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:25.610438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5975ca6f-7440-4660-a98e-5483cf5eebef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:25.610966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5975ca6f-7440-4660-a98e-5483cf5eebef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:25.614647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5975ca6f-7440-4660-a98e-5483cf5eebef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:25.615613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5975ca6f-7440-4660-a98e-5483cf5eebef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:25.617379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5975ca6f-7440-4660-a98e-5483cf5eebef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:25.618184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5975ca6f-7440-4660-a98e-5483cf5eebef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:25.841942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-ce573780-7d59-441b-9586-79eb77723ded req-d9ebd232-6923-4029-9a4d-ad9339b3121f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc16ffe9-0180-4a64-b937-bfd52cacbc89", "tag": "8db7ccd5-249a-4f20-a57f-62285a9089a4"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:25.862833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ce573780-7d59-441b-9586-79eb77723ded req-d9ebd232-6923-4029-9a4d-ad9339b3121f service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:25.881372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ce573780-7d59-441b-9586-79eb77723ded req-d9ebd232-6923-4029-9a4d-ad9339b3121f service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:25.883506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ce573780-7d59-441b-9586-79eb77723ded req-d9ebd232-6923-4029-9a4d-ad9339b3121f service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:25.963296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-ce573780-7d59-441b-9586-79eb77723ded req-d9ebd232-6923-4029-9a4d-ad9339b3121f service nova] Creating event network-changed:8db7ccd5-249a-4f20-a57f-62285a9089a4 for instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 on hv-cinder-85426 Aug 24 04:54:25.963837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ce573780-7d59-441b-9586-79eb77723ded req-d9ebd232-6923-4029-9a4d-ad9339b3121f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 04:54:25.964230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ce573780-7d59-441b-9586-79eb77723ded req-d9ebd232-6923-4029-9a4d-ad9339b3121f service nova] Acquired lock "compute-rpcapi-router" {{(pid=120558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 04:54:25.976997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63bc6ba3-1643-4981-a027-958b7742a08d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:25.977499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63bc6ba3-1643-4981-a027-958b7742a08d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:25.977934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63bc6ba3-1643-4981-a027-958b7742a08d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:25.979707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63bc6ba3-1643-4981-a027-958b7742a08d None None] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:25.990009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63bc6ba3-1643-4981-a027-958b7742a08d None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:25.994873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63bc6ba3-1643-4981-a027-958b7742a08d None None] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:26.038044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.compute.rpcapi [None req-63bc6ba3-1643-4981-a027-958b7742a08d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 04:54:26.039659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63bc6ba3-1643-4981-a027-958b7742a08d None None] Releasing lock "compute-rpcapi-router" {{(pid=120558) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 04:54:26.093482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-63bc6ba3-1643-4981-a027-958b7742a08d None None] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.502124 Aug 24 04:54:26.094872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 34/61] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:26.107213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e0925821-d113-48bf-971f-b4a5a0fa5350 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:26.116008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e0925821-d113-48bf-971f-b4a5a0fa5350 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:26.132116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0925821-d113-48bf-971f-b4a5a0fa5350 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:26.135178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0925821-d113-48bf-971f-b4a5a0fa5350 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:26.136802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0925821-d113-48bf-971f-b4a5a0fa5350 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:26.138540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0925821-d113-48bf-971f-b4a5a0fa5350 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:26.139335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0925821-d113-48bf-971f-b4a5a0fa5350 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:26.141934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0925821-d113-48bf-971f-b4a5a0fa5350 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:26.371771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e0925821-d113-48bf-971f-b4a5a0fa5350 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:26.382623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e0925821-d113-48bf-971f-b4a5a0fa5350 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.283899 Aug 24 04:54:26.383359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 35/62] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:26 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:26.609242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5975ca6f-7440-4660-a98e-5483cf5eebef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:26.634215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5975ca6f-7440-4660-a98e-5483cf5eebef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 1.060534 Aug 24 04:54:26.635418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 28/63] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:25 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:26.684780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-374778114", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a028b6ee-3eb5-44e6-a480-826fa1084130"}], "security_groups": [{"name": "tempest-securitygroup--1072092295"}], "key_name": "tempest-keypair-1624361171", "user_data": "}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:26.905388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.network.neutron [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] validate_networks() for [('a028b6ee-3eb5-44e6-a480-826fa1084130', None, None, None, None, None)] {{(pid=120558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:54:27.414410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ba89ed9a-97af-4ab6-b45b-f52cd3443993 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:27.415120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ba89ed9a-97af-4ab6-b45b-f52cd3443993 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:27.458468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba89ed9a-97af-4ab6-b45b-f52cd3443993 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:27.459612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba89ed9a-97af-4ab6-b45b-f52cd3443993 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:27.460121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba89ed9a-97af-4ab6-b45b-f52cd3443993 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:27.460828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba89ed9a-97af-4ab6-b45b-f52cd3443993 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:27.461284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba89ed9a-97af-4ab6-b45b-f52cd3443993 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:27.461710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba89ed9a-97af-4ab6-b45b-f52cd3443993 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:27.902600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ba89ed9a-97af-4ab6-b45b-f52cd3443993 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:27.914782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ba89ed9a-97af-4ab6-b45b-f52cd3443993 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.510001 Aug 24 04:54:27.918707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 29/64] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:27 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:27.931635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1213109649", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b192333e-49cd-4bbd-809a-5981852bd697"}], "security_groups": [{"name": "tempest-securitygroup--834053723"}], "key_name": "tempest-keypair-1370825006", "user_data": "}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:28.184013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Flavor limits 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:54:28.195037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Image limits 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:54:28.196077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Flavor pref 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:54:28.197805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Image pref 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:54:28.199209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:54:28.235976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:28.236779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:28.238141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:28.242954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:28.244060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:28.245062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:28.247915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] validate_networks() for [('b192333e-49cd-4bbd-809a-5981852bd697', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:54:28.350756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Getting quotas for project c2394a6093e241469dd0900c8efad29c. Resources: {'instances', 'ram', 'cores'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:28.372015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Getting quotas for user 5c6fb51f911e40338628bd734299c0d0 and project c2394a6093e241469dd0900c8efad29c. Resources: {'instances', 'ram', 'cores'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:28.436099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Going to run 1 instances... {{(pid=120558) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:54:28.452171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:54:28.645200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f8c03507-7b2e-41f0-acec-e84a551abc56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.966989 Aug 24 04:54:28.652391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 36/65] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:54:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:54:28.662867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-af2d6ee8-2120-48a6-b54c-413e347f8e53 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:28.663837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-af2d6ee8-2120-48a6-b54c-413e347f8e53 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:28.680070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2d6ee8-2120-48a6-b54c-413e347f8e53 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:28.680918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2d6ee8-2120-48a6-b54c-413e347f8e53 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:28.683851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2d6ee8-2120-48a6-b54c-413e347f8e53 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:28.685619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2d6ee8-2120-48a6-b54c-413e347f8e53 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:28.687261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2d6ee8-2120-48a6-b54c-413e347f8e53 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:28.687920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2d6ee8-2120-48a6-b54c-413e347f8e53 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:29.417668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-af2d6ee8-2120-48a6-b54c-413e347f8e53 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:29.430932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-af2d6ee8-2120-48a6-b54c-413e347f8e53 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.775082 Aug 24 04:54:29.433856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 37/66] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:28 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:29.457495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-222ca4dd-b33c-46f8-9bbf-b9ad5a442952 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:29.464347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-222ca4dd-b33c-46f8-9bbf-b9ad5a442952 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:29.618097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-222ca4dd-b33c-46f8-9bbf-b9ad5a442952 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:29.625760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-222ca4dd-b33c-46f8-9bbf-b9ad5a442952 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1237 microversion: 2.1 time: 0.181344 Aug 24 04:54:29.628354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 38/67] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1237 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:29.653994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7797d125-6fbf-4b6d-af6c-215fabeba5cd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:29.661044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7797d125-6fbf-4b6d-af6c-215fabeba5cd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:29.672891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7797d125-6fbf-4b6d-af6c-215fabeba5cd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:29.678406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7797d125-6fbf-4b6d-af6c-215fabeba5cd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:29.679255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7797d125-6fbf-4b6d-af6c-215fabeba5cd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:29.680243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7797d125-6fbf-4b6d-af6c-215fabeba5cd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:29.680902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7797d125-6fbf-4b6d-af6c-215fabeba5cd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:29.681755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7797d125-6fbf-4b6d-af6c-215fabeba5cd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:29.693318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:54:29.694414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:54:29.695407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:54:29.695966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:54:29.696521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:54:29.728311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:29.747992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:29.751447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:29.766800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:29.771475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:29.772289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:29.885277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:54:29.904173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for user 4bc6971289b943aebec90909ffb8096a and project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:54:29.951556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:54:29.962596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:54:30.163561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dffbf44a-bd33-462d-95f5-f4c86b4ab7cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.243659 Aug 24 04:54:30.164215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 30/68] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:54:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:54:30.188906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cb24b6ff-0f0d-4cb1-bea4-fd7ee9324130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:30.189609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cb24b6ff-0f0d-4cb1-bea4-fd7ee9324130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:30.440714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cb24b6ff-0f0d-4cb1-bea4-fd7ee9324130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:30.449033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cb24b6ff-0f0d-4cb1-bea4-fd7ee9324130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1242 microversion: 2.1 time: 0.267524 Aug 24 04:54:30.454581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 31/69] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1242 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:30.472761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d288c835-89db-4e6c-90a6-2368cb36d6f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:30.473660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d288c835-89db-4e6c-90a6-2368cb36d6f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:30.478634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:30.487764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d288c835-89db-4e6c-90a6-2368cb36d6f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:30.488657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d288c835-89db-4e6c-90a6-2368cb36d6f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:30.490445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d288c835-89db-4e6c-90a6-2368cb36d6f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:30.491908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d288c835-89db-4e6c-90a6-2368cb36d6f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:30.492586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d288c835-89db-4e6c-90a6-2368cb36d6f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:30.493533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d288c835-89db-4e6c-90a6-2368cb36d6f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:30.571129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7797d125-6fbf-4b6d-af6c-215fabeba5cd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:30.583856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7797d125-6fbf-4b6d-af6c-215fabeba5cd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.938271 Aug 24 04:54:30.584430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 39/70] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:29 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:30.651265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f21bf797-ced8-48d8-990c-cf89d1194815 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:30.652264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f21bf797-ced8-48d8-990c-cf89d1194815 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:30.668474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21bf797-ced8-48d8-990c-cf89d1194815 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:30.668980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21bf797-ced8-48d8-990c-cf89d1194815 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:30.669401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21bf797-ced8-48d8-990c-cf89d1194815 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:30.678846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21bf797-ced8-48d8-990c-cf89d1194815 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:30.680380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21bf797-ced8-48d8-990c-cf89d1194815 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:30.688316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21bf797-ced8-48d8-990c-cf89d1194815 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:30.825053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d288c835-89db-4e6c-90a6-2368cb36d6f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:30.837992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d288c835-89db-4e6c-90a6-2368cb36d6f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.380907 Aug 24 04:54:30.839065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 32/71] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:30 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:30.923116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f21bf797-ced8-48d8-990c-cf89d1194815 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:30.932361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f21bf797-ced8-48d8-990c-cf89d1194815 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1289 microversion: 2.1 time: 0.287112 Aug 24 04:54:30.933360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 40/72] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1289 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:31.148531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-711fc9ce-85b5-4087-a851-700858228cdb req-ecb409ee-d749-4b57-9bdc-50127a5d08e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99653dcb-0328-453a-a720-7df80c129db8", "tag": "08f84bc6-2ce1-403b-bf50-415ff1e16c87"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:31.158580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-711fc9ce-85b5-4087-a851-700858228cdb req-ecb409ee-d749-4b57-9bdc-50127a5d08e8 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:31.159373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-711fc9ce-85b5-4087-a851-700858228cdb req-ecb409ee-d749-4b57-9bdc-50127a5d08e8 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:31.159902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-711fc9ce-85b5-4087-a851-700858228cdb req-ecb409ee-d749-4b57-9bdc-50127a5d08e8 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:31.187710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-711fc9ce-85b5-4087-a851-700858228cdb req-ecb409ee-d749-4b57-9bdc-50127a5d08e8 service nova] Creating event network-changed:08f84bc6-2ce1-403b-bf50-415ff1e16c87 for instance 99653dcb-0328-453a-a720-7df80c129db8 on hv-cinder-85426 Aug 24 04:54:31.202568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-711fc9ce-85b5-4087-a851-700858228cdb req-ecb409ee-d749-4b57-9bdc-50127a5d08e8 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059584 Aug 24 04:54:31.210562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 33/73] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:31.475784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-57739576-22ca-4e25-be15-bd26ef087ef8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:31.477753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-57739576-22ca-4e25-be15-bd26ef087ef8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:31.487937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57739576-22ca-4e25-be15-bd26ef087ef8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:31.488713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57739576-22ca-4e25-be15-bd26ef087ef8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:31.489329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57739576-22ca-4e25-be15-bd26ef087ef8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:31.490389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57739576-22ca-4e25-be15-bd26ef087ef8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:31.491118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57739576-22ca-4e25-be15-bd26ef087ef8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:31.491861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57739576-22ca-4e25-be15-bd26ef087ef8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:31.567484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-57739576-22ca-4e25-be15-bd26ef087ef8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:31.575012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-57739576-22ca-4e25-be15-bd26ef087ef8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1246 microversion: 2.1 time: 0.103615 Aug 24 04:54:31.575619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 41/74] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1246 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:31.606201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b1fc131b-0b97-4e3f-9a05-63344a9e49c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:31.606947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b1fc131b-0b97-4e3f-9a05-63344a9e49c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:31.622472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1fc131b-0b97-4e3f-9a05-63344a9e49c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:31.622871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1fc131b-0b97-4e3f-9a05-63344a9e49c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:31.623311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1fc131b-0b97-4e3f-9a05-63344a9e49c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:31.624015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1fc131b-0b97-4e3f-9a05-63344a9e49c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:31.624478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1fc131b-0b97-4e3f-9a05-63344a9e49c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:31.624903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1fc131b-0b97-4e3f-9a05-63344a9e49c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:31.814000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b1fc131b-0b97-4e3f-9a05-63344a9e49c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:31.825542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b1fc131b-0b97-4e3f-9a05-63344a9e49c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.223356 Aug 24 04:54:31.840272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 34/75] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:31 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:31.864898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3ffeebf0-18ba-4bc7-99aa-07e848d814c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:31.865852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3ffeebf0-18ba-4bc7-99aa-07e848d814c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:31.873565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffeebf0-18ba-4bc7-99aa-07e848d814c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:31.874057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffeebf0-18ba-4bc7-99aa-07e848d814c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:31.874496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffeebf0-18ba-4bc7-99aa-07e848d814c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:31.876282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffeebf0-18ba-4bc7-99aa-07e848d814c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:31.876736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffeebf0-18ba-4bc7-99aa-07e848d814c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:31.877646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffeebf0-18ba-4bc7-99aa-07e848d814c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:31.956745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1e0e2869-29a6-4c75-a123-c63b45e13603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:31.957439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1e0e2869-29a6-4c75-a123-c63b45e13603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:31.964858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e0e2869-29a6-4c75-a123-c63b45e13603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:31.965429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e0e2869-29a6-4c75-a123-c63b45e13603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:31.965870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e0e2869-29a6-4c75-a123-c63b45e13603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:31.966794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e0e2869-29a6-4c75-a123-c63b45e13603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:31.967504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e0e2869-29a6-4c75-a123-c63b45e13603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:31.968099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e0e2869-29a6-4c75-a123-c63b45e13603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:32.052137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1e0e2869-29a6-4c75-a123-c63b45e13603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:32.061239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1e0e2869-29a6-4c75-a123-c63b45e13603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1289 microversion: 2.1 time: 0.108432 Aug 24 04:54:32.062197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 35/76] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:32.241251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3ffeebf0-18ba-4bc7-99aa-07e848d814c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:32.250584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3ffeebf0-18ba-4bc7-99aa-07e848d814c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.390450 Aug 24 04:54:32.251199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 42/77] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:31 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:32.599198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e0ea6bc8-a767-4134-81a2-2cfe95ce1510 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:32.599893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e0ea6bc8-a767-4134-81a2-2cfe95ce1510 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:32.605970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0ea6bc8-a767-4134-81a2-2cfe95ce1510 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:32.606710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0ea6bc8-a767-4134-81a2-2cfe95ce1510 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:32.607246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0ea6bc8-a767-4134-81a2-2cfe95ce1510 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:32.608013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0ea6bc8-a767-4134-81a2-2cfe95ce1510 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:32.608541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0ea6bc8-a767-4134-81a2-2cfe95ce1510 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:32.609067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0ea6bc8-a767-4134-81a2-2cfe95ce1510 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:32.860239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-16d92c21-79f5-43cc-b0e5-7568f68fcbdc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:32.861079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-16d92c21-79f5-43cc-b0e5-7568f68fcbdc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:32.874367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16d92c21-79f5-43cc-b0e5-7568f68fcbdc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:32.876433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16d92c21-79f5-43cc-b0e5-7568f68fcbdc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:32.877128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16d92c21-79f5-43cc-b0e5-7568f68fcbdc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:32.879591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16d92c21-79f5-43cc-b0e5-7568f68fcbdc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:32.880221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16d92c21-79f5-43cc-b0e5-7568f68fcbdc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:32.881005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16d92c21-79f5-43cc-b0e5-7568f68fcbdc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:32.884302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e0ea6bc8-a767-4134-81a2-2cfe95ce1510 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:32.892363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e0ea6bc8-a767-4134-81a2-2cfe95ce1510 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1246 microversion: 2.1 time: 0.297983 Aug 24 04:54:32.893156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 36/78] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1246 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:33.041580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-16d92c21-79f5-43cc-b0e5-7568f68fcbdc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:33.050198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-16d92c21-79f5-43cc-b0e5-7568f68fcbdc tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.206489 Aug 24 04:54:33.050785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 43/79] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:32 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:33.086339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-83e3daaf-c6e8-46cf-80e2-24d0c7a6ce72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:33.086991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-83e3daaf-c6e8-46cf-80e2-24d0c7a6ce72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:33.094071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e3daaf-c6e8-46cf-80e2-24d0c7a6ce72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:33.094760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e3daaf-c6e8-46cf-80e2-24d0c7a6ce72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:33.095452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e3daaf-c6e8-46cf-80e2-24d0c7a6ce72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:33.096561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e3daaf-c6e8-46cf-80e2-24d0c7a6ce72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:33.097414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e3daaf-c6e8-46cf-80e2-24d0c7a6ce72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:33.099241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e3daaf-c6e8-46cf-80e2-24d0c7a6ce72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:33.184392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-83e3daaf-c6e8-46cf-80e2-24d0c7a6ce72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:33.192843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-83e3daaf-c6e8-46cf-80e2-24d0c7a6ce72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1289 microversion: 2.1 time: 0.110208 Aug 24 04:54:33.193415 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 37/80] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:33.272945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2b8cebe6-2e7f-40ed-b97e-982df8e02d82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:33.274240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2b8cebe6-2e7f-40ed-b97e-982df8e02d82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:33.280471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8cebe6-2e7f-40ed-b97e-982df8e02d82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:33.281483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8cebe6-2e7f-40ed-b97e-982df8e02d82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:33.282420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8cebe6-2e7f-40ed-b97e-982df8e02d82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:33.284693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8cebe6-2e7f-40ed-b97e-982df8e02d82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:33.285613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8cebe6-2e7f-40ed-b97e-982df8e02d82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:33.286197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8cebe6-2e7f-40ed-b97e-982df8e02d82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:33.308484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:33.457084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2b8cebe6-2e7f-40ed-b97e-982df8e02d82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:33.468625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2b8cebe6-2e7f-40ed-b97e-982df8e02d82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.198019 Aug 24 04:54:33.468625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 44/81] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:33 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:33.912991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-de76131e-8f16-4c41-ac28-36332db3f673 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:33.913607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-de76131e-8f16-4c41-ac28-36332db3f673 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:33.919846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de76131e-8f16-4c41-ac28-36332db3f673 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:33.920324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de76131e-8f16-4c41-ac28-36332db3f673 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:33.920755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de76131e-8f16-4c41-ac28-36332db3f673 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:33.921436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de76131e-8f16-4c41-ac28-36332db3f673 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:33.921882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de76131e-8f16-4c41-ac28-36332db3f673 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:33.922307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de76131e-8f16-4c41-ac28-36332db3f673 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:33.925641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=75 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:33.987347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-de76131e-8f16-4c41-ac28-36332db3f673 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:33.996262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-de76131e-8f16-4c41-ac28-36332db3f673 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1246 microversion: 2.1 time: 0.087098 Aug 24 04:54:33.996873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 38/82] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:34.072176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6d30b9a0-7894-4ad3-a5fc-1b63e7ec678a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:34.072858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6d30b9a0-7894-4ad3-a5fc-1b63e7ec678a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:34.074931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:34.081531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d30b9a0-7894-4ad3-a5fc-1b63e7ec678a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.082266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d30b9a0-7894-4ad3-a5fc-1b63e7ec678a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.083020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d30b9a0-7894-4ad3-a5fc-1b63e7ec678a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.083785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d30b9a0-7894-4ad3-a5fc-1b63e7ec678a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.084429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d30b9a0-7894-4ad3-a5fc-1b63e7ec678a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.084920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d30b9a0-7894-4ad3-a5fc-1b63e7ec678a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.214762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bac64496-4b1b-493c-a2cd-e475bbf235a2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:34.215794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bac64496-4b1b-493c-a2cd-e475bbf235a2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:34.218976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6d30b9a0-7894-4ad3-a5fc-1b63e7ec678a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:34.223666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bac64496-4b1b-493c-a2cd-e475bbf235a2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.224290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bac64496-4b1b-493c-a2cd-e475bbf235a2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.224832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bac64496-4b1b-493c-a2cd-e475bbf235a2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.225634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bac64496-4b1b-493c-a2cd-e475bbf235a2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.226192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bac64496-4b1b-493c-a2cd-e475bbf235a2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.229603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bac64496-4b1b-493c-a2cd-e475bbf235a2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.229711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6d30b9a0-7894-4ad3-a5fc-1b63e7ec678a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.159590 Aug 24 04:54:34.229711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 45/83] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:34 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:34.296712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bac64496-4b1b-493c-a2cd-e475bbf235a2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:34.305258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bac64496-4b1b-493c-a2cd-e475bbf235a2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1289 microversion: 2.1 time: 0.095252 Aug 24 04:54:34.306137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 39/84] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:34.493396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4279aeb9-8e3a-4857-bbc2-01f24ec16a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:34.494131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4279aeb9-8e3a-4857-bbc2-01f24ec16a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:34.500685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4279aeb9-8e3a-4857-bbc2-01f24ec16a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.501271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4279aeb9-8e3a-4857-bbc2-01f24ec16a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.502042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4279aeb9-8e3a-4857-bbc2-01f24ec16a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.503499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4279aeb9-8e3a-4857-bbc2-01f24ec16a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:34.504051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4279aeb9-8e3a-4857-bbc2-01f24ec16a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:34.504733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4279aeb9-8e3a-4857-bbc2-01f24ec16a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:34.642199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4279aeb9-8e3a-4857-bbc2-01f24ec16a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:34.650588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4279aeb9-8e3a-4857-bbc2-01f24ec16a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.161340 Aug 24 04:54:34.651271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 46/85] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:34 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:35.017383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-518c29b7-2ee1-4eb9-992c-87b77d36c05b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:35.018699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-518c29b7-2ee1-4eb9-992c-87b77d36c05b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:35.024909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-518c29b7-2ee1-4eb9-992c-87b77d36c05b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:35.025478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-518c29b7-2ee1-4eb9-992c-87b77d36c05b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:35.025983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-518c29b7-2ee1-4eb9-992c-87b77d36c05b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:35.027022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-518c29b7-2ee1-4eb9-992c-87b77d36c05b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:35.027482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-518c29b7-2ee1-4eb9-992c-87b77d36c05b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:35.027907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-518c29b7-2ee1-4eb9-992c-87b77d36c05b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:35.091330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-518c29b7-2ee1-4eb9-992c-87b77d36c05b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:35.099149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-518c29b7-2ee1-4eb9-992c-87b77d36c05b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1238 microversion: 2.1 time: 0.085846 Aug 24 04:54:35.099717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 40/86] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:35.251397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-313c9473-0f1c-4963-8393-b084bb49db01 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:35.255532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-313c9473-0f1c-4963-8393-b084bb49db01 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:35.273630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-313c9473-0f1c-4963-8393-b084bb49db01 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:35.274517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-313c9473-0f1c-4963-8393-b084bb49db01 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:35.275281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-313c9473-0f1c-4963-8393-b084bb49db01 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:35.276637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-313c9473-0f1c-4963-8393-b084bb49db01 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:35.277304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-313c9473-0f1c-4963-8393-b084bb49db01 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:35.277866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-313c9473-0f1c-4963-8393-b084bb49db01 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:35.325977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-75e6ae46-8630-451e-bd75-a03a40d2a65f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:35.326936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-75e6ae46-8630-451e-bd75-a03a40d2a65f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:35.349725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-75e6ae46-8630-451e-bd75-a03a40d2a65f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:35.350982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-75e6ae46-8630-451e-bd75-a03a40d2a65f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:35.351600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-75e6ae46-8630-451e-bd75-a03a40d2a65f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:35.352470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-75e6ae46-8630-451e-bd75-a03a40d2a65f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:35.353067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-75e6ae46-8630-451e-bd75-a03a40d2a65f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:35.353662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-75e6ae46-8630-451e-bd75-a03a40d2a65f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:35.501259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-75e6ae46-8630-451e-bd75-a03a40d2a65f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:35.526752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-75e6ae46-8630-451e-bd75-a03a40d2a65f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1289 microversion: 2.1 time: 0.203237 Aug 24 04:54:35.529718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 41/87] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1289 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:35.677824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8f981189-8ca3-4b4d-ac1b-1b58292731b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:35.679395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8f981189-8ca3-4b4d-ac1b-1b58292731b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:35.690105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f981189-8ca3-4b4d-ac1b-1b58292731b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:35.691105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f981189-8ca3-4b4d-ac1b-1b58292731b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:35.698224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f981189-8ca3-4b4d-ac1b-1b58292731b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:35.700502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f981189-8ca3-4b4d-ac1b-1b58292731b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:35.701194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f981189-8ca3-4b4d-ac1b-1b58292731b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:35.703461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f981189-8ca3-4b4d-ac1b-1b58292731b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:35.710478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-313c9473-0f1c-4963-8393-b084bb49db01 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:35.720402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-313c9473-0f1c-4963-8393-b084bb49db01 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.475381 Aug 24 04:54:35.724329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 47/88] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:35 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:35.946438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8f981189-8ca3-4b4d-ac1b-1b58292731b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:35.955674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8f981189-8ca3-4b4d-ac1b-1b58292731b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.283118 Aug 24 04:54:35.956356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 42/89] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:35 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:36.124096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2c78b82a-2c51-4bbe-adab-efa3f50d191f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:36.124717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2c78b82a-2c51-4bbe-adab-efa3f50d191f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:36.132467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c78b82a-2c51-4bbe-adab-efa3f50d191f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:36.133133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c78b82a-2c51-4bbe-adab-efa3f50d191f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:36.133674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c78b82a-2c51-4bbe-adab-efa3f50d191f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:36.134589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c78b82a-2c51-4bbe-adab-efa3f50d191f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:36.135248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c78b82a-2c51-4bbe-adab-efa3f50d191f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:36.135714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c78b82a-2c51-4bbe-adab-efa3f50d191f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:36.214400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2c78b82a-2c51-4bbe-adab-efa3f50d191f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:36.223154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2c78b82a-2c51-4bbe-adab-efa3f50d191f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1294 microversion: 2.1 time: 0.103658 Aug 24 04:54:36.223842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 48/90] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:36.549956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7a8dabc6-b1ab-409f-bdf7-791f65b985b6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:36.550626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7a8dabc6-b1ab-409f-bdf7-791f65b985b6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:36.556802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8dabc6-b1ab-409f-bdf7-791f65b985b6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:36.557285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8dabc6-b1ab-409f-bdf7-791f65b985b6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:36.557714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8dabc6-b1ab-409f-bdf7-791f65b985b6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:36.558399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8dabc6-b1ab-409f-bdf7-791f65b985b6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:36.558886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8dabc6-b1ab-409f-bdf7-791f65b985b6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:36.559306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8dabc6-b1ab-409f-bdf7-791f65b985b6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:36.625497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7a8dabc6-b1ab-409f-bdf7-791f65b985b6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:36.633878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7a8dabc6-b1ab-409f-bdf7-791f65b985b6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1295 microversion: 2.1 time: 0.087910 Aug 24 04:54:36.634449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 43/91] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1295 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:36.748481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5a10fe08-7e54-42b5-9af4-a35e40e915f1 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:36.749751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5a10fe08-7e54-42b5-9af4-a35e40e915f1 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:36.758010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a10fe08-7e54-42b5-9af4-a35e40e915f1 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:36.758498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a10fe08-7e54-42b5-9af4-a35e40e915f1 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:36.759179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a10fe08-7e54-42b5-9af4-a35e40e915f1 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:36.760133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a10fe08-7e54-42b5-9af4-a35e40e915f1 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:36.760591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a10fe08-7e54-42b5-9af4-a35e40e915f1 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:36.761017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a10fe08-7e54-42b5-9af4-a35e40e915f1 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:36.929094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5a10fe08-7e54-42b5-9af4-a35e40e915f1 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:36.938812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5a10fe08-7e54-42b5-9af4-a35e40e915f1 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.196257 Aug 24 04:54:36.940294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 49/92] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:36 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:36.976821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-72972a35-6d61-4462-bc54-f5ca522c3cc8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:36.977488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-72972a35-6d61-4462-bc54-f5ca522c3cc8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:36.984620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72972a35-6d61-4462-bc54-f5ca522c3cc8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:36.985222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72972a35-6d61-4462-bc54-f5ca522c3cc8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:36.985899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72972a35-6d61-4462-bc54-f5ca522c3cc8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:36.987322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72972a35-6d61-4462-bc54-f5ca522c3cc8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:36.987934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72972a35-6d61-4462-bc54-f5ca522c3cc8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:36.988449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72972a35-6d61-4462-bc54-f5ca522c3cc8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:37.129183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-72972a35-6d61-4462-bc54-f5ca522c3cc8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:37.136970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-72972a35-6d61-4462-bc54-f5ca522c3cc8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.164870 Aug 24 04:54:37.137515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 44/93] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:36 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:37.244845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-412229cf-5a94-4360-9cc2-d0d41dc7b1c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:37.245502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-412229cf-5a94-4360-9cc2-d0d41dc7b1c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:37.251929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-412229cf-5a94-4360-9cc2-d0d41dc7b1c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:37.253312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-412229cf-5a94-4360-9cc2-d0d41dc7b1c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:37.253749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-412229cf-5a94-4360-9cc2-d0d41dc7b1c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:37.254449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-412229cf-5a94-4360-9cc2-d0d41dc7b1c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:37.254961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-412229cf-5a94-4360-9cc2-d0d41dc7b1c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:37.256789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-412229cf-5a94-4360-9cc2-d0d41dc7b1c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:37.325605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-412229cf-5a94-4360-9cc2-d0d41dc7b1c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:37.336597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-412229cf-5a94-4360-9cc2-d0d41dc7b1c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1294 microversion: 2.1 time: 0.095749 Aug 24 04:54:37.337600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 50/94] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:37.656888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e8c96579-f11e-4c04-9dd1-d34dc76d8a35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:37.657637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e8c96579-f11e-4c04-9dd1-d34dc76d8a35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:37.664846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8c96579-f11e-4c04-9dd1-d34dc76d8a35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:37.665322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8c96579-f11e-4c04-9dd1-d34dc76d8a35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:37.665756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8c96579-f11e-4c04-9dd1-d34dc76d8a35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:37.666445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8c96579-f11e-4c04-9dd1-d34dc76d8a35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:37.667005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8c96579-f11e-4c04-9dd1-d34dc76d8a35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:37.667433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8c96579-f11e-4c04-9dd1-d34dc76d8a35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:37.729121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e8c96579-f11e-4c04-9dd1-d34dc76d8a35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:37.738488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e8c96579-f11e-4c04-9dd1-d34dc76d8a35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1295 microversion: 2.1 time: 0.085716 Aug 24 04:54:37.739197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 45/95] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:37.970050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-656b51af-eaa1-4ee1-9381-3da66e8135e5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:37.971765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-656b51af-eaa1-4ee1-9381-3da66e8135e5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:37.978874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-656b51af-eaa1-4ee1-9381-3da66e8135e5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:37.979363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-656b51af-eaa1-4ee1-9381-3da66e8135e5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:37.980047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-656b51af-eaa1-4ee1-9381-3da66e8135e5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:37.980748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-656b51af-eaa1-4ee1-9381-3da66e8135e5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:37.981431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-656b51af-eaa1-4ee1-9381-3da66e8135e5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:37.981852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-656b51af-eaa1-4ee1-9381-3da66e8135e5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:38.140224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-656b51af-eaa1-4ee1-9381-3da66e8135e5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:38.148423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-656b51af-eaa1-4ee1-9381-3da66e8135e5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.182407 Aug 24 04:54:38.149313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 51/96] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:37 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:38.162111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ed482b64-acc4-4958-8eb5-b3906d526a39 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:38.162932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ed482b64-acc4-4958-8eb5-b3906d526a39 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:38.172325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed482b64-acc4-4958-8eb5-b3906d526a39 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:38.172716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed482b64-acc4-4958-8eb5-b3906d526a39 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:38.174425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed482b64-acc4-4958-8eb5-b3906d526a39 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:38.175407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed482b64-acc4-4958-8eb5-b3906d526a39 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:38.176167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed482b64-acc4-4958-8eb5-b3906d526a39 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:38.176595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed482b64-acc4-4958-8eb5-b3906d526a39 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:38.329193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ed482b64-acc4-4958-8eb5-b3906d526a39 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:38.346405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ed482b64-acc4-4958-8eb5-b3906d526a39 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.192024 Aug 24 04:54:38.347168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 46/97] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:38 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:38.361736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-942e708a-0296-4316-b230-dee8d996b8be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:38.362593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-942e708a-0296-4316-b230-dee8d996b8be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:38.365249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=4 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:38.372324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-942e708a-0296-4316-b230-dee8d996b8be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:38.372840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-942e708a-0296-4316-b230-dee8d996b8be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:38.373394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-942e708a-0296-4316-b230-dee8d996b8be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:38.374211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-942e708a-0296-4316-b230-dee8d996b8be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:38.374662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-942e708a-0296-4316-b230-dee8d996b8be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:38.375177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-942e708a-0296-4316-b230-dee8d996b8be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:38.445266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-942e708a-0296-4316-b230-dee8d996b8be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:38.463933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-942e708a-0296-4316-b230-dee8d996b8be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1294 microversion: 2.1 time: 0.095827 Aug 24 04:54:38.463933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 52/98] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:38.761454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d9da73da-3be4-4534-bfc5-2abd52aa00d1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:38.762088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d9da73da-3be4-4534-bfc5-2abd52aa00d1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:38.769307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9da73da-3be4-4534-bfc5-2abd52aa00d1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:38.770260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9da73da-3be4-4534-bfc5-2abd52aa00d1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:38.771857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9da73da-3be4-4534-bfc5-2abd52aa00d1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:38.773002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9da73da-3be4-4534-bfc5-2abd52aa00d1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:38.773674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9da73da-3be4-4534-bfc5-2abd52aa00d1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:38.774298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9da73da-3be4-4534-bfc5-2abd52aa00d1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:38.902209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d9da73da-3be4-4534-bfc5-2abd52aa00d1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:38.910042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d9da73da-3be4-4534-bfc5-2abd52aa00d1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1295 microversion: 2.1 time: 0.152485 Aug 24 04:54:38.910608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 47/99] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1295 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:39.172420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5078483d-b7b1-461d-aed1-00784bb71515 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:39.173035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5078483d-b7b1-461d-aed1-00784bb71515 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:39.181942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5078483d-b7b1-461d-aed1-00784bb71515 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:39.182439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5078483d-b7b1-461d-aed1-00784bb71515 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:39.182987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5078483d-b7b1-461d-aed1-00784bb71515 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:39.183583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5078483d-b7b1-461d-aed1-00784bb71515 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:39.189088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5078483d-b7b1-461d-aed1-00784bb71515 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:39.189768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5078483d-b7b1-461d-aed1-00784bb71515 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:39.369241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b192a8c1-e7d0-4767-a9e2-39222c557423 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:39.369854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b192a8c1-e7d0-4767-a9e2-39222c557423 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:39.380383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b192a8c1-e7d0-4767-a9e2-39222c557423 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:39.381711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b192a8c1-e7d0-4767-a9e2-39222c557423 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:39.382157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b192a8c1-e7d0-4767-a9e2-39222c557423 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:39.389841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b192a8c1-e7d0-4767-a9e2-39222c557423 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:39.393300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b192a8c1-e7d0-4767-a9e2-39222c557423 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:39.393863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b192a8c1-e7d0-4767-a9e2-39222c557423 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:39.625349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=18 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:39.641357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5078483d-b7b1-461d-aed1-00784bb71515 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:39.656949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5078483d-b7b1-461d-aed1-00784bb71515 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.490525 Aug 24 04:54:39.658910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 53/100] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:39 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:39.670649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82825c65-d407-492e-819c-6402d9b5b3ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:39.673011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-82825c65-d407-492e-819c-6402d9b5b3ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:39.684068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82825c65-d407-492e-819c-6402d9b5b3ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:39.688210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82825c65-d407-492e-819c-6402d9b5b3ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:39.689981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82825c65-d407-492e-819c-6402d9b5b3ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:39.691153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82825c65-d407-492e-819c-6402d9b5b3ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:39.696229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82825c65-d407-492e-819c-6402d9b5b3ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:39.697457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82825c65-d407-492e-819c-6402d9b5b3ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:39.796981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b192a8c1-e7d0-4767-a9e2-39222c557423 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:39.805451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-82825c65-d407-492e-819c-6402d9b5b3ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:39.814052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b192a8c1-e7d0-4767-a9e2-39222c557423 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.446349 Aug 24 04:54:39.816902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-82825c65-d407-492e-819c-6402d9b5b3ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1300 microversion: 2.1 time: 0.156564 Aug 24 04:54:39.819211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 48/101] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:39 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:39.823885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 54/102] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1300 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:39.931230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-415ca94f-6688-495b-9d67-33f8c9b2da14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:39.932208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-415ca94f-6688-495b-9d67-33f8c9b2da14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:39.934390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=10 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:39.941159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415ca94f-6688-495b-9d67-33f8c9b2da14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:39.941628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415ca94f-6688-495b-9d67-33f8c9b2da14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:39.942093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415ca94f-6688-495b-9d67-33f8c9b2da14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:39.943167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415ca94f-6688-495b-9d67-33f8c9b2da14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:39.943653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415ca94f-6688-495b-9d67-33f8c9b2da14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:39.944254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415ca94f-6688-495b-9d67-33f8c9b2da14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:40.181457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-415ca94f-6688-495b-9d67-33f8c9b2da14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:40.192256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-415ca94f-6688-495b-9d67-33f8c9b2da14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.264835 Aug 24 04:54:40.193105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 49/103] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:40.679806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4f3f7b10-f129-401e-b7d3-c0338603b963 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:40.680419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4f3f7b10-f129-401e-b7d3-c0338603b963 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:40.686583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3f7b10-f129-401e-b7d3-c0338603b963 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:40.687095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3f7b10-f129-401e-b7d3-c0338603b963 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:40.687533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3f7b10-f129-401e-b7d3-c0338603b963 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:40.688216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3f7b10-f129-401e-b7d3-c0338603b963 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:40.688791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3f7b10-f129-401e-b7d3-c0338603b963 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:40.689077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3f7b10-f129-401e-b7d3-c0338603b963 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:40.831573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4f3f7b10-f129-401e-b7d3-c0338603b963 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:40.837223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e7efdf21-7493-4e6f-905b-6692792decc9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:40.837961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e7efdf21-7493-4e6f-905b-6692792decc9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:40.839287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4f3f7b10-f129-401e-b7d3-c0338603b963 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.163879 Aug 24 04:54:40.839853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 55/104] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:40 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:40.841811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=32 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:40.845074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-389d2a2e-bfcb-4e19-9638-8d025d93bc4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:40.846117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-389d2a2e-bfcb-4e19-9638-8d025d93bc4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:40.847728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7efdf21-7493-4e6f-905b-6692792decc9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:40.848301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7efdf21-7493-4e6f-905b-6692792decc9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:40.848807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7efdf21-7493-4e6f-905b-6692792decc9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:40.849566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7efdf21-7493-4e6f-905b-6692792decc9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:40.850089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7efdf21-7493-4e6f-905b-6692792decc9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:40.850575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7efdf21-7493-4e6f-905b-6692792decc9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:40.852010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-389d2a2e-bfcb-4e19-9638-8d025d93bc4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:40.852479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-389d2a2e-bfcb-4e19-9638-8d025d93bc4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:40.852908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-389d2a2e-bfcb-4e19-9638-8d025d93bc4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:40.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-389d2a2e-bfcb-4e19-9638-8d025d93bc4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:40.854061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-389d2a2e-bfcb-4e19-9638-8d025d93bc4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:40.854472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-389d2a2e-bfcb-4e19-9638-8d025d93bc4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:40.988063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-389d2a2e-bfcb-4e19-9638-8d025d93bc4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:40.990107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e7efdf21-7493-4e6f-905b-6692792decc9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:40.996157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-389d2a2e-bfcb-4e19-9638-8d025d93bc4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.154783 Aug 24 04:54:40.996785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 56/105] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:40.998943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e7efdf21-7493-4e6f-905b-6692792decc9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.165323 Aug 24 04:54:40.999573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 50/106] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:40 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:41.213295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7d0f9b87-c317-4f90-b889-a504400b1a08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:41.213899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7d0f9b87-c317-4f90-b889-a504400b1a08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:41.219892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d0f9b87-c317-4f90-b889-a504400b1a08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:41.220432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d0f9b87-c317-4f90-b889-a504400b1a08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:41.220860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d0f9b87-c317-4f90-b889-a504400b1a08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:41.221557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d0f9b87-c317-4f90-b889-a504400b1a08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:41.222001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d0f9b87-c317-4f90-b889-a504400b1a08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:41.222414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d0f9b87-c317-4f90-b889-a504400b1a08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:41.354267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7d0f9b87-c317-4f90-b889-a504400b1a08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:41.361986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7d0f9b87-c317-4f90-b889-a504400b1a08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.152468 Aug 24 04:54:41.362546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 57/107] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:41.860267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6d713e4c-dbef-4a9e-a3f0-8285c92c432f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:41.860876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6d713e4c-dbef-4a9e-a3f0-8285c92c432f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:41.866846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d713e4c-dbef-4a9e-a3f0-8285c92c432f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:41.867319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d713e4c-dbef-4a9e-a3f0-8285c92c432f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:41.867768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d713e4c-dbef-4a9e-a3f0-8285c92c432f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:41.868447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d713e4c-dbef-4a9e-a3f0-8285c92c432f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:41.868900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d713e4c-dbef-4a9e-a3f0-8285c92c432f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:41.869316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d713e4c-dbef-4a9e-a3f0-8285c92c432f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:41.997185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6d713e4c-dbef-4a9e-a3f0-8285c92c432f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:42.005091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6d713e4c-dbef-4a9e-a3f0-8285c92c432f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.148649 Aug 24 04:54:42.005633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 51/108] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:41 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:42.017161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-05ca79df-cf4a-4b57-97cd-53d0f4f7433c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:42.018973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-05ca79df-cf4a-4b57-97cd-53d0f4f7433c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:42.021370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9ae0ac0a-bcca-4a2a-88a3-6669dcda4399 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:42.021986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9ae0ac0a-bcca-4a2a-88a3-6669dcda4399 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:42.024411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-05ca79df-cf4a-4b57-97cd-53d0f4f7433c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:42.024895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-05ca79df-cf4a-4b57-97cd-53d0f4f7433c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:42.025350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-05ca79df-cf4a-4b57-97cd-53d0f4f7433c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:42.026022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-05ca79df-cf4a-4b57-97cd-53d0f4f7433c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:42.026478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-05ca79df-cf4a-4b57-97cd-53d0f4f7433c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:42.026929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-05ca79df-cf4a-4b57-97cd-53d0f4f7433c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:42.027989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ae0ac0a-bcca-4a2a-88a3-6669dcda4399 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:42.028477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ae0ac0a-bcca-4a2a-88a3-6669dcda4399 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:42.028945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ae0ac0a-bcca-4a2a-88a3-6669dcda4399 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:42.029694 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ae0ac0a-bcca-4a2a-88a3-6669dcda4399 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:42.030147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ae0ac0a-bcca-4a2a-88a3-6669dcda4399 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:42.030588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ae0ac0a-bcca-4a2a-88a3-6669dcda4399 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:42.157229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9ae0ac0a-bcca-4a2a-88a3-6669dcda4399 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:42.157628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-05ca79df-cf4a-4b57-97cd-53d0f4f7433c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:42.166476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9ae0ac0a-bcca-4a2a-88a3-6669dcda4399 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.150186 Aug 24 04:54:42.167112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 52/109] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:42 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:42.168461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-05ca79df-cf4a-4b57-97cd-53d0f4f7433c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.154709 Aug 24 04:54:42.169037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 58/110] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:42.383023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0ae4c331-fb54-42d1-b6e4-bb1488cee8fb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:42.383633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0ae4c331-fb54-42d1-b6e4-bb1488cee8fb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:42.389670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ae4c331-fb54-42d1-b6e4-bb1488cee8fb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:42.390150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ae4c331-fb54-42d1-b6e4-bb1488cee8fb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:42.390584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ae4c331-fb54-42d1-b6e4-bb1488cee8fb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:42.391289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ae4c331-fb54-42d1-b6e4-bb1488cee8fb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:42.391739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ae4c331-fb54-42d1-b6e4-bb1488cee8fb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:42.392158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ae4c331-fb54-42d1-b6e4-bb1488cee8fb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:42.526149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ae4c331-fb54-42d1-b6e4-bb1488cee8fb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:42.534180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0ae4c331-fb54-42d1-b6e4-bb1488cee8fb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.154974 Aug 24 04:54:42.534768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 53/111] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:43.026130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-95b5e479-affe-4c84-a86f-92c40a0c9877 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:43.026862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-95b5e479-affe-4c84-a86f-92c40a0c9877 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:43.032792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95b5e479-affe-4c84-a86f-92c40a0c9877 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.033503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95b5e479-affe-4c84-a86f-92c40a0c9877 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.033727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95b5e479-affe-4c84-a86f-92c40a0c9877 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.034439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95b5e479-affe-4c84-a86f-92c40a0c9877 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.034886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95b5e479-affe-4c84-a86f-92c40a0c9877 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.035308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95b5e479-affe-4c84-a86f-92c40a0c9877 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.163062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-95b5e479-affe-4c84-a86f-92c40a0c9877 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:43.170923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-95b5e479-affe-4c84-a86f-92c40a0c9877 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.148624 Aug 24 04:54:43.171497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 59/112] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:43 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:43.187046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d4b32391-e027-4d84-81f8-721d9f697fd1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:43.187660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d4b32391-e027-4d84-81f8-721d9f697fd1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:43.188715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b46fcea2-3cd1-4142-a96f-c13d9fd160cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:43.189392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b46fcea2-3cd1-4142-a96f-c13d9fd160cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:43.193689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4b32391-e027-4d84-81f8-721d9f697fd1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.194172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4b32391-e027-4d84-81f8-721d9f697fd1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.194609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4b32391-e027-4d84-81f8-721d9f697fd1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.195302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b46fcea2-3cd1-4142-a96f-c13d9fd160cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.195409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4b32391-e027-4d84-81f8-721d9f697fd1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.195763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4b32391-e027-4d84-81f8-721d9f697fd1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.195869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b46fcea2-3cd1-4142-a96f-c13d9fd160cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.196184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b46fcea2-3cd1-4142-a96f-c13d9fd160cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.196275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4b32391-e027-4d84-81f8-721d9f697fd1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.196851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b46fcea2-3cd1-4142-a96f-c13d9fd160cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.197292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b46fcea2-3cd1-4142-a96f-c13d9fd160cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.197731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b46fcea2-3cd1-4142-a96f-c13d9fd160cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.331804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d4b32391-e027-4d84-81f8-721d9f697fd1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:43.334118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:43.341879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d4b32391-e027-4d84-81f8-721d9f697fd1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.158509 Aug 24 04:54:43.342478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 54/113] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:43 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:43.503389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b46fcea2-3cd1-4142-a96f-c13d9fd160cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:43.511016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b46fcea2-3cd1-4142-a96f-c13d9fd160cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.326030 Aug 24 04:54:43.511594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 60/114] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:43.555062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5b920b27-4f50-45a7-8380-f41a2d03f14f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:43.555601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5b920b27-4f50-45a7-8380-f41a2d03f14f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:43.561532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b920b27-4f50-45a7-8380-f41a2d03f14f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.562019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b920b27-4f50-45a7-8380-f41a2d03f14f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.562486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b920b27-4f50-45a7-8380-f41a2d03f14f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.563207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b920b27-4f50-45a7-8380-f41a2d03f14f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:43.563662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b920b27-4f50-45a7-8380-f41a2d03f14f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:43.564139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b920b27-4f50-45a7-8380-f41a2d03f14f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:43.694644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5b920b27-4f50-45a7-8380-f41a2d03f14f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:43.702761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5b920b27-4f50-45a7-8380-f41a2d03f14f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.151826 Aug 24 04:54:43.703334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 55/115] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:44.193656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b1873575-f148-46ec-b4f6-fb395f28df9c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:44.194474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b1873575-f148-46ec-b4f6-fb395f28df9c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:44.200954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1873575-f148-46ec-b4f6-fb395f28df9c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.201481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1873575-f148-46ec-b4f6-fb395f28df9c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.201958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1873575-f148-46ec-b4f6-fb395f28df9c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.202702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1873575-f148-46ec-b4f6-fb395f28df9c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.203156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1873575-f148-46ec-b4f6-fb395f28df9c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.203966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1873575-f148-46ec-b4f6-fb395f28df9c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.208690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:44.338229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b1873575-f148-46ec-b4f6-fb395f28df9c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:44.346540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b1873575-f148-46ec-b4f6-fb395f28df9c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.157908 Aug 24 04:54:44.347133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 61/116] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:44 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:44.364205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3e2d98b2-693f-48ef-a309-e8a59400c10f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:44.365048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3e2d98b2-693f-48ef-a309-e8a59400c10f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:44.371558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d98b2-693f-48ef-a309-e8a59400c10f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d98b2-693f-48ef-a309-e8a59400c10f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.372463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d98b2-693f-48ef-a309-e8a59400c10f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.373226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d98b2-693f-48ef-a309-e8a59400c10f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.373720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d98b2-693f-48ef-a309-e8a59400c10f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.374157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d98b2-693f-48ef-a309-e8a59400c10f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.530996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3e2d98b2-693f-48ef-a309-e8a59400c10f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:44.535553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8febda87-c840-4333-96f6-7bb8735d26b7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:44.536341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8febda87-c840-4333-96f6-7bb8735d26b7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:44.540813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3e2d98b2-693f-48ef-a309-e8a59400c10f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.181538 Aug 24 04:54:44.542409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 56/117] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:44 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:44.556237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8febda87-c840-4333-96f6-7bb8735d26b7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.557006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8febda87-c840-4333-96f6-7bb8735d26b7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.557654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8febda87-c840-4333-96f6-7bb8735d26b7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.558938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8febda87-c840-4333-96f6-7bb8735d26b7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.559584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8febda87-c840-4333-96f6-7bb8735d26b7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.559982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8febda87-c840-4333-96f6-7bb8735d26b7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.724751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d229b7ed-5e46-472a-8644-6586fe0cdbc7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:44.725388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d229b7ed-5e46-472a-8644-6586fe0cdbc7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:44.730162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8febda87-c840-4333-96f6-7bb8735d26b7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:44.731691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d229b7ed-5e46-472a-8644-6586fe0cdbc7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.732189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d229b7ed-5e46-472a-8644-6586fe0cdbc7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.732635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d229b7ed-5e46-472a-8644-6586fe0cdbc7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.733341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d229b7ed-5e46-472a-8644-6586fe0cdbc7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:44.733797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d229b7ed-5e46-472a-8644-6586fe0cdbc7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:44.734240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d229b7ed-5e46-472a-8644-6586fe0cdbc7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:44.739339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8febda87-c840-4333-96f6-7bb8735d26b7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.210532 Aug 24 04:54:44.739919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 62/118] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:44.867214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d229b7ed-5e46-472a-8644-6586fe0cdbc7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:44.874766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d229b7ed-5e46-472a-8644-6586fe0cdbc7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.154647 Aug 24 04:54:44.875330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 57/119] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:45.367658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6d6e94cb-0164-40ef-9e98-82c0b72b8aca tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:45.368810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6d6e94cb-0164-40ef-9e98-82c0b72b8aca tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:45.375532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d6e94cb-0164-40ef-9e98-82c0b72b8aca tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.376014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d6e94cb-0164-40ef-9e98-82c0b72b8aca tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.376461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d6e94cb-0164-40ef-9e98-82c0b72b8aca tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.377266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d6e94cb-0164-40ef-9e98-82c0b72b8aca tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.377909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d6e94cb-0164-40ef-9e98-82c0b72b8aca tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.378242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d6e94cb-0164-40ef-9e98-82c0b72b8aca tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.563167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6d6e94cb-0164-40ef-9e98-82c0b72b8aca tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:45.569284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1de9214e-3f2c-4d4d-b4b9-10dfcb5d1454 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:45.570511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1de9214e-3f2c-4d4d-b4b9-10dfcb5d1454 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:45.577058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6d6e94cb-0164-40ef-9e98-82c0b72b8aca tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.213129 Aug 24 04:54:45.578499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 63/120] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:45 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:45.583541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1de9214e-3f2c-4d4d-b4b9-10dfcb5d1454 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.584821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1de9214e-3f2c-4d4d-b4b9-10dfcb5d1454 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.586007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1de9214e-3f2c-4d4d-b4b9-10dfcb5d1454 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.587368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1de9214e-3f2c-4d4d-b4b9-10dfcb5d1454 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.588390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1de9214e-3f2c-4d4d-b4b9-10dfcb5d1454 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.589354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1de9214e-3f2c-4d4d-b4b9-10dfcb5d1454 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.763583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-270d3266-7e04-4f1a-868c-9175c0410ee5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:45.764189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-270d3266-7e04-4f1a-868c-9175c0410ee5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:45.770959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-270d3266-7e04-4f1a-868c-9175c0410ee5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.771606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-270d3266-7e04-4f1a-868c-9175c0410ee5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.772045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-270d3266-7e04-4f1a-868c-9175c0410ee5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.772740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-270d3266-7e04-4f1a-868c-9175c0410ee5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.773194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-270d3266-7e04-4f1a-868c-9175c0410ee5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.773619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-270d3266-7e04-4f1a-868c-9175c0410ee5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.857182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1de9214e-3f2c-4d4d-b4b9-10dfcb5d1454 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:45.866554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1de9214e-3f2c-4d4d-b4b9-10dfcb5d1454 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.304235 Aug 24 04:54:45.867330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 58/121] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:45 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:45.895868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bd4e2646-5e51-4515-9728-52d9375f13be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:45.897552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bd4e2646-5e51-4515-9728-52d9375f13be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:45.904299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd4e2646-5e51-4515-9728-52d9375f13be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.904774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd4e2646-5e51-4515-9728-52d9375f13be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.905196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd4e2646-5e51-4515-9728-52d9375f13be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.905873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd4e2646-5e51-4515-9728-52d9375f13be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:45.906493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd4e2646-5e51-4515-9728-52d9375f13be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:45.906963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd4e2646-5e51-4515-9728-52d9375f13be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:45.924897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-270d3266-7e04-4f1a-868c-9175c0410ee5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:45.933339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-270d3266-7e04-4f1a-868c-9175c0410ee5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.173808 Aug 24 04:54:45.934458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 64/122] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:46.097382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bd4e2646-5e51-4515-9728-52d9375f13be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:46.105750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bd4e2646-5e51-4515-9728-52d9375f13be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.213688 Aug 24 04:54:46.106346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 59/123] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:46.599909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-14515384-3505-4ad8-a04e-9ee558db5bfb tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:46.600515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-14515384-3505-4ad8-a04e-9ee558db5bfb tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:46.606563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14515384-3505-4ad8-a04e-9ee558db5bfb tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:46.607254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14515384-3505-4ad8-a04e-9ee558db5bfb tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:46.607867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14515384-3505-4ad8-a04e-9ee558db5bfb tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:46.608550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14515384-3505-4ad8-a04e-9ee558db5bfb tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:46.609023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14515384-3505-4ad8-a04e-9ee558db5bfb tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:46.609415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14515384-3505-4ad8-a04e-9ee558db5bfb tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:46.878831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-14515384-3505-4ad8-a04e-9ee558db5bfb tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:46.887234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-14515384-3505-4ad8-a04e-9ee558db5bfb tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.291648 Aug 24 04:54:46.888630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 65/124] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:46 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:46.888747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-05255880-d99e-48c6-ad50-141728d5d940 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:46.889467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-05255880-d99e-48c6-ad50-141728d5d940 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:46.896322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05255880-d99e-48c6-ad50-141728d5d940 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:46.896800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05255880-d99e-48c6-ad50-141728d5d940 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:46.897223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05255880-d99e-48c6-ad50-141728d5d940 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:46.898598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05255880-d99e-48c6-ad50-141728d5d940 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:46.899229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05255880-d99e-48c6-ad50-141728d5d940 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:46.899647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05255880-d99e-48c6-ad50-141728d5d940 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:46.956085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c311ee19-9382-4219-8c80-3bf44536ca88 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:46.956996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c311ee19-9382-4219-8c80-3bf44536ca88 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:46.964718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c311ee19-9382-4219-8c80-3bf44536ca88 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:46.965614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c311ee19-9382-4219-8c80-3bf44536ca88 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:46.966284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c311ee19-9382-4219-8c80-3bf44536ca88 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:46.967191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c311ee19-9382-4219-8c80-3bf44536ca88 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:46.967791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c311ee19-9382-4219-8c80-3bf44536ca88 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:46.968362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c311ee19-9382-4219-8c80-3bf44536ca88 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:47.193064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c311ee19-9382-4219-8c80-3bf44536ca88 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:47.204237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c311ee19-9382-4219-8c80-3bf44536ca88 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.252933 Aug 24 04:54:47.207145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 66/125] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:47.222736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-62951be7-8006-4ad6-8534-2d197298f673 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:47.223614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-62951be7-8006-4ad6-8534-2d197298f673 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:47.230939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62951be7-8006-4ad6-8534-2d197298f673 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:47.231737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62951be7-8006-4ad6-8534-2d197298f673 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:47.232352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62951be7-8006-4ad6-8534-2d197298f673 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:47.233192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62951be7-8006-4ad6-8534-2d197298f673 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:47.234028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62951be7-8006-4ad6-8534-2d197298f673 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:47.234449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62951be7-8006-4ad6-8534-2d197298f673 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:47.236783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-05255880-d99e-48c6-ad50-141728d5d940 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:47.245462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-05255880-d99e-48c6-ad50-141728d5d940 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.361230 Aug 24 04:54:47.259542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 60/126] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:46 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:47.378778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-62951be7-8006-4ad6-8534-2d197298f673 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:47.387597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-62951be7-8006-4ad6-8534-2d197298f673 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.179234 Aug 24 04:54:47.388176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 67/127] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:47.909786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cf61af33-2709-4de6-b525-a3193d1466e2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:47.910469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cf61af33-2709-4de6-b525-a3193d1466e2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:47.917270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf61af33-2709-4de6-b525-a3193d1466e2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:47.917959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf61af33-2709-4de6-b525-a3193d1466e2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:47.918660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf61af33-2709-4de6-b525-a3193d1466e2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:47.919534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf61af33-2709-4de6-b525-a3193d1466e2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:47.919992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf61af33-2709-4de6-b525-a3193d1466e2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:47.920416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf61af33-2709-4de6-b525-a3193d1466e2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.066297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cf61af33-2709-4de6-b525-a3193d1466e2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:48.074917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cf61af33-2709-4de6-b525-a3193d1466e2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.169445 Aug 24 04:54:48.075679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 61/128] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:47 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:48.229430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2054dbca-29d3-40f5-80b6-2756cd9fd3b9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:48.230724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2054dbca-29d3-40f5-80b6-2756cd9fd3b9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:48.236890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2054dbca-29d3-40f5-80b6-2756cd9fd3b9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:48.237369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2054dbca-29d3-40f5-80b6-2756cd9fd3b9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:48.237798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2054dbca-29d3-40f5-80b6-2756cd9fd3b9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.238487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2054dbca-29d3-40f5-80b6-2756cd9fd3b9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:48.238963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2054dbca-29d3-40f5-80b6-2756cd9fd3b9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:48.239378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2054dbca-29d3-40f5-80b6-2756cd9fd3b9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.269661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6d7baae9-b272-4a9e-9d03-a044cef537cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:48.270507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6d7baae9-b272-4a9e-9d03-a044cef537cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:48.293125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d7baae9-b272-4a9e-9d03-a044cef537cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:48.294317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d7baae9-b272-4a9e-9d03-a044cef537cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:48.298877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d7baae9-b272-4a9e-9d03-a044cef537cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.298877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d7baae9-b272-4a9e-9d03-a044cef537cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:48.299229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d7baae9-b272-4a9e-9d03-a044cef537cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:48.299782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d7baae9-b272-4a9e-9d03-a044cef537cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.409587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2054dbca-29d3-40f5-80b6-2756cd9fd3b9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:48.417576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2054dbca-29d3-40f5-80b6-2756cd9fd3b9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.194588 Aug 24 04:54:48.419073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 68/129] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:48.424174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ad1b3f55-5939-4b84-9ee4-04ab3bea6d63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:48.424850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ad1b3f55-5939-4b84-9ee4-04ab3bea6d63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:48.431450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1b3f55-5939-4b84-9ee4-04ab3bea6d63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:48.432039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1b3f55-5939-4b84-9ee4-04ab3bea6d63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:48.432541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1b3f55-5939-4b84-9ee4-04ab3bea6d63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.433297 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1b3f55-5939-4b84-9ee4-04ab3bea6d63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:48.433817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1b3f55-5939-4b84-9ee4-04ab3bea6d63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:48.434303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1b3f55-5939-4b84-9ee4-04ab3bea6d63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:48.482949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6d7baae9-b272-4a9e-9d03-a044cef537cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:48.492497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6d7baae9-b272-4a9e-9d03-a044cef537cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.228391 Aug 24 04:54:48.493092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 62/130] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:48 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:48.589733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ad1b3f55-5939-4b84-9ee4-04ab3bea6d63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:48.598842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ad1b3f55-5939-4b84-9ee4-04ab3bea6d63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.178689 Aug 24 04:54:48.599418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 69/131] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:49.098120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f01e3947-87b3-459a-8f0d-8a1b20ad5bc3 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:49.098726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f01e3947-87b3-459a-8f0d-8a1b20ad5bc3 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:49.104836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f01e3947-87b3-459a-8f0d-8a1b20ad5bc3 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.105314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f01e3947-87b3-459a-8f0d-8a1b20ad5bc3 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.105750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f01e3947-87b3-459a-8f0d-8a1b20ad5bc3 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.106444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f01e3947-87b3-459a-8f0d-8a1b20ad5bc3 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.106918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f01e3947-87b3-459a-8f0d-8a1b20ad5bc3 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.107335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f01e3947-87b3-459a-8f0d-8a1b20ad5bc3 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.252088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f01e3947-87b3-459a-8f0d-8a1b20ad5bc3 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:49.260331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f01e3947-87b3-459a-8f0d-8a1b20ad5bc3 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.166842 Aug 24 04:54:49.261161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 63/132] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:49 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:49.444609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9a9de1cc-41fe-4a1a-8555-53d037f3f113 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:49.445287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9a9de1cc-41fe-4a1a-8555-53d037f3f113 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:49.451846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a9de1cc-41fe-4a1a-8555-53d037f3f113 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.452328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a9de1cc-41fe-4a1a-8555-53d037f3f113 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.452900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a9de1cc-41fe-4a1a-8555-53d037f3f113 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.453583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a9de1cc-41fe-4a1a-8555-53d037f3f113 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.454263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a9de1cc-41fe-4a1a-8555-53d037f3f113 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.455531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a9de1cc-41fe-4a1a-8555-53d037f3f113 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.513808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c5f8fdfb-0945-4447-b4f9-359b00c8f2bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:49.514596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c5f8fdfb-0945-4447-b4f9-359b00c8f2bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:49.535690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5f8fdfb-0945-4447-b4f9-359b00c8f2bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.536194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5f8fdfb-0945-4447-b4f9-359b00c8f2bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.538281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5f8fdfb-0945-4447-b4f9-359b00c8f2bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.539218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5f8fdfb-0945-4447-b4f9-359b00c8f2bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.539735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5f8fdfb-0945-4447-b4f9-359b00c8f2bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.540181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5f8fdfb-0945-4447-b4f9-359b00c8f2bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.660561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9a9de1cc-41fe-4a1a-8555-53d037f3f113 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:49.685836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9a9de1cc-41fe-4a1a-8555-53d037f3f113 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.245670 Aug 24 04:54:49.688386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 70/133] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:49.694169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e3fa9df6-7cd8-495d-ad6b-1b34c717fe80 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:49.697252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e3fa9df6-7cd8-495d-ad6b-1b34c717fe80 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:49.720468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3fa9df6-7cd8-495d-ad6b-1b34c717fe80 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.720966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3fa9df6-7cd8-495d-ad6b-1b34c717fe80 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.721419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3fa9df6-7cd8-495d-ad6b-1b34c717fe80 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.722103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3fa9df6-7cd8-495d-ad6b-1b34c717fe80 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:49.725480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3fa9df6-7cd8-495d-ad6b-1b34c717fe80 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:49.728844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3fa9df6-7cd8-495d-ad6b-1b34c717fe80 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:49.784191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c5f8fdfb-0945-4447-b4f9-359b00c8f2bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:49.794318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c5f8fdfb-0945-4447-b4f9-359b00c8f2bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.284490 Aug 24 04:54:49.796133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 64/134] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:49 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:49.937275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e3fa9df6-7cd8-495d-ad6b-1b34c717fe80 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:49.951156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e3fa9df6-7cd8-495d-ad6b-1b34c717fe80 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.259175 Aug 24 04:54:49.953791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 71/135] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:50.283469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-53c8af89-61b0-45ae-8597-a5ead128930a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:50.284750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-53c8af89-61b0-45ae-8597-a5ead128930a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:50.294021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53c8af89-61b0-45ae-8597-a5ead128930a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.294659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53c8af89-61b0-45ae-8597-a5ead128930a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.295416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53c8af89-61b0-45ae-8597-a5ead128930a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:50.296288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53c8af89-61b0-45ae-8597-a5ead128930a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.296737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53c8af89-61b0-45ae-8597-a5ead128930a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.297155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53c8af89-61b0-45ae-8597-a5ead128930a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:50.512833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-efbb0edd-0e1e-4833-b8b8-2c699f3cef69 req-2f4e74eb-f04b-46ca-a311-f276896b8560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753ff212-29b2-4316-8343-c0edb0407444", "name": "network-vif-plugged", "status": "completed", "tag": "453466b4-98b4-4211-aef1-6ab4ea3f27fd"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:50.523966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-efbb0edd-0e1e-4833-b8b8-2c699f3cef69 req-2f4e74eb-f04b-46ca-a311-f276896b8560 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.524562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-efbb0edd-0e1e-4833-b8b8-2c699f3cef69 req-2f4e74eb-f04b-46ca-a311-f276896b8560 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.525126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-efbb0edd-0e1e-4833-b8b8-2c699f3cef69 req-2f4e74eb-f04b-46ca-a311-f276896b8560 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:50.536250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-53c8af89-61b0-45ae-8597-a5ead128930a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:50.537636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-efbb0edd-0e1e-4833-b8b8-2c699f3cef69 req-2f4e74eb-f04b-46ca-a311-f276896b8560 service nova] Creating event network-vif-plugged:453466b4-98b4-4211-aef1-6ab4ea3f27fd for instance 753ff212-29b2-4316-8343-c0edb0407444 on hv-cinder-85426 Aug 24 04:54:50.544432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-efbb0edd-0e1e-4833-b8b8-2c699f3cef69 req-2f4e74eb-f04b-46ca-a311-f276896b8560 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106078 Aug 24 04:54:50.550582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-53c8af89-61b0-45ae-8597-a5ead128930a tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.272485 Aug 24 04:54:50.551705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 65/136] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:50 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:50.558228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 72/137] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:50.708945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a11acd9f-6256-4b63-9ec3-268fba0eec78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:50.709969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a11acd9f-6256-4b63-9ec3-268fba0eec78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:50.716925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a11acd9f-6256-4b63-9ec3-268fba0eec78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.717519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a11acd9f-6256-4b63-9ec3-268fba0eec78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.718182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a11acd9f-6256-4b63-9ec3-268fba0eec78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:50.719023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a11acd9f-6256-4b63-9ec3-268fba0eec78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.719741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a11acd9f-6256-4b63-9ec3-268fba0eec78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.721166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a11acd9f-6256-4b63-9ec3-268fba0eec78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:50.819484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-24187f13-1ae0-403b-b0df-7f79048ee563 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:50.821106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-24187f13-1ae0-403b-b0df-7f79048ee563 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:50.830106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24187f13-1ae0-403b-b0df-7f79048ee563 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.830762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24187f13-1ae0-403b-b0df-7f79048ee563 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.831317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24187f13-1ae0-403b-b0df-7f79048ee563 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:50.832269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24187f13-1ae0-403b-b0df-7f79048ee563 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:50.833171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24187f13-1ae0-403b-b0df-7f79048ee563 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:50.834336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24187f13-1ae0-403b-b0df-7f79048ee563 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:51.025479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a11acd9f-6256-4b63-9ec3-268fba0eec78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:51.041136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a11acd9f-6256-4b63-9ec3-268fba0eec78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.336214 Aug 24 04:54:51.041727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 66/138] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:51.052911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0b858d80-2531-41e7-bd2e-d4250a5e4ab2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:51.053528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0b858d80-2531-41e7-bd2e-d4250a5e4ab2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:51.081187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b858d80-2531-41e7-bd2e-d4250a5e4ab2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:51.083343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b858d80-2531-41e7-bd2e-d4250a5e4ab2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:51.084027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b858d80-2531-41e7-bd2e-d4250a5e4ab2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:51.085517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b858d80-2531-41e7-bd2e-d4250a5e4ab2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:51.086197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b858d80-2531-41e7-bd2e-d4250a5e4ab2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:51.086898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b858d80-2531-41e7-bd2e-d4250a5e4ab2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:51.358526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-24187f13-1ae0-403b-b0df-7f79048ee563 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:51.368078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-24187f13-1ae0-403b-b0df-7f79048ee563 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.554695 Aug 24 04:54:51.382022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 73/139] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:50 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:51.443310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0b858d80-2531-41e7-bd2e-d4250a5e4ab2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:51.458282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0b858d80-2531-41e7-bd2e-d4250a5e4ab2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.415491 Aug 24 04:54:51.458903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 67/140] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:51.574079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-14c784d9-6909-421d-b40a-f626b152b04b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:51.574974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-14c784d9-6909-421d-b40a-f626b152b04b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:51.582145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14c784d9-6909-421d-b40a-f626b152b04b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:51.583005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14c784d9-6909-421d-b40a-f626b152b04b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:51.584084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14c784d9-6909-421d-b40a-f626b152b04b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:51.585933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14c784d9-6909-421d-b40a-f626b152b04b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:51.586359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14c784d9-6909-421d-b40a-f626b152b04b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:51.586887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14c784d9-6909-421d-b40a-f626b152b04b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:51.758487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-55bf047f-0beb-4e3d-b0fd-105e8fb72cca req-46be5155-9197-450b-86f5-075847cb71e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598c5040-751c-4914-906d-031f0abe36aa", "tag": "bdbf7cbc-ecbc-4cba-98a8-1e7f94e21fbc"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:51.783288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-55bf047f-0beb-4e3d-b0fd-105e8fb72cca req-46be5155-9197-450b-86f5-075847cb71e5 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:51.785124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-55bf047f-0beb-4e3d-b0fd-105e8fb72cca req-46be5155-9197-450b-86f5-075847cb71e5 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:51.785788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-55bf047f-0beb-4e3d-b0fd-105e8fb72cca req-46be5155-9197-450b-86f5-075847cb71e5 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:51.808128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-55bf047f-0beb-4e3d-b0fd-105e8fb72cca req-46be5155-9197-450b-86f5-075847cb71e5 service nova] Creating event network-changed:bdbf7cbc-ecbc-4cba-98a8-1e7f94e21fbc for instance 598c5040-751c-4914-906d-031f0abe36aa on hv-cinder-85426 Aug 24 04:54:51.826552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-55bf047f-0beb-4e3d-b0fd-105e8fb72cca req-46be5155-9197-450b-86f5-075847cb71e5 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069507 Aug 24 04:54:51.827653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 68/141] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:51.886176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-14c784d9-6909-421d-b40a-f626b152b04b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:51.895086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-14c784d9-6909-421d-b40a-f626b152b04b tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.324800 Aug 24 04:54:51.895881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 74/142] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:51 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:52.063011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e9f8c2d8-b1fc-4741-ab88-86ce37e127a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:52.063721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e9f8c2d8-b1fc-4741-ab88-86ce37e127a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:52.080259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-f442c7fe-f9a9-4a4d-a08d-1d4749b90034 req-552354f9-d489-4911-a337-73675f3f4a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0463d0c-9ee3-4f76-91c6-2fcbdfb55053", "tag": "6cf34b36-25b7-4379-a2c5-fda35bfb9740"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:52.090838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9f8c2d8-b1fc-4741-ab88-86ce37e127a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.091345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9f8c2d8-b1fc-4741-ab88-86ce37e127a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.091789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9f8c2d8-b1fc-4741-ab88-86ce37e127a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.096287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9f8c2d8-b1fc-4741-ab88-86ce37e127a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.097975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9f8c2d8-b1fc-4741-ab88-86ce37e127a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.098771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9f8c2d8-b1fc-4741-ab88-86ce37e127a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.101887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f442c7fe-f9a9-4a4d-a08d-1d4749b90034 req-552354f9-d489-4911-a337-73675f3f4a42 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.104222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f442c7fe-f9a9-4a4d-a08d-1d4749b90034 req-552354f9-d489-4911-a337-73675f3f4a42 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.108154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f442c7fe-f9a9-4a4d-a08d-1d4749b90034 req-552354f9-d489-4911-a337-73675f3f4a42 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.139087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-f442c7fe-f9a9-4a4d-a08d-1d4749b90034 req-552354f9-d489-4911-a337-73675f3f4a42 service nova] Creating event network-changed:6cf34b36-25b7-4379-a2c5-fda35bfb9740 for instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 on hv-cinder-85426 Aug 24 04:54:52.152015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-f442c7fe-f9a9-4a4d-a08d-1d4749b90034 req-552354f9-d489-4911-a337-73675f3f4a42 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075670 Aug 24 04:54:52.155242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 75/143] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:54:52.302833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e9f8c2d8-b1fc-4741-ab88-86ce37e127a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:52.309966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e9f8c2d8-b1fc-4741-ab88-86ce37e127a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.251958 Aug 24 04:54:52.311057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 69/144] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:52.390141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-60ec32f9-0ada-4e96-ac97-e48f3d693391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:52.391054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-60ec32f9-0ada-4e96-ac97-e48f3d693391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:52.419374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-60ec32f9-0ada-4e96-ac97-e48f3d693391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.419890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-60ec32f9-0ada-4e96-ac97-e48f3d693391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.420385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-60ec32f9-0ada-4e96-ac97-e48f3d693391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.421221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-60ec32f9-0ada-4e96-ac97-e48f3d693391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.421680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-60ec32f9-0ada-4e96-ac97-e48f3d693391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.422105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-60ec32f9-0ada-4e96-ac97-e48f3d693391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.479879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1bb32e53-9734-4cff-b357-c389854ec35f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:52.480988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1bb32e53-9734-4cff-b357-c389854ec35f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:52.500066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bb32e53-9734-4cff-b357-c389854ec35f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.515921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bb32e53-9734-4cff-b357-c389854ec35f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.516681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bb32e53-9734-4cff-b357-c389854ec35f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.517644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bb32e53-9734-4cff-b357-c389854ec35f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.520223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bb32e53-9734-4cff-b357-c389854ec35f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.521468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bb32e53-9734-4cff-b357-c389854ec35f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.600822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-60ec32f9-0ada-4e96-ac97-e48f3d693391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:52.612184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-60ec32f9-0ada-4e96-ac97-e48f3d693391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.226268 Aug 24 04:54:52.629295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 76/145] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:52 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:52.739934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1bb32e53-9734-4cff-b357-c389854ec35f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:52.748169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1bb32e53-9734-4cff-b357-c389854ec35f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.273021 Aug 24 04:54:52.750204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 70/146] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:52.916264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-252139d9-27fb-40a0-b269-1a9c53c073bd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:52.916264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-252139d9-27fb-40a0-b269-1a9c53c073bd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:52.928956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-252139d9-27fb-40a0-b269-1a9c53c073bd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.929832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-252139d9-27fb-40a0-b269-1a9c53c073bd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.930287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-252139d9-27fb-40a0-b269-1a9c53c073bd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:52.931042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-252139d9-27fb-40a0-b269-1a9c53c073bd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:52.931713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-252139d9-27fb-40a0-b269-1a9c53c073bd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:52.932294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-252139d9-27fb-40a0-b269-1a9c53c073bd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:53.154677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-252139d9-27fb-40a0-b269-1a9c53c073bd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:53.173022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-252139d9-27fb-40a0-b269-1a9c53c073bd tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.257043 Aug 24 04:54:53.174637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 77/147] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:52 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:53.331517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-182d08a2-48c9-4531-9f1a-ace073ff689e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:53.332557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-182d08a2-48c9-4531-9f1a-ace073ff689e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:53.340519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-182d08a2-48c9-4531-9f1a-ace073ff689e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:53.341365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-182d08a2-48c9-4531-9f1a-ace073ff689e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:53.342063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-182d08a2-48c9-4531-9f1a-ace073ff689e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:53.343243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-182d08a2-48c9-4531-9f1a-ace073ff689e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:53.343846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-182d08a2-48c9-4531-9f1a-ace073ff689e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:53.344424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-182d08a2-48c9-4531-9f1a-ace073ff689e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:53.636166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f1c74102-558e-4bfd-85f1-dd697f653d8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:53.636777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f1c74102-558e-4bfd-85f1-dd697f653d8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:53.666988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1c74102-558e-4bfd-85f1-dd697f653d8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:53.667736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1c74102-558e-4bfd-85f1-dd697f653d8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:53.670646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1c74102-558e-4bfd-85f1-dd697f653d8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:53.672710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1c74102-558e-4bfd-85f1-dd697f653d8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:53.675426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1c74102-558e-4bfd-85f1-dd697f653d8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:53.680109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1c74102-558e-4bfd-85f1-dd697f653d8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.010382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f1c74102-558e-4bfd-85f1-dd697f653d8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:54.020017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f1c74102-558e-4bfd-85f1-dd697f653d8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.389048 Aug 24 04:54:54.021816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 78/148] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:53 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:54.027487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1210ac21-b789-487f-b28b-787cd995b9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:54.028105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1210ac21-b789-487f-b28b-787cd995b9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:54.046495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1210ac21-b789-487f-b28b-787cd995b9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.047079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1210ac21-b789-487f-b28b-787cd995b9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.047599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1210ac21-b789-487f-b28b-787cd995b9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.048398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1210ac21-b789-487f-b28b-787cd995b9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.048917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1210ac21-b789-487f-b28b-787cd995b9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.049414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1210ac21-b789-487f-b28b-787cd995b9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.053899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:54.128369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-182d08a2-48c9-4531-9f1a-ace073ff689e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:54.155324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-182d08a2-48c9-4531-9f1a-ace073ff689e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.812773 Aug 24 04:54:54.167323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 71/149] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:54.197791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1ec26ac5-887d-4725-8938-ab21051b3ee0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:54.198566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1ec26ac5-887d-4725-8938-ab21051b3ee0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:54.215955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ec26ac5-887d-4725-8938-ab21051b3ee0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.218177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ec26ac5-887d-4725-8938-ab21051b3ee0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.220905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ec26ac5-887d-4725-8938-ab21051b3ee0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.223263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ec26ac5-887d-4725-8938-ab21051b3ee0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.230025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ec26ac5-887d-4725-8938-ab21051b3ee0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.230550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ec26ac5-887d-4725-8938-ab21051b3ee0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.255811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:54.430780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1210ac21-b789-487f-b28b-787cd995b9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:54.439430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1210ac21-b789-487f-b28b-787cd995b9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.416555 Aug 24 04:54:54.440015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 79/150] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:54.680205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-18d58475-5baf-4f40-9f52-3efd2696c675 req-20aa67fb-2e10-4741-a9a2-3db25001d095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc16ffe9-0180-4a64-b937-bfd52cacbc89", "name": "network-vif-plugged", "status": "completed", "tag": "8db7ccd5-249a-4f20-a57f-62285a9089a4"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:54:54.699824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-18d58475-5baf-4f40-9f52-3efd2696c675 req-20aa67fb-2e10-4741-a9a2-3db25001d095 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:54.700556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-18d58475-5baf-4f40-9f52-3efd2696c675 req-20aa67fb-2e10-4741-a9a2-3db25001d095 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:54.702014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-18d58475-5baf-4f40-9f52-3efd2696c675 req-20aa67fb-2e10-4741-a9a2-3db25001d095 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:54.730776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-18d58475-5baf-4f40-9f52-3efd2696c675 req-20aa67fb-2e10-4741-a9a2-3db25001d095 service nova] Creating event network-vif-plugged:8db7ccd5-249a-4f20-a57f-62285a9089a4 for instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 on hv-cinder-85426 Aug 24 04:54:54.748085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-18d58475-5baf-4f40-9f52-3efd2696c675 req-20aa67fb-2e10-4741-a9a2-3db25001d095 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072043 Aug 24 04:54:54.749468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 80/151] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:54:55.044540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2f4b2754-b854-4714-bb73-1d6e52ae3c28 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:55.045339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2f4b2754-b854-4714-bb73-1d6e52ae3c28 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:55.052154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f4b2754-b854-4714-bb73-1d6e52ae3c28 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.052711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f4b2754-b854-4714-bb73-1d6e52ae3c28 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.053216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f4b2754-b854-4714-bb73-1d6e52ae3c28 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.054256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f4b2754-b854-4714-bb73-1d6e52ae3c28 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.054719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f4b2754-b854-4714-bb73-1d6e52ae3c28 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.055328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f4b2754-b854-4714-bb73-1d6e52ae3c28 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.056181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1ec26ac5-887d-4725-8938-ab21051b3ee0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:55.064965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1ec26ac5-887d-4725-8938-ab21051b3ee0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.872443 Aug 24 04:54:55.065760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 72/152] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:54 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:55.182121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1d3e431a-88f0-4c5f-ab18-0ff39e049cef tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:55.183012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1d3e431a-88f0-4c5f-ab18-0ff39e049cef tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:55.189979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d3e431a-88f0-4c5f-ab18-0ff39e049cef tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.190462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d3e431a-88f0-4c5f-ab18-0ff39e049cef tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.191248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d3e431a-88f0-4c5f-ab18-0ff39e049cef tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.191937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d3e431a-88f0-4c5f-ab18-0ff39e049cef tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.192385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d3e431a-88f0-4c5f-ab18-0ff39e049cef tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.192800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d3e431a-88f0-4c5f-ab18-0ff39e049cef tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.202519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2f4b2754-b854-4714-bb73-1d6e52ae3c28 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:55.210788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2f4b2754-b854-4714-bb73-1d6e52ae3c28 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.170693 Aug 24 04:54:55.211969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 81/153] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:55 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:55.358245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1d3e431a-88f0-4c5f-ab18-0ff39e049cef tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:55.366901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1d3e431a-88f0-4c5f-ab18-0ff39e049cef tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.190020 Aug 24 04:54:55.367642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 73/154] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:55.460758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-417db0c1-305f-4ebd-8282-b6f02c075c95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:55.461464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-417db0c1-305f-4ebd-8282-b6f02c075c95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:55.467868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-417db0c1-305f-4ebd-8282-b6f02c075c95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.468356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-417db0c1-305f-4ebd-8282-b6f02c075c95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.468993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-417db0c1-305f-4ebd-8282-b6f02c075c95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.469829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-417db0c1-305f-4ebd-8282-b6f02c075c95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:55.471097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-417db0c1-305f-4ebd-8282-b6f02c075c95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:55.471877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-417db0c1-305f-4ebd-8282-b6f02c075c95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:55.614112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-417db0c1-305f-4ebd-8282-b6f02c075c95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:55.622366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-417db0c1-305f-4ebd-8282-b6f02c075c95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.165509 Aug 24 04:54:55.623235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 82/155] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:56.086306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fe66e1fa-6ab8-4b5b-a21e-4e2cc4910925 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:56.087216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fe66e1fa-6ab8-4b5b-a21e-4e2cc4910925 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:56.093708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe66e1fa-6ab8-4b5b-a21e-4e2cc4910925 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.094195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe66e1fa-6ab8-4b5b-a21e-4e2cc4910925 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.094628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe66e1fa-6ab8-4b5b-a21e-4e2cc4910925 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.095929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe66e1fa-6ab8-4b5b-a21e-4e2cc4910925 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.096554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe66e1fa-6ab8-4b5b-a21e-4e2cc4910925 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.096981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe66e1fa-6ab8-4b5b-a21e-4e2cc4910925 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.235705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e84de63e-ab53-41dc-96b8-0ac4879c5d00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:56.236507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e84de63e-ab53-41dc-96b8-0ac4879c5d00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:56.242995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fe66e1fa-6ab8-4b5b-a21e-4e2cc4910925 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:56.243480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e84de63e-ab53-41dc-96b8-0ac4879c5d00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.243565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e84de63e-ab53-41dc-96b8-0ac4879c5d00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.243957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e84de63e-ab53-41dc-96b8-0ac4879c5d00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.244645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e84de63e-ab53-41dc-96b8-0ac4879c5d00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.245268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e84de63e-ab53-41dc-96b8-0ac4879c5d00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.245841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e84de63e-ab53-41dc-96b8-0ac4879c5d00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.250618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fe66e1fa-6ab8-4b5b-a21e-4e2cc4910925 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.168036 Aug 24 04:54:56.263592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 74/156] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:56 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:56.387530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-195955bd-62ef-4fdf-b3e5-cac8bc70da9c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:56.388130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-195955bd-62ef-4fdf-b3e5-cac8bc70da9c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:56.393098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e84de63e-ab53-41dc-96b8-0ac4879c5d00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:56.395152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-195955bd-62ef-4fdf-b3e5-cac8bc70da9c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.395576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-195955bd-62ef-4fdf-b3e5-cac8bc70da9c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.396005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-195955bd-62ef-4fdf-b3e5-cac8bc70da9c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.396685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-195955bd-62ef-4fdf-b3e5-cac8bc70da9c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.398014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-195955bd-62ef-4fdf-b3e5-cac8bc70da9c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.398594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-195955bd-62ef-4fdf-b3e5-cac8bc70da9c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.404009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e84de63e-ab53-41dc-96b8-0ac4879c5d00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.172003 Aug 24 04:54:56.404692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 83/157] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:56 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:56.572475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-195955bd-62ef-4fdf-b3e5-cac8bc70da9c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:56.582580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-195955bd-62ef-4fdf-b3e5-cac8bc70da9c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.198747 Aug 24 04:54:56.599330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 75/158] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:56.645445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b433b49b-483c-4465-ad3a-a05146a515b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:56.646057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b433b49b-483c-4465-ad3a-a05146a515b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:56.651956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b433b49b-483c-4465-ad3a-a05146a515b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.652715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b433b49b-483c-4465-ad3a-a05146a515b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.653156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b433b49b-483c-4465-ad3a-a05146a515b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.653833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b433b49b-483c-4465-ad3a-a05146a515b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:56.654285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b433b49b-483c-4465-ad3a-a05146a515b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:56.654714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b433b49b-483c-4465-ad3a-a05146a515b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:56.820149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b433b49b-483c-4465-ad3a-a05146a515b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:56.828892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b433b49b-483c-4465-ad3a-a05146a515b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.188062 Aug 24 04:54:56.830237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 84/159] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:57.271088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8ca71e5-038d-4e26-afb5-4a56115cd7c6 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:57.272054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c8ca71e5-038d-4e26-afb5-4a56115cd7c6 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:57.278250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8ca71e5-038d-4e26-afb5-4a56115cd7c6 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.279455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8ca71e5-038d-4e26-afb5-4a56115cd7c6 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.279893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8ca71e5-038d-4e26-afb5-4a56115cd7c6 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.280606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8ca71e5-038d-4e26-afb5-4a56115cd7c6 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.281105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8ca71e5-038d-4e26-afb5-4a56115cd7c6 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.281512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8ca71e5-038d-4e26-afb5-4a56115cd7c6 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.426144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ab7dcc1c-74e5-47cd-ad77-82b979c112c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:57.426758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ab7dcc1c-74e5-47cd-ad77-82b979c112c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:57.431367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c8ca71e5-038d-4e26-afb5-4a56115cd7c6 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:57.432741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab7dcc1c-74e5-47cd-ad77-82b979c112c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.433302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab7dcc1c-74e5-47cd-ad77-82b979c112c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.433957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab7dcc1c-74e5-47cd-ad77-82b979c112c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.434646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab7dcc1c-74e5-47cd-ad77-82b979c112c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.435280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab7dcc1c-74e5-47cd-ad77-82b979c112c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.435798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab7dcc1c-74e5-47cd-ad77-82b979c112c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.439630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c8ca71e5-038d-4e26-afb5-4a56115cd7c6 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.172421 Aug 24 04:54:57.455603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 76/160] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:57 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:57.580889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ab7dcc1c-74e5-47cd-ad77-82b979c112c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:57.588999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ab7dcc1c-74e5-47cd-ad77-82b979c112c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.167610 Aug 24 04:54:57.589573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 85/161] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:57 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:57.605550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4535ba5f-17f2-4a67-80fb-df59a00b8a2a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:57.606158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4535ba5f-17f2-4a67-80fb-df59a00b8a2a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:57.612886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4535ba5f-17f2-4a67-80fb-df59a00b8a2a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.613370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4535ba5f-17f2-4a67-80fb-df59a00b8a2a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.613801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4535ba5f-17f2-4a67-80fb-df59a00b8a2a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.614483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4535ba5f-17f2-4a67-80fb-df59a00b8a2a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.614951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4535ba5f-17f2-4a67-80fb-df59a00b8a2a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.615535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4535ba5f-17f2-4a67-80fb-df59a00b8a2a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.783656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4535ba5f-17f2-4a67-80fb-df59a00b8a2a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:57.792119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4535ba5f-17f2-4a67-80fb-df59a00b8a2a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.190633 Aug 24 04:54:57.792691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 77/162] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:57.849991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2ae7fe16-2371-4554-ab49-05614b344c39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:57.850600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2ae7fe16-2371-4554-ab49-05614b344c39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:57.856777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ae7fe16-2371-4554-ab49-05614b344c39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.857200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ae7fe16-2371-4554-ab49-05614b344c39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.857853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ae7fe16-2371-4554-ab49-05614b344c39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:57.858525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ae7fe16-2371-4554-ab49-05614b344c39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:57.859029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ae7fe16-2371-4554-ab49-05614b344c39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:57.859448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ae7fe16-2371-4554-ab49-05614b344c39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:58.009329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2ae7fe16-2371-4554-ab49-05614b344c39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:58.017975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2ae7fe16-2371-4554-ab49-05614b344c39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.172520 Aug 24 04:54:58.018543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 86/163] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:58.462349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9205bf65-dd7d-459e-a765-6e6fc7bae555 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:58.462987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9205bf65-dd7d-459e-a765-6e6fc7bae555 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:58.468832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9205bf65-dd7d-459e-a765-6e6fc7bae555 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:58.469382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9205bf65-dd7d-459e-a765-6e6fc7bae555 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:58.469896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9205bf65-dd7d-459e-a765-6e6fc7bae555 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:58.470946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9205bf65-dd7d-459e-a765-6e6fc7bae555 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:58.471588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9205bf65-dd7d-459e-a765-6e6fc7bae555 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:58.472009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9205bf65-dd7d-459e-a765-6e6fc7bae555 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:58.609114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-00507e1e-a646-44e7-9dda-31e8b5916a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:58.609720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-00507e1e-a646-44e7-9dda-31e8b5916a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:58.616702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00507e1e-a646-44e7-9dda-31e8b5916a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:58.617192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00507e1e-a646-44e7-9dda-31e8b5916a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:58.617617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00507e1e-a646-44e7-9dda-31e8b5916a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:58.618478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00507e1e-a646-44e7-9dda-31e8b5916a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:58.618964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00507e1e-a646-44e7-9dda-31e8b5916a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:58.619388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00507e1e-a646-44e7-9dda-31e8b5916a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:58.620624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9205bf65-dd7d-459e-a765-6e6fc7bae555 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:58.630323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9205bf65-dd7d-459e-a765-6e6fc7bae555 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.172346 Aug 24 04:54:58.631151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 78/164] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:58 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:58.776309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-00507e1e-a646-44e7-9dda-31e8b5916a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:58.784173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-00507e1e-a646-44e7-9dda-31e8b5916a76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.178805 Aug 24 04:54:58.784908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 87/165] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:58 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:54:58.813475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7afcb6a8-6a04-44d5-8f40-56403f2cc7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:58.814840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7afcb6a8-6a04-44d5-8f40-56403f2cc7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:58.821034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7afcb6a8-6a04-44d5-8f40-56403f2cc7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:58.821517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7afcb6a8-6a04-44d5-8f40-56403f2cc7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:58.821952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7afcb6a8-6a04-44d5-8f40-56403f2cc7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:58.822663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7afcb6a8-6a04-44d5-8f40-56403f2cc7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:58.823134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7afcb6a8-6a04-44d5-8f40-56403f2cc7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:58.823548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7afcb6a8-6a04-44d5-8f40-56403f2cc7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:58.985625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7afcb6a8-6a04-44d5-8f40-56403f2cc7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:58.996068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7afcb6a8-6a04-44d5-8f40-56403f2cc7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.184920 Aug 24 04:54:58.996714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 79/166] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:59.040981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4b28943d-9016-4713-adaf-6592a72cb767 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:59.041679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4b28943d-9016-4713-adaf-6592a72cb767 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:59.048071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b28943d-9016-4713-adaf-6592a72cb767 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:59.049047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b28943d-9016-4713-adaf-6592a72cb767 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:59.049481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b28943d-9016-4713-adaf-6592a72cb767 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:59.050164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b28943d-9016-4713-adaf-6592a72cb767 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:59.050614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b28943d-9016-4713-adaf-6592a72cb767 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:59.051066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b28943d-9016-4713-adaf-6592a72cb767 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:59.185997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4b28943d-9016-4713-adaf-6592a72cb767 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:59.193703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4b28943d-9016-4713-adaf-6592a72cb767 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.157136 Aug 24 04:54:59.194281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 88/167] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:59.652023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-09e63872-554e-431a-b6d0-31a7e5436bd5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:59.652592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-09e63872-554e-431a-b6d0-31a7e5436bd5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:59.659294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e63872-554e-431a-b6d0-31a7e5436bd5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:59.659904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e63872-554e-431a-b6d0-31a7e5436bd5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:59.660334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e63872-554e-431a-b6d0-31a7e5436bd5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:59.661012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e63872-554e-431a-b6d0-31a7e5436bd5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:59.661459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e63872-554e-431a-b6d0-31a7e5436bd5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:59.661877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e63872-554e-431a-b6d0-31a7e5436bd5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:59.807283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-09e63872-554e-431a-b6d0-31a7e5436bd5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:54:59.809952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fc3bb7af-9939-4537-a7c6-f4e38103d3f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:54:59.814492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fc3bb7af-9939-4537-a7c6-f4e38103d3f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:54:59.823558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc3bb7af-9939-4537-a7c6-f4e38103d3f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:59.823974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc3bb7af-9939-4537-a7c6-f4e38103d3f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:59.825872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc3bb7af-9939-4537-a7c6-f4e38103d3f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:54:59.826559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc3bb7af-9939-4537-a7c6-f4e38103d3f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:54:59.827099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-09e63872-554e-431a-b6d0-31a7e5436bd5 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.179001 Aug 24 04:54:59.827834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 80/168] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:59 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:54:59.828432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc3bb7af-9939-4537-a7c6-f4e38103d3f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:54:59.828940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc3bb7af-9939-4537-a7c6-f4e38103d3f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.028452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-56c5bd9b-0175-4c04-84a6-e5162583ad44 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:00.029062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-56c5bd9b-0175-4c04-84a6-e5162583ad44 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:00.044412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56c5bd9b-0175-4c04-84a6-e5162583ad44 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.044901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56c5bd9b-0175-4c04-84a6-e5162583ad44 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.045332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56c5bd9b-0175-4c04-84a6-e5162583ad44 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.046022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56c5bd9b-0175-4c04-84a6-e5162583ad44 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.051422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56c5bd9b-0175-4c04-84a6-e5162583ad44 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.051866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56c5bd9b-0175-4c04-84a6-e5162583ad44 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.180354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fc3bb7af-9939-4537-a7c6-f4e38103d3f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:00.190730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fc3bb7af-9939-4537-a7c6-f4e38103d3f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.388571 Aug 24 04:55:00.193278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 89/169] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:54:59 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:00.220718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d3007a60-8346-40c2-a302-4275d43dcbae tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:00.221745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d3007a60-8346-40c2-a302-4275d43dcbae tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:00.228221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3007a60-8346-40c2-a302-4275d43dcbae tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.229070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3007a60-8346-40c2-a302-4275d43dcbae tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.229557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3007a60-8346-40c2-a302-4275d43dcbae tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.230537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3007a60-8346-40c2-a302-4275d43dcbae tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.231588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3007a60-8346-40c2-a302-4275d43dcbae tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.232008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3007a60-8346-40c2-a302-4275d43dcbae tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.268853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-56c5bd9b-0175-4c04-84a6-e5162583ad44 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:00.276815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-56c5bd9b-0175-4c04-84a6-e5162583ad44 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.252202 Aug 24 04:55:00.277381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 81/170] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:00.374952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d3007a60-8346-40c2-a302-4275d43dcbae tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:00.383003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d3007a60-8346-40c2-a302-4275d43dcbae tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.166939 Aug 24 04:55:00.383568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 90/171] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:00.848906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7396f348-96ad-4574-83df-9af172569809 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:00.849503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7396f348-96ad-4574-83df-9af172569809 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:00.851526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=99 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:00.857207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7396f348-96ad-4574-83df-9af172569809 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.857823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7396f348-96ad-4574-83df-9af172569809 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.858254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7396f348-96ad-4574-83df-9af172569809 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.858986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7396f348-96ad-4574-83df-9af172569809 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:00.859436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7396f348-96ad-4574-83df-9af172569809 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:00.859855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7396f348-96ad-4574-83df-9af172569809 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:00.992860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7396f348-96ad-4574-83df-9af172569809 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:01.000647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7396f348-96ad-4574-83df-9af172569809 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.156157 Aug 24 04:55:01.001211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 82/172] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:00 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:01.213657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fd4c7166-c7ad-4713-a324-76b373c27f24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:01.214624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fd4c7166-c7ad-4713-a324-76b373c27f24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:01.221292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd4c7166-c7ad-4713-a324-76b373c27f24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.221786 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd4c7166-c7ad-4713-a324-76b373c27f24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.222220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd4c7166-c7ad-4713-a324-76b373c27f24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.223406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd4c7166-c7ad-4713-a324-76b373c27f24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.223871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd4c7166-c7ad-4713-a324-76b373c27f24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.224306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd4c7166-c7ad-4713-a324-76b373c27f24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.300719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e8306f69-02cd-43a2-8bf7-61d97815ccd2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:01.301537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e8306f69-02cd-43a2-8bf7-61d97815ccd2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:01.309035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8306f69-02cd-43a2-8bf7-61d97815ccd2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.309524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8306f69-02cd-43a2-8bf7-61d97815ccd2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.309955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8306f69-02cd-43a2-8bf7-61d97815ccd2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.310650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8306f69-02cd-43a2-8bf7-61d97815ccd2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.313450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8306f69-02cd-43a2-8bf7-61d97815ccd2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.314089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8306f69-02cd-43a2-8bf7-61d97815ccd2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.397916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fd4c7166-c7ad-4713-a324-76b373c27f24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:01.397916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fd4c7166-c7ad-4713-a324-76b373c27f24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.187207 Aug 24 04:55:01.397916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 91/173] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:01 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:01.414943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7d1ecb7e-b29d-47c8-81ba-af12617bf9c9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:01.415663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7d1ecb7e-b29d-47c8-81ba-af12617bf9c9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:01.422331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d1ecb7e-b29d-47c8-81ba-af12617bf9c9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.423018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d1ecb7e-b29d-47c8-81ba-af12617bf9c9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.424122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d1ecb7e-b29d-47c8-81ba-af12617bf9c9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.424912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d1ecb7e-b29d-47c8-81ba-af12617bf9c9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:01.425455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d1ecb7e-b29d-47c8-81ba-af12617bf9c9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:01.425962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d1ecb7e-b29d-47c8-81ba-af12617bf9c9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:01.469199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e8306f69-02cd-43a2-8bf7-61d97815ccd2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:01.477681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e8306f69-02cd-43a2-8bf7-61d97815ccd2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.184099 Aug 24 04:55:01.478257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 83/174] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:01.570438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7d1ecb7e-b29d-47c8-81ba-af12617bf9c9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:01.579158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7d1ecb7e-b29d-47c8-81ba-af12617bf9c9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.178477 Aug 24 04:55:01.579753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 92/175] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:02.023200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5f5e8642-2566-4ee4-9ceb-60f7d645d9c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:02.026298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5f5e8642-2566-4ee4-9ceb-60f7d645d9c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:02.034829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f5e8642-2566-4ee4-9ceb-60f7d645d9c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.035461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f5e8642-2566-4ee4-9ceb-60f7d645d9c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.036217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f5e8642-2566-4ee4-9ceb-60f7d645d9c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.037500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f5e8642-2566-4ee4-9ceb-60f7d645d9c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.038454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f5e8642-2566-4ee4-9ceb-60f7d645d9c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.040045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f5e8642-2566-4ee4-9ceb-60f7d645d9c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.086401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-c2ea5b72-6951-4960-aa17-e52108513969 req-a48fb543-32a7-40b6-9f82-e2dbaafd9e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99653dcb-0328-453a-a720-7df80c129db8", "name": "network-vif-plugged", "status": "completed", "tag": "08f84bc6-2ce1-403b-bf50-415ff1e16c87"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:02.107087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-c2ea5b72-6951-4960-aa17-e52108513969 req-a48fb543-32a7-40b6-9f82-e2dbaafd9e4d service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.107761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-c2ea5b72-6951-4960-aa17-e52108513969 req-a48fb543-32a7-40b6-9f82-e2dbaafd9e4d service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.108191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-c2ea5b72-6951-4960-aa17-e52108513969 req-a48fb543-32a7-40b6-9f82-e2dbaafd9e4d service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.128095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-c2ea5b72-6951-4960-aa17-e52108513969 req-a48fb543-32a7-40b6-9f82-e2dbaafd9e4d service nova] Creating event network-vif-plugged:08f84bc6-2ce1-403b-bf50-415ff1e16c87 for instance 99653dcb-0328-453a-a720-7df80c129db8 on hv-cinder-85426 Aug 24 04:55:02.143554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-c2ea5b72-6951-4960-aa17-e52108513969 req-a48fb543-32a7-40b6-9f82-e2dbaafd9e4d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060189 Aug 24 04:55:02.144964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 93/176] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:02.263934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5f5e8642-2566-4ee4-9ceb-60f7d645d9c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:02.273730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5f5e8642-2566-4ee4-9ceb-60f7d645d9c2 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.254872 Aug 24 04:55:02.274305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 84/177] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:02 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:02.424707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e7395423-5771-49e4-bc2d-99d139631b1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:02.425422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e7395423-5771-49e4-bc2d-99d139631b1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:02.436753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7395423-5771-49e4-bc2d-99d139631b1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.437266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7395423-5771-49e4-bc2d-99d139631b1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.437701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7395423-5771-49e4-bc2d-99d139631b1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.438402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7395423-5771-49e4-bc2d-99d139631b1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.438945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7395423-5771-49e4-bc2d-99d139631b1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.439572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7395423-5771-49e4-bc2d-99d139631b1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.499584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-514ba66c-4b31-4449-a998-2d3662f19a59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:02.500189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-514ba66c-4b31-4449-a998-2d3662f19a59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:02.508585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-514ba66c-4b31-4449-a998-2d3662f19a59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.509453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-514ba66c-4b31-4449-a998-2d3662f19a59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.510089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-514ba66c-4b31-4449-a998-2d3662f19a59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.511173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-514ba66c-4b31-4449-a998-2d3662f19a59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.511939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-514ba66c-4b31-4449-a998-2d3662f19a59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.512502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-514ba66c-4b31-4449-a998-2d3662f19a59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.677924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e7395423-5771-49e4-bc2d-99d139631b1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:02.691835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e7395423-5771-49e4-bc2d-99d139631b1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.271181 Aug 24 04:55:02.692442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 94/178] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:02 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:02.700113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ebfa4664-46cd-417a-a5c0-f7c3ad63aacc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:02.701378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ebfa4664-46cd-417a-a5c0-f7c3ad63aacc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:02.707442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:02.709991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa4664-46cd-417a-a5c0-f7c3ad63aacc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.710764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa4664-46cd-417a-a5c0-f7c3ad63aacc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.712130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa4664-46cd-417a-a5c0-f7c3ad63aacc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.713056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa4664-46cd-417a-a5c0-f7c3ad63aacc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:02.713862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa4664-46cd-417a-a5c0-f7c3ad63aacc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:02.714668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa4664-46cd-417a-a5c0-f7c3ad63aacc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:02.737064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-514ba66c-4b31-4449-a998-2d3662f19a59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:02.764552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-514ba66c-4b31-4449-a998-2d3662f19a59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.252977 Aug 24 04:55:02.764552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 85/179] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:02.903090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ebfa4664-46cd-417a-a5c0-f7c3ad63aacc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:02.912097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ebfa4664-46cd-417a-a5c0-f7c3ad63aacc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.216264 Aug 24 04:55:02.912915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 95/180] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:03.295628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a8143e23-d089-4f21-a8b6-545c0ae8515f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:03.296271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a8143e23-d089-4f21-a8b6-545c0ae8515f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:03.302942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8143e23-d089-4f21-a8b6-545c0ae8515f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.303661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8143e23-d089-4f21-a8b6-545c0ae8515f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.304598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8143e23-d089-4f21-a8b6-545c0ae8515f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.306014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8143e23-d089-4f21-a8b6-545c0ae8515f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.306630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8143e23-d089-4f21-a8b6-545c0ae8515f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.307230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8143e23-d089-4f21-a8b6-545c0ae8515f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.463366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a8143e23-d089-4f21-a8b6-545c0ae8515f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:03.470507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a8143e23-d089-4f21-a8b6-545c0ae8515f tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1314 microversion: 2.1 time: 0.179273 Aug 24 04:55:03.471117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 86/181] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:03 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:03.716397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b426ed23-025b-4bd8-a9e0-8d27f2463cfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:03.717041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b426ed23-025b-4bd8-a9e0-8d27f2463cfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:03.728468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b426ed23-025b-4bd8-a9e0-8d27f2463cfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.729275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b426ed23-025b-4bd8-a9e0-8d27f2463cfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.729872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b426ed23-025b-4bd8-a9e0-8d27f2463cfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.730862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b426ed23-025b-4bd8-a9e0-8d27f2463cfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.731518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b426ed23-025b-4bd8-a9e0-8d27f2463cfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.732350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b426ed23-025b-4bd8-a9e0-8d27f2463cfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.780787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9d249b2d-12bd-476a-8a23-218f3dc80533 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:03.781710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9d249b2d-12bd-476a-8a23-218f3dc80533 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:03.804647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d249b2d-12bd-476a-8a23-218f3dc80533 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.806176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d249b2d-12bd-476a-8a23-218f3dc80533 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.806922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d249b2d-12bd-476a-8a23-218f3dc80533 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:03.809684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d249b2d-12bd-476a-8a23-218f3dc80533 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:03.813339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d249b2d-12bd-476a-8a23-218f3dc80533 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:03.814604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d249b2d-12bd-476a-8a23-218f3dc80533 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:04.046076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9d249b2d-12bd-476a-8a23-218f3dc80533 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:04.055722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9d249b2d-12bd-476a-8a23-218f3dc80533 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.281311 Aug 24 04:55:04.056204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 87/182] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:04.061053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-de5638cc-e23c-42e8-9263-b65470f4477b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:04.062566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-de5638cc-e23c-42e8-9263-b65470f4477b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:04.070160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de5638cc-e23c-42e8-9263-b65470f4477b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:04.070925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de5638cc-e23c-42e8-9263-b65470f4477b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:04.071670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de5638cc-e23c-42e8-9263-b65470f4477b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:04.073406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de5638cc-e23c-42e8-9263-b65470f4477b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:04.074020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de5638cc-e23c-42e8-9263-b65470f4477b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:04.074842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de5638cc-e23c-42e8-9263-b65470f4477b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:04.116029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b426ed23-025b-4bd8-a9e0-8d27f2463cfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:04.127239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b426ed23-025b-4bd8-a9e0-8d27f2463cfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.414421 Aug 24 04:55:04.130830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 96/183] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:03 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:04.166012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-c84b1016-e447-45f6-957b-956792c768bb req-018673c0-e063-444b-91a0-5f44aa5540a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0463d0c-9ee3-4f76-91c6-2fcbdfb55053", "name": "network-vif-plugged", "status": "completed", "tag": "6cf34b36-25b7-4379-a2c5-fda35bfb9740"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:04.181858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-c84b1016-e447-45f6-957b-956792c768bb req-018673c0-e063-444b-91a0-5f44aa5540a4 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:04.190887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-c84b1016-e447-45f6-957b-956792c768bb req-018673c0-e063-444b-91a0-5f44aa5540a4 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:04.191571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-c84b1016-e447-45f6-957b-956792c768bb req-018673c0-e063-444b-91a0-5f44aa5540a4 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:04.195939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:04.211957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-c84b1016-e447-45f6-957b-956792c768bb req-018673c0-e063-444b-91a0-5f44aa5540a4 service nova] Creating event network-vif-plugged:6cf34b36-25b7-4379-a2c5-fda35bfb9740 for instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 on hv-cinder-85426 Aug 24 04:55:04.224458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-c84b1016-e447-45f6-957b-956792c768bb req-018673c0-e063-444b-91a0-5f44aa5540a4 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062034 Aug 24 04:55:04.227836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 97/184] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:04.475221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-de5638cc-e23c-42e8-9263-b65470f4477b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:04.479211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:04.492569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6db113f8-f139-42d6-ac36-02a93e4a42df tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:04.493522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6db113f8-f139-42d6-ac36-02a93e4a42df tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:04.503433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db113f8-f139-42d6-ac36-02a93e4a42df tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:04.504211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-de5638cc-e23c-42e8-9263-b65470f4477b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.429431 Aug 24 04:55:04.508013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 88/185] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:04.508980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db113f8-f139-42d6-ac36-02a93e4a42df tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:04.509621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db113f8-f139-42d6-ac36-02a93e4a42df tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:04.510560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db113f8-f139-42d6-ac36-02a93e4a42df tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:04.522459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db113f8-f139-42d6-ac36-02a93e4a42df tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:04.523100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db113f8-f139-42d6-ac36-02a93e4a42df tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:04.762809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6db113f8-f139-42d6-ac36-02a93e4a42df tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:04.775879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6db113f8-f139-42d6-ac36-02a93e4a42df tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1502 microversion: 2.1 time: 0.284051 Aug 24 04:55:04.776525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 98/186] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:04 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1502 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:05.080955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-765e4ca9-892d-49e5-b16f-adfb6071e8ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:05.081863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-765e4ca9-892d-49e5-b16f-adfb6071e8ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:05.091301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-765e4ca9-892d-49e5-b16f-adfb6071e8ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.091797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-765e4ca9-892d-49e5-b16f-adfb6071e8ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.092321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-765e4ca9-892d-49e5-b16f-adfb6071e8ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.093197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-765e4ca9-892d-49e5-b16f-adfb6071e8ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.096018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-765e4ca9-892d-49e5-b16f-adfb6071e8ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.096673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-765e4ca9-892d-49e5-b16f-adfb6071e8ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.161908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-09e35212-9023-45b8-b590-7a02ac117ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:05.162846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-09e35212-9023-45b8-b590-7a02ac117ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:05.171061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e35212-9023-45b8-b590-7a02ac117ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.171791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e35212-9023-45b8-b590-7a02ac117ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.172414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e35212-9023-45b8-b590-7a02ac117ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.173619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e35212-9023-45b8-b590-7a02ac117ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.174258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e35212-9023-45b8-b590-7a02ac117ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.174890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e35212-9023-45b8-b590-7a02ac117ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.404481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-765e4ca9-892d-49e5-b16f-adfb6071e8ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:05.431603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-765e4ca9-892d-49e5-b16f-adfb6071e8ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.356407 Aug 24 04:55:05.432757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 89/187] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:05.436652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-09e35212-9023-45b8-b590-7a02ac117ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:05.445987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-09e35212-9023-45b8-b590-7a02ac117ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.289177 Aug 24 04:55:05.446835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 99/188] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:05 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:05.528739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b27a7695-bcb4-4d19-9487-75ab4edcb05b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:05.529352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b27a7695-bcb4-4d19-9487-75ab4edcb05b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:05.536121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b27a7695-bcb4-4d19-9487-75ab4edcb05b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.536611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b27a7695-bcb4-4d19-9487-75ab4edcb05b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.537040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b27a7695-bcb4-4d19-9487-75ab4edcb05b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.537766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b27a7695-bcb4-4d19-9487-75ab4edcb05b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:05.538175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b27a7695-bcb4-4d19-9487-75ab4edcb05b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:05.538775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b27a7695-bcb4-4d19-9487-75ab4edcb05b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:05.727467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b27a7695-bcb4-4d19-9487-75ab4edcb05b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:05.745433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b27a7695-bcb4-4d19-9487-75ab4edcb05b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.219492 Aug 24 04:55:05.758789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 90/189] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:06.467517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6d318973-69c5-4009-9386-478e56ee64aa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:06.468391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6d318973-69c5-4009-9386-478e56ee64aa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:06.473710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cf35cc70-81f4-4ddf-9caa-ba293e48d836 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:06.474456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cf35cc70-81f4-4ddf-9caa-ba293e48d836 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:06.477282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d318973-69c5-4009-9386-478e56ee64aa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.477980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d318973-69c5-4009-9386-478e56ee64aa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.478646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d318973-69c5-4009-9386-478e56ee64aa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.479609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d318973-69c5-4009-9386-478e56ee64aa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.480173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d318973-69c5-4009-9386-478e56ee64aa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.480696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d318973-69c5-4009-9386-478e56ee64aa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.481605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf35cc70-81f4-4ddf-9caa-ba293e48d836 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.482100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf35cc70-81f4-4ddf-9caa-ba293e48d836 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.482537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf35cc70-81f4-4ddf-9caa-ba293e48d836 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.483320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf35cc70-81f4-4ddf-9caa-ba293e48d836 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.483919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf35cc70-81f4-4ddf-9caa-ba293e48d836 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.484337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf35cc70-81f4-4ddf-9caa-ba293e48d836 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.664844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6d318973-69c5-4009-9386-478e56ee64aa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:06.674669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6d318973-69c5-4009-9386-478e56ee64aa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.210383 Aug 24 04:55:06.675346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 91/190] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:06 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:06.680054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cf35cc70-81f4-4ddf-9caa-ba293e48d836 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:06.691618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cf35cc70-81f4-4ddf-9caa-ba293e48d836 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.235516 Aug 24 04:55:06.692646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 100/191] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:06.709423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-94be50b7-63fa-477a-aba4-1bbac750541e tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "114ba5fe-03d1-43af-a99d-7fa584432253"}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:06.712306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-94be50b7-63fa-477a-aba4-1bbac750541e tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:06.721814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94be50b7-63fa-477a-aba4-1bbac750541e tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.722301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94be50b7-63fa-477a-aba4-1bbac750541e tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.722866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94be50b7-63fa-477a-aba4-1bbac750541e tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.723425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94be50b7-63fa-477a-aba4-1bbac750541e tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.723863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94be50b7-63fa-477a-aba4-1bbac750541e tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.724496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94be50b7-63fa-477a-aba4-1bbac750541e tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.768772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-29b8eb83-65fb-4a4f-a442-930351aa29ac tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:06.769377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-29b8eb83-65fb-4a4f-a442-930351aa29ac tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:06.779681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29b8eb83-65fb-4a4f-a442-930351aa29ac tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.780174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29b8eb83-65fb-4a4f-a442-930351aa29ac tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.780610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29b8eb83-65fb-4a4f-a442-930351aa29ac tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.781308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29b8eb83-65fb-4a4f-a442-930351aa29ac tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:06.784329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29b8eb83-65fb-4a4f-a442-930351aa29ac tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:06.785954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29b8eb83-65fb-4a4f-a442-930351aa29ac tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:06.963031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-29b8eb83-65fb-4a4f-a442-930351aa29ac tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:06.975975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-29b8eb83-65fb-4a4f-a442-930351aa29ac tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.211447 Aug 24 04:55:06.976592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 101/192] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:07.696647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-088bc0fd-6876-451d-bf41-e1ca2cc3da06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:07.697341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-088bc0fd-6876-451d-bf41-e1ca2cc3da06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:07.703407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-088bc0fd-6876-451d-bf41-e1ca2cc3da06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.703890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-088bc0fd-6876-451d-bf41-e1ca2cc3da06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.705156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-088bc0fd-6876-451d-bf41-e1ca2cc3da06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.705852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-088bc0fd-6876-451d-bf41-e1ca2cc3da06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.706305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-088bc0fd-6876-451d-bf41-e1ca2cc3da06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.708123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-088bc0fd-6876-451d-bf41-e1ca2cc3da06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.873602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-088bc0fd-6876-451d-bf41-e1ca2cc3da06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:07.882931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-088bc0fd-6876-451d-bf41-e1ca2cc3da06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.189886 Aug 24 04:55:07.883646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 102/193] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:07 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:07.888800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b7faac91-8944-4b57-a840-5d3fa0ca4777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:07.889610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b7faac91-8944-4b57-a840-5d3fa0ca4777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:07.898011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7faac91-8944-4b57-a840-5d3fa0ca4777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.899075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7faac91-8944-4b57-a840-5d3fa0ca4777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.899894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7faac91-8944-4b57-a840-5d3fa0ca4777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:07.900913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7faac91-8944-4b57-a840-5d3fa0ca4777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:07.901833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7faac91-8944-4b57-a840-5d3fa0ca4777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:07.903064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7faac91-8944-4b57-a840-5d3fa0ca4777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:08.053355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b7faac91-8944-4b57-a840-5d3fa0ca4777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:08.064823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b7faac91-8944-4b57-a840-5d3fa0ca4777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.179771 Aug 24 04:55:08.065991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 103/194] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:08.071212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-55de77bf-17e7-4021-8d58-581a5758204f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:08.073164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-55de77bf-17e7-4021-8d58-581a5758204f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:08.094535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55de77bf-17e7-4021-8d58-581a5758204f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:08.095688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55de77bf-17e7-4021-8d58-581a5758204f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:08.096214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55de77bf-17e7-4021-8d58-581a5758204f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:08.096944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55de77bf-17e7-4021-8d58-581a5758204f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:08.097402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55de77bf-17e7-4021-8d58-581a5758204f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:08.097847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55de77bf-17e7-4021-8d58-581a5758204f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:08.251729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-55de77bf-17e7-4021-8d58-581a5758204f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:08.265032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-55de77bf-17e7-4021-8d58-581a5758204f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.197220 Aug 24 04:55:08.265759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 104/195] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:08.903572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d9f01a48-d34a-42ec-8f1b-f946fb5147f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:08.904263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d9f01a48-d34a-42ec-8f1b-f946fb5147f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:08.911282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9f01a48-d34a-42ec-8f1b-f946fb5147f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:08.911764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9f01a48-d34a-42ec-8f1b-f946fb5147f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:08.912285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9f01a48-d34a-42ec-8f1b-f946fb5147f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:08.912890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9f01a48-d34a-42ec-8f1b-f946fb5147f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:08.913394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9f01a48-d34a-42ec-8f1b-f946fb5147f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:08.913815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9f01a48-d34a-42ec-8f1b-f946fb5147f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:09.049780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d9f01a48-d34a-42ec-8f1b-f946fb5147f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:09.057315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d9f01a48-d34a-42ec-8f1b-f946fb5147f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.157692 Aug 24 04:55:09.057878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 105/196] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:08 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:09.086255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-31ea3d18-c4ce-40d5-9f4d-8e0c208488f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:09.086891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-31ea3d18-c4ce-40d5-9f4d-8e0c208488f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:09.092952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ea3d18-c4ce-40d5-9f4d-8e0c208488f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:09.093421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ea3d18-c4ce-40d5-9f4d-8e0c208488f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:09.093848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ea3d18-c4ce-40d5-9f4d-8e0c208488f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:09.094521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ea3d18-c4ce-40d5-9f4d-8e0c208488f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:09.095604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ea3d18-c4ce-40d5-9f4d-8e0c208488f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:09.096017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ea3d18-c4ce-40d5-9f4d-8e0c208488f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:09.228833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-31ea3d18-c4ce-40d5-9f4d-8e0c208488f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:09.237127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-31ea3d18-c4ce-40d5-9f4d-8e0c208488f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.154725 Aug 24 04:55:09.237685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 106/197] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:09.289375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0c6f9002-8127-42e9-a50a-586cc1b738f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:09.289900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0c6f9002-8127-42e9-a50a-586cc1b738f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:09.295990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c6f9002-8127-42e9-a50a-586cc1b738f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:09.296459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c6f9002-8127-42e9-a50a-586cc1b738f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:09.296885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c6f9002-8127-42e9-a50a-586cc1b738f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:09.297552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c6f9002-8127-42e9-a50a-586cc1b738f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:09.298117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c6f9002-8127-42e9-a50a-586cc1b738f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:09.298678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c6f9002-8127-42e9-a50a-586cc1b738f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:09.436264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0c6f9002-8127-42e9-a50a-586cc1b738f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:09.444587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0c6f9002-8127-42e9-a50a-586cc1b738f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.159034 Aug 24 04:55:09.445145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 107/198] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:10.082395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4ee6d875-7ce9-457d-b13f-be365b0ad572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:10.083890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4ee6d875-7ce9-457d-b13f-be365b0ad572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:10.094513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ee6d875-7ce9-457d-b13f-be365b0ad572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:10.096175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ee6d875-7ce9-457d-b13f-be365b0ad572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:10.097774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ee6d875-7ce9-457d-b13f-be365b0ad572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:10.098778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ee6d875-7ce9-457d-b13f-be365b0ad572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:10.099381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ee6d875-7ce9-457d-b13f-be365b0ad572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:10.100029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ee6d875-7ce9-457d-b13f-be365b0ad572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:10.271460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4ee6d875-7ce9-457d-b13f-be365b0ad572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:10.280238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4ee6d875-7ce9-457d-b13f-be365b0ad572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1322 microversion: 2.1 time: 0.205685 Aug 24 04:55:10.280817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 108/199] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:10 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:10.286475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3f1515e1-a165-4a24-bec4-8b9ab91dbf97 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:10.287951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3f1515e1-a165-4a24-bec4-8b9ab91dbf97 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:10.294703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f1515e1-a165-4a24-bec4-8b9ab91dbf97 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:10.295597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f1515e1-a165-4a24-bec4-8b9ab91dbf97 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:10.296027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f1515e1-a165-4a24-bec4-8b9ab91dbf97 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:10.296872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f1515e1-a165-4a24-bec4-8b9ab91dbf97 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:10.297388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f1515e1-a165-4a24-bec4-8b9ab91dbf97 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:10.298752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f1515e1-a165-4a24-bec4-8b9ab91dbf97 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:10.443009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3f1515e1-a165-4a24-bec4-8b9ab91dbf97 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:10.450956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3f1515e1-a165-4a24-bec4-8b9ab91dbf97 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.169108 Aug 24 04:55:10.451919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 109/200] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:10.465506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e8a06bfb-c342-4255-90f8-32bdadad725a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:10.466485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e8a06bfb-c342-4255-90f8-32bdadad725a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:10.475114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8a06bfb-c342-4255-90f8-32bdadad725a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:10.475782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8a06bfb-c342-4255-90f8-32bdadad725a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:10.476529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8a06bfb-c342-4255-90f8-32bdadad725a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:10.477335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8a06bfb-c342-4255-90f8-32bdadad725a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:10.478094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8a06bfb-c342-4255-90f8-32bdadad725a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:10.478715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8a06bfb-c342-4255-90f8-32bdadad725a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:10.647072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e8a06bfb-c342-4255-90f8-32bdadad725a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:10.656222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e8a06bfb-c342-4255-90f8-32bdadad725a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.194382 Aug 24 04:55:10.656994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 110/201] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:11.301814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d6639a74-1f54-4c7d-83da-3460f76ee96e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:11.302568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d6639a74-1f54-4c7d-83da-3460f76ee96e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:11.309080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d6639a74-1f54-4c7d-83da-3460f76ee96e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.309559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d6639a74-1f54-4c7d-83da-3460f76ee96e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.309985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d6639a74-1f54-4c7d-83da-3460f76ee96e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:11.310670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d6639a74-1f54-4c7d-83da-3460f76ee96e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.311144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d6639a74-1f54-4c7d-83da-3460f76ee96e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.311558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d6639a74-1f54-4c7d-83da-3460f76ee96e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:11.464241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d6639a74-1f54-4c7d-83da-3460f76ee96e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:11.474771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d6639a74-1f54-4c7d-83da-3460f76ee96e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1516 microversion: 2.1 time: 0.177152 Aug 24 04:55:11.475451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 111/202] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:11 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:11.480672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f216cccd-4f00-4f59-9405-f6924a130ac6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:11.481307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f216cccd-4f00-4f59-9405-f6924a130ac6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:11.487342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f216cccd-4f00-4f59-9405-f6924a130ac6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.487853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f216cccd-4f00-4f59-9405-f6924a130ac6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.488266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f216cccd-4f00-4f59-9405-f6924a130ac6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:11.488949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f216cccd-4f00-4f59-9405-f6924a130ac6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.489394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f216cccd-4f00-4f59-9405-f6924a130ac6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.489808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f216cccd-4f00-4f59-9405-f6924a130ac6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:11.637565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f216cccd-4f00-4f59-9405-f6924a130ac6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:11.648326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f216cccd-4f00-4f59-9405-f6924a130ac6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.171321 Aug 24 04:55:11.649021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 112/203] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:11.654210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a54a9bc7-90aa-478b-a752-1ca610eef53d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:11.656515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a54a9bc7-90aa-478b-a752-1ca610eef53d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:11.666678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a54a9bc7-90aa-478b-a752-1ca610eef53d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.667267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a54a9bc7-90aa-478b-a752-1ca610eef53d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.667512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a54a9bc7-90aa-478b-a752-1ca610eef53d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:11.668218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a54a9bc7-90aa-478b-a752-1ca610eef53d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.668930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a54a9bc7-90aa-478b-a752-1ca610eef53d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.669344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a54a9bc7-90aa-478b-a752-1ca610eef53d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:11.751330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-a54a9bc7-90aa-478b-a752-1ca610eef53d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lazy-loading 'flavor' on Instance uuid 99653dcb-0328-453a-a720-7df80c129db8 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:55:11.835615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:11.903850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a54a9bc7-90aa-478b-a752-1ca610eef53d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8/action" status: 200 len: 32 microversion: 2.1 time: 0.253721 Aug 24 04:55:11.904579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 113/204] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 04:55:11 2022] POST /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8/action => generated 32 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:55:11.911094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-930f1a5f-f958-4583-9839-8d749837f016 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:11.911903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-930f1a5f-f958-4583-9839-8d749837f016 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:11.927384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930f1a5f-f958-4583-9839-8d749837f016 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.927953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930f1a5f-f958-4583-9839-8d749837f016 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.928383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930f1a5f-f958-4583-9839-8d749837f016 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:11.929072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930f1a5f-f958-4583-9839-8d749837f016 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:11.929514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930f1a5f-f958-4583-9839-8d749837f016 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:11.929923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930f1a5f-f958-4583-9839-8d749837f016 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.160818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-930f1a5f-f958-4583-9839-8d749837f016 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:12.186099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-930f1a5f-f958-4583-9839-8d749837f016 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.280369 Aug 24 04:55:12.208411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 114/205] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:12.221912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-40df85c8-1fc3-440f-acd1-33087f66417f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:12.232907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-40df85c8-1fc3-440f-acd1-33087f66417f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:12.258064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40df85c8-1fc3-440f-acd1-33087f66417f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.258552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40df85c8-1fc3-440f-acd1-33087f66417f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.259009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40df85c8-1fc3-440f-acd1-33087f66417f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.259803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40df85c8-1fc3-440f-acd1-33087f66417f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.260336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40df85c8-1fc3-440f-acd1-33087f66417f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.260870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40df85c8-1fc3-440f-acd1-33087f66417f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.477990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-94be50b7-63fa-477a-aba4-1bbac750541e tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "POST /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.785546 Aug 24 04:55:12.483911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 92/206] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 04:55:06 2022] POST /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444/os-volume_attachments => generated 194 bytes in 5803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:12.490581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-cdc4085f-b6b0-4d23-9fea-cdd259acf604 req-e7e5d571-8d3a-43f4-863c-c0eb337692a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598c5040-751c-4914-906d-031f0abe36aa", "name": "network-vif-plugged", "status": "completed", "tag": "bdbf7cbc-ecbc-4cba-98a8-1e7f94e21fbc"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:12.499495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-40df85c8-1fc3-440f-acd1-33087f66417f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:12.505941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-cdc4085f-b6b0-4d23-9fea-cdd259acf604 req-e7e5d571-8d3a-43f4-863c-c0eb337692a6 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.507517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-cdc4085f-b6b0-4d23-9fea-cdd259acf604 req-e7e5d571-8d3a-43f4-863c-c0eb337692a6 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.507517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-cdc4085f-b6b0-4d23-9fea-cdd259acf604 req-e7e5d571-8d3a-43f4-863c-c0eb337692a6 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.510854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-40df85c8-1fc3-440f-acd1-33087f66417f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.301330 Aug 24 04:55:12.511695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 115/207] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:12 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:12.531510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-cdc4085f-b6b0-4d23-9fea-cdd259acf604 req-e7e5d571-8d3a-43f4-863c-c0eb337692a6 service nova] Creating event network-vif-plugged:bdbf7cbc-ecbc-4cba-98a8-1e7f94e21fbc for instance 598c5040-751c-4914-906d-031f0abe36aa on hv-cinder-85426 Aug 24 04:55:12.539589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-cdc4085f-b6b0-4d23-9fea-cdd259acf604 req-e7e5d571-8d3a-43f4-863c-c0eb337692a6 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053939 Aug 24 04:55:12.540615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 93/208] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:12.668888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a5bfc5d8-9d91-4737-bb0d-4a2093e48f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:12.669500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a5bfc5d8-9d91-4737-bb0d-4a2093e48f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:12.676727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5bfc5d8-9d91-4737-bb0d-4a2093e48f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.677221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5bfc5d8-9d91-4737-bb0d-4a2093e48f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.677657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5bfc5d8-9d91-4737-bb0d-4a2093e48f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.678353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5bfc5d8-9d91-4737-bb0d-4a2093e48f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:12.678832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5bfc5d8-9d91-4737-bb0d-4a2093e48f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:12.679359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5bfc5d8-9d91-4737-bb0d-4a2093e48f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:12.921468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a5bfc5d8-9d91-4737-bb0d-4a2093e48f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:12.930372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a5bfc5d8-9d91-4737-bb0d-4a2093e48f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.265536 Aug 24 04:55:12.931063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 116/209] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:13.217393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ca5b9f08-59e4-442d-9f1f-b1e410a9f371 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:13.218152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ca5b9f08-59e4-442d-9f1f-b1e410a9f371 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:13.225711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5b9f08-59e4-442d-9f1f-b1e410a9f371 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:13.226197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5b9f08-59e4-442d-9f1f-b1e410a9f371 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:13.226627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5b9f08-59e4-442d-9f1f-b1e410a9f371 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:13.227369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5b9f08-59e4-442d-9f1f-b1e410a9f371 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:13.227814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5b9f08-59e4-442d-9f1f-b1e410a9f371 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:13.228231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5b9f08-59e4-442d-9f1f-b1e410a9f371 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:13.364132 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ca5b9f08-59e4-442d-9f1f-b1e410a9f371 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:13.375605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ca5b9f08-59e4-442d-9f1f-b1e410a9f371 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.163903 Aug 24 04:55:13.376176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 94/210] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:13.533570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b77fcdf0-ecef-4205-b381-dc80a01b8d60 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:13.534266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b77fcdf0-ecef-4205-b381-dc80a01b8d60 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:13.549398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77fcdf0-ecef-4205-b381-dc80a01b8d60 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:13.549889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77fcdf0-ecef-4205-b381-dc80a01b8d60 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:13.550373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77fcdf0-ecef-4205-b381-dc80a01b8d60 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:13.551219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77fcdf0-ecef-4205-b381-dc80a01b8d60 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:13.551754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77fcdf0-ecef-4205-b381-dc80a01b8d60 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:13.552183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77fcdf0-ecef-4205-b381-dc80a01b8d60 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:13.706824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b77fcdf0-ecef-4205-b381-dc80a01b8d60 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:13.715738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b77fcdf0-ecef-4205-b381-dc80a01b8d60 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.187307 Aug 24 04:55:13.716361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 117/211] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:13 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:13.964920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-32195512-7f09-4653-b6db-bb8986544c12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:13.965527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-32195512-7f09-4653-b6db-bb8986544c12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:13.973199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32195512-7f09-4653-b6db-bb8986544c12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:13.973679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32195512-7f09-4653-b6db-bb8986544c12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:13.974103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32195512-7f09-4653-b6db-bb8986544c12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:13.975057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32195512-7f09-4653-b6db-bb8986544c12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:13.975445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32195512-7f09-4653-b6db-bb8986544c12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:13.976009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32195512-7f09-4653-b6db-bb8986544c12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:14.121171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-32195512-7f09-4653-b6db-bb8986544c12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:14.129605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-32195512-7f09-4653-b6db-bb8986544c12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1367 microversion: 2.1 time: 0.182688 Aug 24 04:55:14.130201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 95/212] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:14.395785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-132a70b9-effc-4354-8202-8eae9ab88dd1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:14.396386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-132a70b9-effc-4354-8202-8eae9ab88dd1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:14.402974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a70b9-effc-4354-8202-8eae9ab88dd1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:14.403465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a70b9-effc-4354-8202-8eae9ab88dd1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:14.403900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a70b9-effc-4354-8202-8eae9ab88dd1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:14.404594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a70b9-effc-4354-8202-8eae9ab88dd1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:14.405045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a70b9-effc-4354-8202-8eae9ab88dd1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:14.405480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a70b9-effc-4354-8202-8eae9ab88dd1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:14.545522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-132a70b9-effc-4354-8202-8eae9ab88dd1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:14.555633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-132a70b9-effc-4354-8202-8eae9ab88dd1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.163762 Aug 24 04:55:14.570183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 118/213] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:14.743880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-31f56a79-9d56-4c02-a057-2686c16fafca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:14.744777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-31f56a79-9d56-4c02-a057-2686c16fafca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:14.762237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f56a79-9d56-4c02-a057-2686c16fafca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:14.762780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f56a79-9d56-4c02-a057-2686c16fafca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:14.763231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f56a79-9d56-4c02-a057-2686c16fafca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:14.763947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f56a79-9d56-4c02-a057-2686c16fafca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:14.764405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f56a79-9d56-4c02-a057-2686c16fafca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:14.765441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f56a79-9d56-4c02-a057-2686c16fafca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:14.934402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-31f56a79-9d56-4c02-a057-2686c16fafca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:14.944279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-31f56a79-9d56-4c02-a057-2686c16fafca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.205358 Aug 24 04:55:14.945404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 96/214] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:14 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:15.152175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ceacbf6b-ae2b-42d8-9724-a40a28b402f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:15.153146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ceacbf6b-ae2b-42d8-9724-a40a28b402f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:15.160796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ceacbf6b-ae2b-42d8-9724-a40a28b402f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.161560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ceacbf6b-ae2b-42d8-9724-a40a28b402f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.162060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ceacbf6b-ae2b-42d8-9724-a40a28b402f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.162995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ceacbf6b-ae2b-42d8-9724-a40a28b402f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.163660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ceacbf6b-ae2b-42d8-9724-a40a28b402f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.164158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ceacbf6b-ae2b-42d8-9724-a40a28b402f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.446103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ceacbf6b-ae2b-42d8-9724-a40a28b402f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:15.457070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ceacbf6b-ae2b-42d8-9724-a40a28b402f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1555 microversion: 2.1 time: 0.309292 Aug 24 04:55:15.458605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 119/215] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1555 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:15.481356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3b9f6f63-1792-465d-86cf-63b056d51709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:15.483359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3b9f6f63-1792-465d-86cf-63b056d51709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:15.490853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b9f6f63-1792-465d-86cf-63b056d51709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.491333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b9f6f63-1792-465d-86cf-63b056d51709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.491768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b9f6f63-1792-465d-86cf-63b056d51709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.492662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b9f6f63-1792-465d-86cf-63b056d51709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.493259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b9f6f63-1792-465d-86cf-63b056d51709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.493829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b9f6f63-1792-465d-86cf-63b056d51709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.576943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-274479de-2ee6-4752-b9de-8af0be3fbed0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:15.577546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-274479de-2ee6-4752-b9de-8af0be3fbed0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:15.583638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-274479de-2ee6-4752-b9de-8af0be3fbed0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.584118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-274479de-2ee6-4752-b9de-8af0be3fbed0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.584555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-274479de-2ee6-4752-b9de-8af0be3fbed0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.585242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-274479de-2ee6-4752-b9de-8af0be3fbed0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.585925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-274479de-2ee6-4752-b9de-8af0be3fbed0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.586394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-274479de-2ee6-4752-b9de-8af0be3fbed0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.620540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3b9f6f63-1792-465d-86cf-63b056d51709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143869 Aug 24 04:55:15.621140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 97/216] 10.222.0.97 () {58 vars in 1275 bytes} [Wed Aug 24 04:55:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:55:15.965857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e5fd53c6-be55-4d00-b7de-a73d87a5882c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:15.966569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e5fd53c6-be55-4d00-b7de-a73d87a5882c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:15.988833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5fd53c6-be55-4d00-b7de-a73d87a5882c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.993920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5fd53c6-be55-4d00-b7de-a73d87a5882c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.994730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5fd53c6-be55-4d00-b7de-a73d87a5882c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:15.995696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5fd53c6-be55-4d00-b7de-a73d87a5882c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:15.998243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5fd53c6-be55-4d00-b7de-a73d87a5882c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:15.998990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5fd53c6-be55-4d00-b7de-a73d87a5882c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:16.256145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e5fd53c6-be55-4d00-b7de-a73d87a5882c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:16.265895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e5fd53c6-be55-4d00-b7de-a73d87a5882c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.304527 Aug 24 04:55:16.267125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 98/217] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:15 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:16.325537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-274479de-2ee6-4752-b9de-8af0be3fbed0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:16.333418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-274479de-2ee6-4752-b9de-8af0be3fbed0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1363 microversion: 2.1 time: 0.760673 Aug 24 04:55:16.334084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 120/218] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1363 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:17.288095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-54b29673-eb18-4bdc-bdbe-b05b1714bdb2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:17.288994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-54b29673-eb18-4bdc-bdbe-b05b1714bdb2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:17.295804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-54b29673-eb18-4bdc-bdbe-b05b1714bdb2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.296276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-54b29673-eb18-4bdc-bdbe-b05b1714bdb2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.297040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-54b29673-eb18-4bdc-bdbe-b05b1714bdb2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:17.298529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-54b29673-eb18-4bdc-bdbe-b05b1714bdb2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.299023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-54b29673-eb18-4bdc-bdbe-b05b1714bdb2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.299441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-54b29673-eb18-4bdc-bdbe-b05b1714bdb2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:17.370279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b861af6d-2b69-40c1-8e59-130e849288f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:17.378795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b861af6d-2b69-40c1-8e59-130e849288f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:17.398661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b861af6d-2b69-40c1-8e59-130e849288f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.399408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b861af6d-2b69-40c1-8e59-130e849288f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.400199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b861af6d-2b69-40c1-8e59-130e849288f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:17.401125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b861af6d-2b69-40c1-8e59-130e849288f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.401766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b861af6d-2b69-40c1-8e59-130e849288f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.402563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b861af6d-2b69-40c1-8e59-130e849288f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:17.555911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-54b29673-eb18-4bdc-bdbe-b05b1714bdb2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:17.575051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-54b29673-eb18-4bdc-bdbe-b05b1714bdb2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.290376 Aug 24 04:55:17.575843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 99/219] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:17 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:17.581506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-f8a41ef2-f0eb-4787-80bc-6084d26a6147 req-c5ea464b-cff8-49b3-bce9-c1efcbc09ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0463d0c-9ee3-4f76-91c6-2fcbdfb55053", "tag": "6cf34b36-25b7-4379-a2c5-fda35bfb9740"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:17.591959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-f8a41ef2-f0eb-4787-80bc-6084d26a6147 req-c5ea464b-cff8-49b3-bce9-c1efcbc09ef6 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.592636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-f8a41ef2-f0eb-4787-80bc-6084d26a6147 req-c5ea464b-cff8-49b3-bce9-c1efcbc09ef6 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-f8a41ef2-f0eb-4787-80bc-6084d26a6147 req-c5ea464b-cff8-49b3-bce9-c1efcbc09ef6 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:17.609022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-f8a41ef2-f0eb-4787-80bc-6084d26a6147 req-c5ea464b-cff8-49b3-bce9-c1efcbc09ef6 service nova] Creating event network-changed:6cf34b36-25b7-4379-a2c5-fda35bfb9740 for instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 on hv-cinder-85426 Aug 24 04:55:17.615981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-f8a41ef2-f0eb-4787-80bc-6084d26a6147 req-c5ea464b-cff8-49b3-bce9-c1efcbc09ef6 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038626 Aug 24 04:55:17.618118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 100/220] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:17.644217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b861af6d-2b69-40c1-8e59-130e849288f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:17.653421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b861af6d-2b69-40c1-8e59-130e849288f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1548 microversion: 2.1 time: 0.291875 Aug 24 04:55:17.654187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 121/221] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1548 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:17.682270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bcc650f6-4db9-42fe-8b5d-be2e8873baa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:17.683370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bcc650f6-4db9-42fe-8b5d-be2e8873baa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:17.696871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcc650f6-4db9-42fe-8b5d-be2e8873baa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.698157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcc650f6-4db9-42fe-8b5d-be2e8873baa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.699112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcc650f6-4db9-42fe-8b5d-be2e8873baa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:17.704554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcc650f6-4db9-42fe-8b5d-be2e8873baa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:17.706298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcc650f6-4db9-42fe-8b5d-be2e8873baa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:17.706751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcc650f6-4db9-42fe-8b5d-be2e8873baa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:18.195334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bcc650f6-4db9-42fe-8b5d-be2e8873baa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.518728 Aug 24 04:55:18.206478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 101/222] 10.222.0.97 () {58 vars in 1275 bytes} [Wed Aug 24 04:55:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-interface => generated 284 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:18.597272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-deea7259-d4ae-46d7-980b-cf7f6abe0176 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:18.598909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-deea7259-d4ae-46d7-980b-cf7f6abe0176 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:18.606088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-deea7259-d4ae-46d7-980b-cf7f6abe0176 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:18.606893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-deea7259-d4ae-46d7-980b-cf7f6abe0176 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:18.607575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-deea7259-d4ae-46d7-980b-cf7f6abe0176 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:18.608900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-deea7259-d4ae-46d7-980b-cf7f6abe0176 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:18.609703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-deea7259-d4ae-46d7-980b-cf7f6abe0176 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:18.611551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-deea7259-d4ae-46d7-980b-cf7f6abe0176 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:18.781431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-deea7259-d4ae-46d7-980b-cf7f6abe0176 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:18.799788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-deea7259-d4ae-46d7-980b-cf7f6abe0176 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.207085 Aug 24 04:55:18.800374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 122/223] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:18 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:19.826638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-429a1ba1-ba4f-4162-837a-a3faafc8aa0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:19.827288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-429a1ba1-ba4f-4162-837a-a3faafc8aa0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:19.838987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-429a1ba1-ba4f-4162-837a-a3faafc8aa0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:19.842074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-429a1ba1-ba4f-4162-837a-a3faafc8aa0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:19.843068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-429a1ba1-ba4f-4162-837a-a3faafc8aa0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:19.843957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-429a1ba1-ba4f-4162-837a-a3faafc8aa0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:19.847400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-429a1ba1-ba4f-4162-837a-a3faafc8aa0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:19.848058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-429a1ba1-ba4f-4162-837a-a3faafc8aa0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:20.089670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-429a1ba1-ba4f-4162-837a-a3faafc8aa0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:20.099627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-429a1ba1-ba4f-4162-837a-a3faafc8aa0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.282936 Aug 24 04:55:20.100300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 102/224] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:19 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:20.255342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-f80ede42-134f-431f-8af9-af7933d0d9a2 req-8e081b8a-e0b9-4935-808c-928c25bf795a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598c5040-751c-4914-906d-031f0abe36aa", "tag": "bdbf7cbc-ecbc-4cba-98a8-1e7f94e21fbc"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:20.264850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f80ede42-134f-431f-8af9-af7933d0d9a2 req-8e081b8a-e0b9-4935-808c-928c25bf795a service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:20.265378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f80ede42-134f-431f-8af9-af7933d0d9a2 req-8e081b8a-e0b9-4935-808c-928c25bf795a service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:20.265804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f80ede42-134f-431f-8af9-af7933d0d9a2 req-8e081b8a-e0b9-4935-808c-928c25bf795a service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:20.277482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-f80ede42-134f-431f-8af9-af7933d0d9a2 req-8e081b8a-e0b9-4935-808c-928c25bf795a service nova] Creating event network-changed:bdbf7cbc-ecbc-4cba-98a8-1e7f94e21fbc for instance 598c5040-751c-4914-906d-031f0abe36aa on hv-cinder-85426 Aug 24 04:55:20.283709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-f80ede42-134f-431f-8af9-af7933d0d9a2 req-8e081b8a-e0b9-4935-808c-928c25bf795a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031861 Aug 24 04:55:20.284382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 123/225] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:21.121609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bf6c4263-5222-49d9-8b34-e33712fe52e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:21.122455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bf6c4263-5222-49d9-8b34-e33712fe52e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:21.130033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf6c4263-5222-49d9-8b34-e33712fe52e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:21.130779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf6c4263-5222-49d9-8b34-e33712fe52e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:21.131209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf6c4263-5222-49d9-8b34-e33712fe52e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:21.131931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf6c4263-5222-49d9-8b34-e33712fe52e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:21.132380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf6c4263-5222-49d9-8b34-e33712fe52e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:21.132794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf6c4263-5222-49d9-8b34-e33712fe52e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:21.272775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bf6c4263-5222-49d9-8b34-e33712fe52e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:21.280475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bf6c4263-5222-49d9-8b34-e33712fe52e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.162980 Aug 24 04:55:21.281033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 103/226] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:21 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:22.302987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-24a64287-2622-4622-87ed-b44b3a6b0c55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:22.303716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-24a64287-2622-4622-87ed-b44b3a6b0c55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:22.310127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a64287-2622-4622-87ed-b44b3a6b0c55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:22.310597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a64287-2622-4622-87ed-b44b3a6b0c55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:22.311085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a64287-2622-4622-87ed-b44b3a6b0c55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:22.311773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a64287-2622-4622-87ed-b44b3a6b0c55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:22.312230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a64287-2622-4622-87ed-b44b3a6b0c55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:22.312661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a64287-2622-4622-87ed-b44b3a6b0c55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:22.443490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-24a64287-2622-4622-87ed-b44b3a6b0c55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:22.451371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-24a64287-2622-4622-87ed-b44b3a6b0c55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.152766 Aug 24 04:55:22.452058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 124/227] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:22 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:23.472742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ffd5fc7f-eb58-4433-887f-602b44743a78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:23.473353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ffd5fc7f-eb58-4433-887f-602b44743a78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:23.479924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd5fc7f-eb58-4433-887f-602b44743a78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:23.480738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd5fc7f-eb58-4433-887f-602b44743a78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:23.480829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd5fc7f-eb58-4433-887f-602b44743a78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:23.481494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd5fc7f-eb58-4433-887f-602b44743a78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:23.481937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd5fc7f-eb58-4433-887f-602b44743a78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:23.482358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd5fc7f-eb58-4433-887f-602b44743a78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:23.623992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ffd5fc7f-eb58-4433-887f-602b44743a78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:23.638055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ffd5fc7f-eb58-4433-887f-602b44743a78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.169290 Aug 24 04:55:23.639310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 104/228] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:23 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:24.660719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-52b10527-131f-49b4-bcf7-34bcd3f9c1fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:24.661321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-52b10527-131f-49b4-bcf7-34bcd3f9c1fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:24.667521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10527-131f-49b4-bcf7-34bcd3f9c1fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:24.667997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10527-131f-49b4-bcf7-34bcd3f9c1fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:24.668676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10527-131f-49b4-bcf7-34bcd3f9c1fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:24.669365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10527-131f-49b4-bcf7-34bcd3f9c1fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:24.669808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10527-131f-49b4-bcf7-34bcd3f9c1fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:24.670223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10527-131f-49b4-bcf7-34bcd3f9c1fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:24.844605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-52b10527-131f-49b4-bcf7-34bcd3f9c1fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:24.852922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-52b10527-131f-49b4-bcf7-34bcd3f9c1fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.196608 Aug 24 04:55:24.853486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 125/229] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:24 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:25.526543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3c479528-3089-4dc0-b149-c43c2b29c6a0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:25.527093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3c479528-3089-4dc0-b149-c43c2b29c6a0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:25.533392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c479528-3089-4dc0-b149-c43c2b29c6a0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.534031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c479528-3089-4dc0-b149-c43c2b29c6a0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.534466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c479528-3089-4dc0-b149-c43c2b29c6a0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.535187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c479528-3089-4dc0-b149-c43c2b29c6a0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.535641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c479528-3089-4dc0-b149-c43c2b29c6a0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.536123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c479528-3089-4dc0-b149-c43c2b29c6a0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.562597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3c479528-3089-4dc0-b149-c43c2b29c6a0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Going to try to terminate instance {{(pid=120557) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:55:25.580567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:25.659641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3c479528-3089-4dc0-b149-c43c2b29c6a0 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "DELETE /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 204 len: 0 microversion: 2.1 time: 0.136168 Aug 24 04:55:25.660377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 105/230] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 04:55:25 2022] DELETE /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:55:25.668766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0b9a5810-b31e-455e-8552-d7b35f938563 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:25.669372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0b9a5810-b31e-455e-8552-d7b35f938563 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:25.676363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b9a5810-b31e-455e-8552-d7b35f938563 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.677054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b9a5810-b31e-455e-8552-d7b35f938563 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.677744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b9a5810-b31e-455e-8552-d7b35f938563 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.678442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b9a5810-b31e-455e-8552-d7b35f938563 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.678922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b9a5810-b31e-455e-8552-d7b35f938563 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.679343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b9a5810-b31e-455e-8552-d7b35f938563 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.877158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-12dacf7c-4709-4c31-9375-f76b8435584e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:25.878068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-12dacf7c-4709-4c31-9375-f76b8435584e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:25.886029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12dacf7c-4709-4c31-9375-f76b8435584e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.887016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12dacf7c-4709-4c31-9375-f76b8435584e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.887611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12dacf7c-4709-4c31-9375-f76b8435584e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:25.888478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12dacf7c-4709-4c31-9375-f76b8435584e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:25.889086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12dacf7c-4709-4c31-9375-f76b8435584e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:25.889662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12dacf7c-4709-4c31-9375-f76b8435584e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:26.043348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0b9a5810-b31e-455e-8552-d7b35f938563 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:26.045559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-12dacf7c-4709-4c31-9375-f76b8435584e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:26.053031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0b9a5810-b31e-455e-8552-d7b35f938563 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1554 microversion: 2.1 time: 0.388271 Aug 24 04:55:26.053612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 126/231] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:25 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1554 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:26.054243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-12dacf7c-4709-4c31-9375-f76b8435584e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.182725 Aug 24 04:55:26.055093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 106/232] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:25 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:27.074941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-002ad7fd-9c71-454b-bf81-69504738878d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:27.075765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8726c471-7fed-481f-a168-b18a84e301df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:27.076134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-002ad7fd-9c71-454b-bf81-69504738878d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:27.076569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8726c471-7fed-481f-a168-b18a84e301df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:27.081990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-002ad7fd-9c71-454b-bf81-69504738878d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.082478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-002ad7fd-9c71-454b-bf81-69504738878d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.082944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-002ad7fd-9c71-454b-bf81-69504738878d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8726c471-7fed-481f-a168-b18a84e301df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.083637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-002ad7fd-9c71-454b-bf81-69504738878d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.083955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8726c471-7fed-481f-a168-b18a84e301df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.084089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-002ad7fd-9c71-454b-bf81-69504738878d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.084379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8726c471-7fed-481f-a168-b18a84e301df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.084513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-002ad7fd-9c71-454b-bf81-69504738878d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.085053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8726c471-7fed-481f-a168-b18a84e301df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:27.085495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8726c471-7fed-481f-a168-b18a84e301df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:27.085906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8726c471-7fed-481f-a168-b18a84e301df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:27.220587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8726c471-7fed-481f-a168-b18a84e301df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:27.221922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-002ad7fd-9c71-454b-bf81-69504738878d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:27.230401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8726c471-7fed-481f-a168-b18a84e301df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.158620 Aug 24 04:55:27.230585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-002ad7fd-9c71-454b-bf81-69504738878d tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1554 microversion: 2.1 time: 0.160136 Aug 24 04:55:27.231032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 127/233] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:27 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:27.233282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 107/234] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:27 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:28.254082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2d46381b-e685-4a61-b15b-9ff216cdc808 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:28.254868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2d46381b-e685-4a61-b15b-9ff216cdc808 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:28.255671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5cc208e1-6a4f-44f1-a38a-f212d8319458 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:28.256285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5cc208e1-6a4f-44f1-a38a-f212d8319458 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:28.261341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d46381b-e685-4a61-b15b-9ff216cdc808 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:28.261810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d46381b-e685-4a61-b15b-9ff216cdc808 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:28.262268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d46381b-e685-4a61-b15b-9ff216cdc808 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:28.262808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cc208e1-6a4f-44f1-a38a-f212d8319458 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:28.263100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d46381b-e685-4a61-b15b-9ff216cdc808 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:28.263290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cc208e1-6a4f-44f1-a38a-f212d8319458 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:28.263541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d46381b-e685-4a61-b15b-9ff216cdc808 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:28.263718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cc208e1-6a4f-44f1-a38a-f212d8319458 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:28.263954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d46381b-e685-4a61-b15b-9ff216cdc808 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:28.264393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cc208e1-6a4f-44f1-a38a-f212d8319458 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:28.264842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cc208e1-6a4f-44f1-a38a-f212d8319458 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:28.265262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cc208e1-6a4f-44f1-a38a-f212d8319458 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:28.403367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5cc208e1-6a4f-44f1-a38a-f212d8319458 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:28.403782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2d46381b-e685-4a61-b15b-9ff216cdc808 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:28.411498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5cc208e1-6a4f-44f1-a38a-f212d8319458 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.160085 Aug 24 04:55:28.412122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 108/235] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:28 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:28.413165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2d46381b-e685-4a61-b15b-9ff216cdc808 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1554 microversion: 2.1 time: 0.163731 Aug 24 04:55:28.413905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 128/236] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:28 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:29.402165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-53a8e6cd-bfe4-40a8-bd56-a13a2c2b252c req-e1b5b4a8-e105-4488-8bb3-4d8ca573273e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "753ff212-29b2-4316-8343-c0edb0407444", "name": "network-vif-deleted", "tag": "453466b4-98b4-4211-aef1-6ab4ea3f27fd"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:29.415326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-53a8e6cd-bfe4-40a8-bd56-a13a2c2b252c req-e1b5b4a8-e105-4488-8bb3-4d8ca573273e service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.416820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-53a8e6cd-bfe4-40a8-bd56-a13a2c2b252c req-e1b5b4a8-e105-4488-8bb3-4d8ca573273e service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.419108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-53a8e6cd-bfe4-40a8-bd56-a13a2c2b252c req-e1b5b4a8-e105-4488-8bb3-4d8ca573273e service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.435646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-53a8e6cd-bfe4-40a8-bd56-a13a2c2b252c req-e1b5b4a8-e105-4488-8bb3-4d8ca573273e service nova] Creating event network-vif-deleted:453466b4-98b4-4211-aef1-6ab4ea3f27fd for instance 753ff212-29b2-4316-8343-c0edb0407444 on hv-cinder-85426 Aug 24 04:55:29.437329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f40e85f3-ce10-4e66-a459-3f667b5a60f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:29.438077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f40e85f3-ce10-4e66-a459-3f667b5a60f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:29.442940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-53a8e6cd-bfe4-40a8-bd56-a13a2c2b252c req-e1b5b4a8-e105-4488-8bb3-4d8ca573273e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044560 Aug 24 04:55:29.445054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f40e85f3-ce10-4e66-a459-3f667b5a60f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.445553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f40e85f3-ce10-4e66-a459-3f667b5a60f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.447387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 109/237] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:29.447582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f40e85f3-ce10-4e66-a459-3f667b5a60f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.448445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f40e85f3-ce10-4e66-a459-3f667b5a60f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.449146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f40e85f3-ce10-4e66-a459-3f667b5a60f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.449724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f40e85f3-ce10-4e66-a459-3f667b5a60f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.453522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-284e547f-26d7-4357-acce-1875bc00f518 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:29.454231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-284e547f-26d7-4357-acce-1875bc00f518 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:29.462269 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-284e547f-26d7-4357-acce-1875bc00f518 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.462778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-284e547f-26d7-4357-acce-1875bc00f518 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.463213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-284e547f-26d7-4357-acce-1875bc00f518 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.463910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-284e547f-26d7-4357-acce-1875bc00f518 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:29.464524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-284e547f-26d7-4357-acce-1875bc00f518 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:29.465098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-284e547f-26d7-4357-acce-1875bc00f518 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:29.541840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-284e547f-26d7-4357-acce-1875bc00f518 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:29.550821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-284e547f-26d7-4357-acce-1875bc00f518 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1345 microversion: 2.1 time: 0.101854 Aug 24 04:55:29.559029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 110/238] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:29 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1345 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:29.603471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f40e85f3-ce10-4e66-a459-3f667b5a60f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:29.607041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:29.612222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f40e85f3-ce10-4e66-a459-3f667b5a60f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.180744 Aug 24 04:55:29.612794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 129/239] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:29 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:30.573073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:30.573704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:30.583017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:30.583798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:30.584416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:30.585389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:30.586179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:30.587472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:30.624771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:30.625560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:30.628412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:30.628412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lazy-loading 'fault' on Instance uuid 753ff212-29b2-4316-8343-c0edb0407444 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:55:30.633777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-34d7cd08-0419-4dbd-838a-367ce52c1db8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:30.634932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-34d7cd08-0419-4dbd-838a-367ce52c1db8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:30.641654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-34d7cd08-0419-4dbd-838a-367ce52c1db8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:30.643008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-34d7cd08-0419-4dbd-838a-367ce52c1db8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:30.643591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-34d7cd08-0419-4dbd-838a-367ce52c1db8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:30.644435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-34d7cd08-0419-4dbd-838a-367ce52c1db8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:30.645027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-34d7cd08-0419-4dbd-838a-367ce52c1db8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:30.645588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-34d7cd08-0419-4dbd-838a-367ce52c1db8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:30.675616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e13e73729374a93ab04ed49d985a5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e5ec225f4ae4da89c5fb7762191e236', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:30.684894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9c0ce10c-0640-4f4d-9b1c-18644ffeea6c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 200 len: 1350 microversion: 2.1 time: 0.116710 Aug 24 04:55:30.698712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 111/240] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:30 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 1350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:30.789805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-34d7cd08-0419-4dbd-838a-367ce52c1db8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:30.799462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-34d7cd08-0419-4dbd-838a-367ce52c1db8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.168626 Aug 24 04:55:30.800284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 130/241] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:30 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:31.707464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:31.708073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:31.710563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:31.717699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.718182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.718611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.719499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.719949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.720389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.734468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] HTTP exception thrown: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Request method failure captured: Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 HTTP/1.1 Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7r8dMYKaCp2WENTVlnqMfzb-PYXiopWw_iQhkt2vTY9iEMeeM8V-oWpyGtiy-h2a4aedps3XPJ9sY9DSYtb2pOmPhod_KXVh5rcpnfDdu2CMAwRa9DFBiDokjn7aBA15Ia0zjsaoEManRAThkZRtNeF_4pjrEC_cGj1q9k7RfXgq8 Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 4e5ec225f4ae4da89c5fb7762191e236 Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:55:31.739292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_4e5ec225f4ae4da89c5fb7762191e236", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 4e5ec225f4ae4da89c5fb7762191e236 Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-DeleteServersTestJSON-1859194211-project Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 7e13e73729374a93ab04ed49d985a5d7 Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-DeleteServersTestJSON-1859194211-project Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:31.740723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '753ff212-29b2-4316-8343-c0edb0407444'} Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:31.744851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:31.746249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:55:31.747603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Returning 404 to user: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:31.747603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-842133a0-5741-4167-a87d-6456bfd32c2c tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 404 len: 111 microversion: 2.1 time: 0.037902 Aug 24 04:55:31.747603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 112/242] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:31 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:31.821969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9013096a-e727-4f04-bbe8-c274bdbb15e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:31.822749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9013096a-e727-4f04-bbe8-c274bdbb15e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:31.829091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9013096a-e727-4f04-bbe8-c274bdbb15e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.829667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9013096a-e727-4f04-bbe8-c274bdbb15e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.831030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9013096a-e727-4f04-bbe8-c274bdbb15e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.831897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9013096a-e727-4f04-bbe8-c274bdbb15e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.832458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9013096a-e727-4f04-bbe8-c274bdbb15e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.832976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9013096a-e727-4f04-bbe8-c274bdbb15e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.864390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:31.867196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:31.873655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.874246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.874948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.875867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:31.876549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:31.877716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:31.894393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] HTTP exception thrown: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Request method failure captured: Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444/os-volume_attachments HTTP/1.1 Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7r8dMYKaCp2WENTVlnqMfzb-PYXiopWw_iQhkt2vTY9iEMeeM8V-oWpyGtiy-h2a4aedps3XPJ9sY9DSYtb2pOmPhod_KXVh5rcpnfDdu2CMAwRa9DFBiDokjn7aBA15Ia0zjsaoEManRAThkZRtNeF_4pjrEC_cGj1q9k7RfXgq8 Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 4e5ec225f4ae4da89c5fb7762191e236 Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:55:31.896832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_4e5ec225f4ae4da89c5fb7762191e236", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 4e5ec225f4ae4da89c5fb7762191e236 Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-DeleteServersTestJSON-1859194211-project Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 7e13e73729374a93ab04ed49d985a5d7 Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-DeleteServersTestJSON-1859194211-project Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:31.898045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'server_id': '753ff212-29b2-4316-8343-c0edb0407444'} Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:31.898787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:31.899916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:55:31.902588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Returning 404 to user: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:31.903474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c8c3ca4f-3447-4c7d-bd77-1eafd4a17fb9 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043102 Aug 24 04:55:31.904213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 113/243] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 04:55:31 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:55:31.982196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9013096a-e727-4f04-bbe8-c274bdbb15e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:31.992102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9013096a-e727-4f04-bbe8-c274bdbb15e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.174617 Aug 24 04:55:31.992688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 131/244] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:31 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:33.014388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d2254d57-14fc-4a01-9708-e438ac8981a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:33.015641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d2254d57-14fc-4a01-9708-e438ac8981a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:33.022947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2254d57-14fc-4a01-9708-e438ac8981a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.023434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2254d57-14fc-4a01-9708-e438ac8981a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.024009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2254d57-14fc-4a01-9708-e438ac8981a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.024698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2254d57-14fc-4a01-9708-e438ac8981a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.025145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2254d57-14fc-4a01-9708-e438ac8981a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.025566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2254d57-14fc-4a01-9708-e438ac8981a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.148728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:33.149283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:33.155222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=74 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:33.157058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.157470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.158577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.159682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.160124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.160598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.181868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] HTTP exception thrown: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Request method failure captured: Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 HTTP/1.1 Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa7r8dMYKaCp2WENTVlnqMfzb-PYXiopWw_iQhkt2vTY9iEMeeM8V-oWpyGtiy-h2a4aedps3XPJ9sY9DSYtb2pOmPhod_KXVh5rcpnfDdu2CMAwRa9DFBiDokjn7aBA15Ia0zjsaoEManRAThkZRtNeF_4pjrEC_cGj1q9k7RfXgq8 Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 4e5ec225f4ae4da89c5fb7762191e236 Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 04:55:33.188153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_4e5ec225f4ae4da89c5fb7762191e236", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 4e5ec225f4ae4da89c5fb7762191e236 Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-DeleteServersTestJSON-1859194211-project Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 7e13e73729374a93ab04ed49d985a5d7 Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-DeleteServersTestJSON-1859194211-project Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:33.189915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '753ff212-29b2-4316-8343-c0edb0407444'} Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:33.190945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:33.192230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:55:33.194542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Returning 404 to user: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:33.195820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-82035bdc-95d0-4618-be34-658ba4499e13 tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "DELETE /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 404 len: 111 microversion: 2.1 time: 0.051094 Aug 24 04:55:33.196455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 132/245] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 04:55:33 2022] DELETE /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:33.202818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d2254d57-14fc-4a01-9708-e438ac8981a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:33.205845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:33.206978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] [instance: 753ff212-29b2-4316-8343-c0edb0407444] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:33.213222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d2254d57-14fc-4a01-9708-e438ac8981a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.202591 Aug 24 04:55:33.213795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.214544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.215158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.216192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:33.216860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:33.217460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:33.229590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 114/246] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:33 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:33.233494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] HTTP exception thrown: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Request method failure captured: Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 HTTP/1.1 Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa7r8dMYKaCp2WENTVlnqMfzb-PYXiopWw_iQhkt2vTY9iEMeeM8V-oWpyGtiy-h2a4aedps3XPJ9sY9DSYtb2pOmPhod_KXVh5rcpnfDdu2CMAwRa9DFBiDokjn7aBA15Ia0zjsaoEManRAThkZRtNeF_4pjrEC_cGj1q9k7RfXgq8 Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 4e5ec225f4ae4da89c5fb7762191e236 Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 04:55:33.235134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_4e5ec225f4ae4da89c5fb7762191e236", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/4e5ec225f4ae4da89c5fb7762191e236"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 4e5ec225f4ae4da89c5fb7762191e236 Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859194211 Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-DeleteServersTestJSON-1859194211-project Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 7e13e73729374a93ab04ed49d985a5d7 Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-DeleteServersTestJSON-1859194211-project Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:33.236381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '753ff212-29b2-4316-8343-c0edb0407444'} Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:55:33.237268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. Aug 24 04:55:33.238581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:55:33.240423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] Returning 404 to user: Instance 753ff212-29b2-4316-8343-c0edb0407444 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:55:33.240423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-931dbe16-13af-445e-aa5c-d77566f503ea tempest-DeleteServersTestJSON-1859194211 tempest-DeleteServersTestJSON-1859194211-project] 10.222.0.97 "GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444" status: 404 len: 111 microversion: 2.1 time: 0.035741 Aug 24 04:55:33.240423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 133/247] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:33 2022] GET /compute/v2.1/servers/753ff212-29b2-4316-8343-c0edb0407444 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:34.237262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-704822b9-2570-479d-b19f-5178a7928398 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:34.238603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-704822b9-2570-479d-b19f-5178a7928398 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:34.246384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-704822b9-2570-479d-b19f-5178a7928398 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:34.247111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-704822b9-2570-479d-b19f-5178a7928398 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:34.247735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-704822b9-2570-479d-b19f-5178a7928398 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:34.248670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-704822b9-2570-479d-b19f-5178a7928398 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:34.249456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-704822b9-2570-479d-b19f-5178a7928398 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:34.250052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-704822b9-2570-479d-b19f-5178a7928398 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:34.589543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-704822b9-2570-479d-b19f-5178a7928398 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:34.615280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-704822b9-2570-479d-b19f-5178a7928398 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.384595 Aug 24 04:55:34.619769 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 115/248] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:34 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:35.638946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-132a7bed-f82c-41d6-a2e9-1c905f4a0576 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:35.639742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-132a7bed-f82c-41d6-a2e9-1c905f4a0576 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:35.651498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a7bed-f82c-41d6-a2e9-1c905f4a0576 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:35.655319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a7bed-f82c-41d6-a2e9-1c905f4a0576 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:35.656626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a7bed-f82c-41d6-a2e9-1c905f4a0576 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:35.659692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a7bed-f82c-41d6-a2e9-1c905f4a0576 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:35.661056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a7bed-f82c-41d6-a2e9-1c905f4a0576 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:35.662206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-132a7bed-f82c-41d6-a2e9-1c905f4a0576 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:35.917653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-132a7bed-f82c-41d6-a2e9-1c905f4a0576 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:35.928018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-132a7bed-f82c-41d6-a2e9-1c905f4a0576 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.296007 Aug 24 04:55:35.944101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 134/249] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:35 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:36.950033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-285d5c2e-f028-4ee6-b53b-a6fffb646625 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:36.950634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-285d5c2e-f028-4ee6-b53b-a6fffb646625 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:36.959598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-285d5c2e-f028-4ee6-b53b-a6fffb646625 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:36.960507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-285d5c2e-f028-4ee6-b53b-a6fffb646625 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:36.960947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-285d5c2e-f028-4ee6-b53b-a6fffb646625 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:36.961843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-285d5c2e-f028-4ee6-b53b-a6fffb646625 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:36.962298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-285d5c2e-f028-4ee6-b53b-a6fffb646625 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:36.962772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-285d5c2e-f028-4ee6-b53b-a6fffb646625 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:37.191087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-285d5c2e-f028-4ee6-b53b-a6fffb646625 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:37.203818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-285d5c2e-f028-4ee6-b53b-a6fffb646625 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.257528 Aug 24 04:55:37.204622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 116/250] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:36 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:38.225737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1d3aa7cc-d9d6-40d6-8640-0fcb92dc80a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:38.226340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1d3aa7cc-d9d6-40d6-8640-0fcb92dc80a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:38.232269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3aa7cc-d9d6-40d6-8640-0fcb92dc80a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:38.232744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3aa7cc-d9d6-40d6-8640-0fcb92dc80a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:38.233173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3aa7cc-d9d6-40d6-8640-0fcb92dc80a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:38.233851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3aa7cc-d9d6-40d6-8640-0fcb92dc80a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:38.234295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3aa7cc-d9d6-40d6-8640-0fcb92dc80a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:38.234726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3aa7cc-d9d6-40d6-8640-0fcb92dc80a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:38.369382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1d3aa7cc-d9d6-40d6-8640-0fcb92dc80a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:38.377872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1d3aa7cc-d9d6-40d6-8640-0fcb92dc80a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.155777 Aug 24 04:55:38.378459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 135/251] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:38 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:39.399817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3048b8ba-8c76-4978-b00b-06ea000b0df9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:39.400477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3048b8ba-8c76-4978-b00b-06ea000b0df9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:39.407397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3048b8ba-8c76-4978-b00b-06ea000b0df9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:39.408448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3048b8ba-8c76-4978-b00b-06ea000b0df9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:39.409101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3048b8ba-8c76-4978-b00b-06ea000b0df9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:39.409996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3048b8ba-8c76-4978-b00b-06ea000b0df9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:39.410450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3048b8ba-8c76-4978-b00b-06ea000b0df9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:39.410897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3048b8ba-8c76-4978-b00b-06ea000b0df9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:39.573228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3048b8ba-8c76-4978-b00b-06ea000b0df9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:39.582410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3048b8ba-8c76-4978-b00b-06ea000b0df9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.186302 Aug 24 04:55:39.583089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 117/252] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:39 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:40.607930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-23e9dbb2-1a38-4a97-89a3-30f4803e8fe0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:40.609154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-23e9dbb2-1a38-4a97-89a3-30f4803e8fe0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:40.616939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e9dbb2-1a38-4a97-89a3-30f4803e8fe0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.618427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e9dbb2-1a38-4a97-89a3-30f4803e8fe0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.619641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e9dbb2-1a38-4a97-89a3-30f4803e8fe0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.620907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e9dbb2-1a38-4a97-89a3-30f4803e8fe0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:40.621583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e9dbb2-1a38-4a97-89a3-30f4803e8fe0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:40.622228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e9dbb2-1a38-4a97-89a3-30f4803e8fe0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:40.881091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-23e9dbb2-1a38-4a97-89a3-30f4803e8fe0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:40.889616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-23e9dbb2-1a38-4a97-89a3-30f4803e8fe0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.285427 Aug 24 04:55:40.890188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 136/253] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:40 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:41.919933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-714d9817-673a-4529-ac1b-2ca2b5a10afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:41.921814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-714d9817-673a-4529-ac1b-2ca2b5a10afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:41.952144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714d9817-673a-4529-ac1b-2ca2b5a10afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:41.952898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714d9817-673a-4529-ac1b-2ca2b5a10afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:41.953348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714d9817-673a-4529-ac1b-2ca2b5a10afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:41.954043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714d9817-673a-4529-ac1b-2ca2b5a10afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:41.954624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714d9817-673a-4529-ac1b-2ca2b5a10afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:41.955393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714d9817-673a-4529-ac1b-2ca2b5a10afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:42.435448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-714d9817-673a-4529-ac1b-2ca2b5a10afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:42.452640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-714d9817-673a-4529-ac1b-2ca2b5a10afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.545759 Aug 24 04:55:42.453265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 118/254] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:41 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:43.477191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-868dfa1d-77bb-4f9d-bb2c-fb68a396dc78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:43.478932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-868dfa1d-77bb-4f9d-bb2c-fb68a396dc78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:43.489003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-868dfa1d-77bb-4f9d-bb2c-fb68a396dc78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:43.489491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-868dfa1d-77bb-4f9d-bb2c-fb68a396dc78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:43.493553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-868dfa1d-77bb-4f9d-bb2c-fb68a396dc78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:43.496739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-868dfa1d-77bb-4f9d-bb2c-fb68a396dc78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:43.496739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-868dfa1d-77bb-4f9d-bb2c-fb68a396dc78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:43.497712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-868dfa1d-77bb-4f9d-bb2c-fb68a396dc78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:43.775205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-868dfa1d-77bb-4f9d-bb2c-fb68a396dc78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:43.797603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-868dfa1d-77bb-4f9d-bb2c-fb68a396dc78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.319716 Aug 24 04:55:43.798895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 137/255] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:43 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:44.822574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f5fc792c-2991-4a6d-b47a-9970a2728520 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:44.823496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f5fc792c-2991-4a6d-b47a-9970a2728520 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:44.844236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5fc792c-2991-4a6d-b47a-9970a2728520 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:44.846359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5fc792c-2991-4a6d-b47a-9970a2728520 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:44.848543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5fc792c-2991-4a6d-b47a-9970a2728520 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:44.849716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5fc792c-2991-4a6d-b47a-9970a2728520 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:44.850187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5fc792c-2991-4a6d-b47a-9970a2728520 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:44.850611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5fc792c-2991-4a6d-b47a-9970a2728520 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:45.239164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f5fc792c-2991-4a6d-b47a-9970a2728520 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:45.254491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f5fc792c-2991-4a6d-b47a-9970a2728520 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.437043 Aug 24 04:55:45.255747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 119/256] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:44 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:46.275423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b77a54ab-3bcf-45a5-9127-8fe16dfa4c78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:46.276658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b77a54ab-3bcf-45a5-9127-8fe16dfa4c78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:46.284471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77a54ab-3bcf-45a5-9127-8fe16dfa4c78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:46.285172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77a54ab-3bcf-45a5-9127-8fe16dfa4c78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:46.285932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77a54ab-3bcf-45a5-9127-8fe16dfa4c78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:46.286735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77a54ab-3bcf-45a5-9127-8fe16dfa4c78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:46.287533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77a54ab-3bcf-45a5-9127-8fe16dfa4c78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:46.288163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b77a54ab-3bcf-45a5-9127-8fe16dfa4c78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:46.488605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b77a54ab-3bcf-45a5-9127-8fe16dfa4c78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:46.504892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b77a54ab-3bcf-45a5-9127-8fe16dfa4c78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.226471 Aug 24 04:55:46.505928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 138/257] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:46 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:47.528014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a04ce2e4-b10a-498b-a071-1b50ffe75ed9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:47.528872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a04ce2e4-b10a-498b-a071-1b50ffe75ed9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:47.553266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a04ce2e4-b10a-498b-a071-1b50ffe75ed9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:47.554381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a04ce2e4-b10a-498b-a071-1b50ffe75ed9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:47.555041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a04ce2e4-b10a-498b-a071-1b50ffe75ed9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:47.555894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a04ce2e4-b10a-498b-a071-1b50ffe75ed9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:47.557419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a04ce2e4-b10a-498b-a071-1b50ffe75ed9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:47.558846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a04ce2e4-b10a-498b-a071-1b50ffe75ed9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:47.757189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a04ce2e4-b10a-498b-a071-1b50ffe75ed9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:47.771389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a04ce2e4-b10a-498b-a071-1b50ffe75ed9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.248820 Aug 24 04:55:47.772377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 120/258] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:47 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:48.795968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-89b5d119-6ec6-4304-8893-eadba6cd914e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:48.796691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-89b5d119-6ec6-4304-8893-eadba6cd914e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:48.813209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b5d119-6ec6-4304-8893-eadba6cd914e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:48.815933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b5d119-6ec6-4304-8893-eadba6cd914e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:48.816379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b5d119-6ec6-4304-8893-eadba6cd914e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:48.817095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b5d119-6ec6-4304-8893-eadba6cd914e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:48.817546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b5d119-6ec6-4304-8893-eadba6cd914e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:48.818058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b5d119-6ec6-4304-8893-eadba6cd914e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:49.087254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-89b5d119-6ec6-4304-8893-eadba6cd914e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:49.096138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-89b5d119-6ec6-4304-8893-eadba6cd914e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.306963 Aug 24 04:55:49.096727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 139/259] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:48 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:50.119184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bf4c9ff4-9e0a-44bf-b814-aa93ce70ab6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:50.120506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bf4c9ff4-9e0a-44bf-b814-aa93ce70ab6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:50.131432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf4c9ff4-9e0a-44bf-b814-aa93ce70ab6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:50.132298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf4c9ff4-9e0a-44bf-b814-aa93ce70ab6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:50.134191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf4c9ff4-9e0a-44bf-b814-aa93ce70ab6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:50.135166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf4c9ff4-9e0a-44bf-b814-aa93ce70ab6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:50.137766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf4c9ff4-9e0a-44bf-b814-aa93ce70ab6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:50.139551 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf4c9ff4-9e0a-44bf-b814-aa93ce70ab6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:50.477927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bf4c9ff4-9e0a-44bf-b814-aa93ce70ab6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:50.489428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bf4c9ff4-9e0a-44bf-b814-aa93ce70ab6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.374961 Aug 24 04:55:50.490013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 121/260] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:50 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:51.525265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ee83f4ce-7fb7-430f-8e0e-ee7e0aad4131 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:51.525879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ee83f4ce-7fb7-430f-8e0e-ee7e0aad4131 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:51.542506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee83f4ce-7fb7-430f-8e0e-ee7e0aad4131 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:51.543123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee83f4ce-7fb7-430f-8e0e-ee7e0aad4131 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:51.544491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee83f4ce-7fb7-430f-8e0e-ee7e0aad4131 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:51.545662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee83f4ce-7fb7-430f-8e0e-ee7e0aad4131 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:51.546130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee83f4ce-7fb7-430f-8e0e-ee7e0aad4131 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:51.546560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee83f4ce-7fb7-430f-8e0e-ee7e0aad4131 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:51.792866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ee83f4ce-7fb7-430f-8e0e-ee7e0aad4131 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:51.802367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ee83f4ce-7fb7-430f-8e0e-ee7e0aad4131 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.292855 Aug 24 04:55:51.802997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 140/261] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:51 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:52.826988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b6d6216f-e221-4b76-a8a1-a1adeebd8ef9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:52.827649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b6d6216f-e221-4b76-a8a1-a1adeebd8ef9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:52.837626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6d6216f-e221-4b76-a8a1-a1adeebd8ef9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:52.838138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6d6216f-e221-4b76-a8a1-a1adeebd8ef9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:52.839723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6d6216f-e221-4b76-a8a1-a1adeebd8ef9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:52.840638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6d6216f-e221-4b76-a8a1-a1adeebd8ef9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:52.842221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6d6216f-e221-4b76-a8a1-a1adeebd8ef9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:52.842830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6d6216f-e221-4b76-a8a1-a1adeebd8ef9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:52.976307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-da43739c-d63d-4733-99e4-a6cbc3a880c9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Action: 'create', calling method: .version_select at 0x7f359038e940>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-776612737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZyBBZ/OTZX+JOcwIQjl4ciahlUSgPb6ydOsApJdLgvGwX1pt6pqP27cwwORLg1O1ayOOJ+huZQPI37AwUH1S+f0pgpuzmGZP0+mBFbkcFSYwVUfcAdml4Cu6vOxGqReA=="}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:55:52.997464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-da43739c-d63d-4733-99e4-a6cbc3a880c9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Getting quotas for project aaa96f5af1de4cf5a59cdca9c785db52. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:55:53.001818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-da43739c-d63d-4733-99e4-a6cbc3a880c9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Getting quotas for user 81f88a5d0ffe4c5abd85cdfc19d18694 and project aaa96f5af1de4cf5a59cdca9c785db52. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:55:53.004110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b6d6216f-e221-4b76-a8a1-a1adeebd8ef9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:53.017831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b6d6216f-e221-4b76-a8a1-a1adeebd8ef9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.194714 Aug 24 04:55:53.019470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 141/262] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:52 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:55:53.039222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-da43739c-d63d-4733-99e4-a6cbc3a880c9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.320832 Aug 24 04:55:53.039919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 122/263] 10.222.0.97 () {60 vars in 1159 bytes} [Wed Aug 24 04:55:52 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:55:54.038925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9b08ceb3-594f-45df-8b34-122453dc8ad6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:54.040179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9b08ceb3-594f-45df-8b34-122453dc8ad6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:54.047231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b08ceb3-594f-45df-8b34-122453dc8ad6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:54.048795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b08ceb3-594f-45df-8b34-122453dc8ad6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:54.049557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b08ceb3-594f-45df-8b34-122453dc8ad6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:54.050630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b08ceb3-594f-45df-8b34-122453dc8ad6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:54.051304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b08ceb3-594f-45df-8b34-122453dc8ad6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:54.052030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b08ceb3-594f-45df-8b34-122453dc8ad6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:54.223491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9b08ceb3-594f-45df-8b34-122453dc8ad6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:54.231533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9b08ceb3-594f-45df-8b34-122453dc8ad6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.196577 Aug 24 04:55:54.232240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 142/264] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:54 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:55.253906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9863d028-9a59-4af3-a51e-6ae777a40faf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:55.254647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9863d028-9a59-4af3-a51e-6ae777a40faf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:55.264743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9863d028-9a59-4af3-a51e-6ae777a40faf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:55.265228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9863d028-9a59-4af3-a51e-6ae777a40faf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:55.265659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9863d028-9a59-4af3-a51e-6ae777a40faf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:55.266354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9863d028-9a59-4af3-a51e-6ae777a40faf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:55.267652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9863d028-9a59-4af3-a51e-6ae777a40faf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:55.268224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9863d028-9a59-4af3-a51e-6ae777a40faf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:55.408864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9863d028-9a59-4af3-a51e-6ae777a40faf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:55.411811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:55.422546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9863d028-9a59-4af3-a51e-6ae777a40faf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.173150 Aug 24 04:55:55.439673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 123/265] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:55 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:56.445857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ad193bc0-c10c-4ff4-926c-7e3915d3c8ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:56.446655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ad193bc0-c10c-4ff4-926c-7e3915d3c8ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:56.453784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad193bc0-c10c-4ff4-926c-7e3915d3c8ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:56.454922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad193bc0-c10c-4ff4-926c-7e3915d3c8ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:56.455561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad193bc0-c10c-4ff4-926c-7e3915d3c8ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:56.456573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad193bc0-c10c-4ff4-926c-7e3915d3c8ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:56.457107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad193bc0-c10c-4ff4-926c-7e3915d3c8ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:56.457754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad193bc0-c10c-4ff4-926c-7e3915d3c8ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:56.623258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ad193bc0-c10c-4ff4-926c-7e3915d3c8ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:56.631788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ad193bc0-c10c-4ff4-926c-7e3915d3c8ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.190319 Aug 24 04:55:56.632351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 143/266] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:56 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:57.655081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0d6c0c0a-d134-43ff-a359-0c09a0182554 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:57.655692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0d6c0c0a-d134-43ff-a359-0c09a0182554 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:57.664141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d6c0c0a-d134-43ff-a359-0c09a0182554 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:57.664927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d6c0c0a-d134-43ff-a359-0c09a0182554 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:57.665659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d6c0c0a-d134-43ff-a359-0c09a0182554 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:57.666353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d6c0c0a-d134-43ff-a359-0c09a0182554 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:57.667130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d6c0c0a-d134-43ff-a359-0c09a0182554 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:57.667553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d6c0c0a-d134-43ff-a359-0c09a0182554 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:57.814180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0d6c0c0a-d134-43ff-a359-0c09a0182554 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:57.822257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0d6c0c0a-d134-43ff-a359-0c09a0182554 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.172254 Aug 24 04:55:57.822859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 124/267] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:57 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:55:58.843741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1b5894fa-9c75-4534-aec1-7a569a3f66ee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:55:58.844354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1b5894fa-9c75-4534-aec1-7a569a3f66ee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:55:58.852912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5894fa-9c75-4534-aec1-7a569a3f66ee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:58.853392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5894fa-9c75-4534-aec1-7a569a3f66ee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:58.853826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5894fa-9c75-4534-aec1-7a569a3f66ee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:58.854515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5894fa-9c75-4534-aec1-7a569a3f66ee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:55:58.855002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5894fa-9c75-4534-aec1-7a569a3f66ee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:55:58.855426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5894fa-9c75-4534-aec1-7a569a3f66ee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:55:58.996964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1b5894fa-9c75-4534-aec1-7a569a3f66ee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:55:59.005438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1b5894fa-9c75-4534-aec1-7a569a3f66ee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.165546 Aug 24 04:55:59.006162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 144/268] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:55:58 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:00.026322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-47fad6f3-a596-46c9-bdd0-294538aa1f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:00.026984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-47fad6f3-a596-46c9-bdd0-294538aa1f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:00.033943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fad6f3-a596-46c9-bdd0-294538aa1f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:00.034425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fad6f3-a596-46c9-bdd0-294538aa1f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:00.034895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fad6f3-a596-46c9-bdd0-294538aa1f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:00.035578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fad6f3-a596-46c9-bdd0-294538aa1f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:00.036027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fad6f3-a596-46c9-bdd0-294538aa1f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:00.036443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fad6f3-a596-46c9-bdd0-294538aa1f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:00.169031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-47fad6f3-a596-46c9-bdd0-294538aa1f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:00.177239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-47fad6f3-a596-46c9-bdd0-294538aa1f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.154788 Aug 24 04:56:00.177836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 125/269] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:00 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:01.198451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1fb59c30-ca3b-4b3a-8d39-86b7663e204e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:01.199078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1fb59c30-ca3b-4b3a-8d39-86b7663e204e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:01.205748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fb59c30-ca3b-4b3a-8d39-86b7663e204e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:01.206215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fb59c30-ca3b-4b3a-8d39-86b7663e204e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:01.206640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fb59c30-ca3b-4b3a-8d39-86b7663e204e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:01.207337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fb59c30-ca3b-4b3a-8d39-86b7663e204e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:01.207776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fb59c30-ca3b-4b3a-8d39-86b7663e204e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:01.208186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fb59c30-ca3b-4b3a-8d39-86b7663e204e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:01.210705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=83 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:01.338719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1fb59c30-ca3b-4b3a-8d39-86b7663e204e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:01.347408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1fb59c30-ca3b-4b3a-8d39-86b7663e204e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.152712 Aug 24 04:56:01.347990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 145/270] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:01 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:02.369374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-18eaad0f-9fbd-4c53-95c2-5a38d5167bae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:02.369911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-18eaad0f-9fbd-4c53-95c2-5a38d5167bae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:02.372220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:02.377523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18eaad0f-9fbd-4c53-95c2-5a38d5167bae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:02.378716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18eaad0f-9fbd-4c53-95c2-5a38d5167bae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:02.379151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18eaad0f-9fbd-4c53-95c2-5a38d5167bae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:02.379840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18eaad0f-9fbd-4c53-95c2-5a38d5167bae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:02.380293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18eaad0f-9fbd-4c53-95c2-5a38d5167bae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:02.380713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18eaad0f-9fbd-4c53-95c2-5a38d5167bae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:02.518872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-18eaad0f-9fbd-4c53-95c2-5a38d5167bae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:02.526788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-18eaad0f-9fbd-4c53-95c2-5a38d5167bae tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.161312 Aug 24 04:56:02.527344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 126/271] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:02 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:03.548408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-448cd51b-621c-4271-b428-23b23e9df1b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:03.549005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-448cd51b-621c-4271-b428-23b23e9df1b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:03.551084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=28 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:03.556726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-448cd51b-621c-4271-b428-23b23e9df1b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:03.557209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-448cd51b-621c-4271-b428-23b23e9df1b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:03.557677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-448cd51b-621c-4271-b428-23b23e9df1b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:03.558362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-448cd51b-621c-4271-b428-23b23e9df1b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:03.558847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-448cd51b-621c-4271-b428-23b23e9df1b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:03.559269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-448cd51b-621c-4271-b428-23b23e9df1b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:03.691661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-448cd51b-621c-4271-b428-23b23e9df1b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:03.699365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-448cd51b-621c-4271-b428-23b23e9df1b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.154864 Aug 24 04:56:03.699935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 146/272] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:03 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:04.720198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-36b0996c-6db5-4f7c-9d89-7dbc4a9a65c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:04.720844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-36b0996c-6db5-4f7c-9d89-7dbc4a9a65c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:04.723355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=4 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:04.729381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36b0996c-6db5-4f7c-9d89-7dbc4a9a65c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:04.729873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36b0996c-6db5-4f7c-9d89-7dbc4a9a65c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:04.730308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36b0996c-6db5-4f7c-9d89-7dbc4a9a65c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:04.731033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36b0996c-6db5-4f7c-9d89-7dbc4a9a65c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:04.731479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36b0996c-6db5-4f7c-9d89-7dbc4a9a65c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:04.731899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36b0996c-6db5-4f7c-9d89-7dbc4a9a65c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:04.884318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-36b0996c-6db5-4f7c-9d89-7dbc4a9a65c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:04.894043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-36b0996c-6db5-4f7c-9d89-7dbc4a9a65c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.177563 Aug 24 04:56:04.895124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 127/273] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:04 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:05.916200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-303250ba-10dd-410c-b6b6-54d68772f286 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:05.916808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-303250ba-10dd-410c-b6b6-54d68772f286 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:05.923105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-303250ba-10dd-410c-b6b6-54d68772f286 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:05.923584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-303250ba-10dd-410c-b6b6-54d68772f286 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:05.924018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-303250ba-10dd-410c-b6b6-54d68772f286 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:05.924720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-303250ba-10dd-410c-b6b6-54d68772f286 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:05.925164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-303250ba-10dd-410c-b6b6-54d68772f286 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:05.925586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-303250ba-10dd-410c-b6b6-54d68772f286 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:06.055782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-303250ba-10dd-410c-b6b6-54d68772f286 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:06.063685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-303250ba-10dd-410c-b6b6-54d68772f286 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.151353 Aug 24 04:56:06.064250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 147/274] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:05 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:07.084586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-41b4389f-b246-498e-bc6f-6d9a025823a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:07.085222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-41b4389f-b246-498e-bc6f-6d9a025823a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:07.091407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b4389f-b246-498e-bc6f-6d9a025823a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:07.091880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b4389f-b246-498e-bc6f-6d9a025823a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:07.092310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b4389f-b246-498e-bc6f-6d9a025823a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:07.092990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b4389f-b246-498e-bc6f-6d9a025823a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:07.093443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b4389f-b246-498e-bc6f-6d9a025823a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:07.093866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b4389f-b246-498e-bc6f-6d9a025823a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:07.229802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-41b4389f-b246-498e-bc6f-6d9a025823a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:07.237541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-41b4389f-b246-498e-bc6f-6d9a025823a5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.156934 Aug 24 04:56:07.238754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 128/275] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:07 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:08.259819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2eeaa439-b3ee-4bda-b60a-ca9c40808316 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:08.260526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2eeaa439-b3ee-4bda-b60a-ca9c40808316 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:08.267117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eeaa439-b3ee-4bda-b60a-ca9c40808316 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:08.267363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eeaa439-b3ee-4bda-b60a-ca9c40808316 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:08.267796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eeaa439-b3ee-4bda-b60a-ca9c40808316 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:08.269019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eeaa439-b3ee-4bda-b60a-ca9c40808316 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:08.269475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eeaa439-b3ee-4bda-b60a-ca9c40808316 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:08.269949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eeaa439-b3ee-4bda-b60a-ca9c40808316 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:08.407270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2eeaa439-b3ee-4bda-b60a-ca9c40808316 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:08.415574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2eeaa439-b3ee-4bda-b60a-ca9c40808316 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1522 microversion: 2.1 time: 0.160449 Aug 24 04:56:08.416138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 148/276] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:08 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:09.436497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-37e7239c-4569-4bea-897a-e4ec1be0905f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:09.437136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-37e7239c-4569-4bea-897a-e4ec1be0905f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:09.443678 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e7239c-4569-4bea-897a-e4ec1be0905f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.444160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e7239c-4569-4bea-897a-e4ec1be0905f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.444597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e7239c-4569-4bea-897a-e4ec1be0905f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.445277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e7239c-4569-4bea-897a-e4ec1be0905f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.445708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e7239c-4569-4bea-897a-e4ec1be0905f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.446131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e7239c-4569-4bea-897a-e4ec1be0905f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.579143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-37e7239c-4569-4bea-897a-e4ec1be0905f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:09.587546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-37e7239c-4569-4bea-897a-e4ec1be0905f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1502 microversion: 2.1 time: 0.154850 Aug 24 04:56:09.588109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 129/277] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:09 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:09.607698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ae361ed3-1282-467f-b483-ad152d3c6071 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:09.608302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ae361ed3-1282-467f-b483-ad152d3c6071 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:09.614294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae361ed3-1282-467f-b483-ad152d3c6071 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.614834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae361ed3-1282-467f-b483-ad152d3c6071 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.615277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae361ed3-1282-467f-b483-ad152d3c6071 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.615956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae361ed3-1282-467f-b483-ad152d3c6071 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:09.616403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae361ed3-1282-467f-b483-ad152d3c6071 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:09.616818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae361ed3-1282-467f-b483-ad152d3c6071 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:09.745932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ae361ed3-1282-467f-b483-ad152d3c6071 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:09.753907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ae361ed3-1282-467f-b483-ad152d3c6071 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1515 microversion: 2.1 time: 0.150032 Aug 24 04:56:09.754474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 149/278] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:09 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:13.236306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3f68beac-980e-4f07-ad8e-1d0b2de6c569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:13.238709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3f68beac-980e-4f07-ad8e-1d0b2de6c569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:13.245313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f68beac-980e-4f07-ad8e-1d0b2de6c569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:13.245782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f68beac-980e-4f07-ad8e-1d0b2de6c569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:13.246507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f68beac-980e-4f07-ad8e-1d0b2de6c569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:13.246890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f68beac-980e-4f07-ad8e-1d0b2de6c569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:13.247330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f68beac-980e-4f07-ad8e-1d0b2de6c569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:13.247741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f68beac-980e-4f07-ad8e-1d0b2de6c569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:13.271416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-3f68beac-980e-4f07-ad8e-1d0b2de6c569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lazy-loading 'flavor' on Instance uuid dc16ffe9-0180-4a64-b937-bfd52cacbc89 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:56:13.378791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3f68beac-980e-4f07-ad8e-1d0b2de6c569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89/action" status: 200 len: 32 microversion: 2.1 time: 0.146361 Aug 24 04:56:13.379690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 130/279] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 04:56:13 2022] POST /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89/action => generated 32 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 04:56:13.389201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0225e934-5906-44bd-ae32-440fdf442bdf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:13.389810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0225e934-5906-44bd-ae32-440fdf442bdf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:13.397149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225e934-5906-44bd-ae32-440fdf442bdf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:13.397634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225e934-5906-44bd-ae32-440fdf442bdf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:13.398077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225e934-5906-44bd-ae32-440fdf442bdf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:13.398803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225e934-5906-44bd-ae32-440fdf442bdf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:13.399283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225e934-5906-44bd-ae32-440fdf442bdf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:13.399669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225e934-5906-44bd-ae32-440fdf442bdf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:13.537534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0225e934-5906-44bd-ae32-440fdf442bdf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:13.545582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0225e934-5906-44bd-ae32-440fdf442bdf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.160220 Aug 24 04:56:13.546522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 150/280] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:13 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:14.567642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-01f86ea2-b9ff-420b-8730-541aac047e81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:14.568329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-01f86ea2-b9ff-420b-8730-541aac047e81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:14.574888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01f86ea2-b9ff-420b-8730-541aac047e81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:14.575356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01f86ea2-b9ff-420b-8730-541aac047e81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:14.575779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01f86ea2-b9ff-420b-8730-541aac047e81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:14.576446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01f86ea2-b9ff-420b-8730-541aac047e81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:14.576888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01f86ea2-b9ff-420b-8730-541aac047e81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:14.577298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01f86ea2-b9ff-420b-8730-541aac047e81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:14.709778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-01f86ea2-b9ff-420b-8730-541aac047e81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:14.717443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-01f86ea2-b9ff-420b-8730-541aac047e81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.154571 Aug 24 04:56:14.718017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 131/281] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:14 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:15.737500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-935222e2-dfb4-4e3e-8fb0-fc6d9c6bdeed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:15.738199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-935222e2-dfb4-4e3e-8fb0-fc6d9c6bdeed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:15.744144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935222e2-dfb4-4e3e-8fb0-fc6d9c6bdeed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:15.744624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935222e2-dfb4-4e3e-8fb0-fc6d9c6bdeed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:15.745056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935222e2-dfb4-4e3e-8fb0-fc6d9c6bdeed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:15.745769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935222e2-dfb4-4e3e-8fb0-fc6d9c6bdeed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:15.746212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935222e2-dfb4-4e3e-8fb0-fc6d9c6bdeed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:15.746649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935222e2-dfb4-4e3e-8fb0-fc6d9c6bdeed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:15.897476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-935222e2-dfb4-4e3e-8fb0-fc6d9c6bdeed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:15.905233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-935222e2-dfb4-4e3e-8fb0-fc6d9c6bdeed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.171745 Aug 24 04:56:15.905907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 151/282] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:15 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:16.926893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-24013e22-52ae-4959-88d5-fff49f87231a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:16.927708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-24013e22-52ae-4959-88d5-fff49f87231a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:16.936140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24013e22-52ae-4959-88d5-fff49f87231a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:16.936601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24013e22-52ae-4959-88d5-fff49f87231a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:16.937030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24013e22-52ae-4959-88d5-fff49f87231a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:16.937710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24013e22-52ae-4959-88d5-fff49f87231a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:16.938155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24013e22-52ae-4959-88d5-fff49f87231a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:16.938572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24013e22-52ae-4959-88d5-fff49f87231a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:17.065898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-24013e22-52ae-4959-88d5-fff49f87231a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:17.074303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-24013e22-52ae-4959-88d5-fff49f87231a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.151313 Aug 24 04:56:17.074977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 132/283] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:16 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:18.095146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2e1e45c2-fcee-43eb-b10e-8abb3c0402bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:18.095745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2e1e45c2-fcee-43eb-b10e-8abb3c0402bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:18.102478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e1e45c2-fcee-43eb-b10e-8abb3c0402bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:18.102976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e1e45c2-fcee-43eb-b10e-8abb3c0402bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:18.103403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e1e45c2-fcee-43eb-b10e-8abb3c0402bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:18.104068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e1e45c2-fcee-43eb-b10e-8abb3c0402bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:18.104510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e1e45c2-fcee-43eb-b10e-8abb3c0402bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:18.104918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e1e45c2-fcee-43eb-b10e-8abb3c0402bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:18.236146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2e1e45c2-fcee-43eb-b10e-8abb3c0402bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:18.243717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2e1e45c2-fcee-43eb-b10e-8abb3c0402bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.152384 Aug 24 04:56:18.244276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 152/284] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:18 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:19.264804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d8f15a4e-972c-4e50-9bda-eea3618717ec tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:19.265442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d8f15a4e-972c-4e50-9bda-eea3618717ec tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:19.272493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8f15a4e-972c-4e50-9bda-eea3618717ec tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:19.272968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8f15a4e-972c-4e50-9bda-eea3618717ec tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:19.273398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8f15a4e-972c-4e50-9bda-eea3618717ec tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:19.274082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8f15a4e-972c-4e50-9bda-eea3618717ec tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:19.274528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8f15a4e-972c-4e50-9bda-eea3618717ec tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:19.274969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8f15a4e-972c-4e50-9bda-eea3618717ec tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:19.404009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d8f15a4e-972c-4e50-9bda-eea3618717ec tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:19.411894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d8f15a4e-972c-4e50-9bda-eea3618717ec tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.150941 Aug 24 04:56:19.412457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 133/285] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:19 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:20.433383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-813d7a33-0603-47ca-9b51-a5ab5c33a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:20.433897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-813d7a33-0603-47ca-9b51-a5ab5c33a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:20.439824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-813d7a33-0603-47ca-9b51-a5ab5c33a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:20.440296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-813d7a33-0603-47ca-9b51-a5ab5c33a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:20.440763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-813d7a33-0603-47ca-9b51-a5ab5c33a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:20.441442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-813d7a33-0603-47ca-9b51-a5ab5c33a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:20.441888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-813d7a33-0603-47ca-9b51-a5ab5c33a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:20.442302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-813d7a33-0603-47ca-9b51-a5ab5c33a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:20.571378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-813d7a33-0603-47ca-9b51-a5ab5c33a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:20.579134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-813d7a33-0603-47ca-9b51-a5ab5c33a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.149603 Aug 24 04:56:20.579694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 153/286] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:20 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:21.600484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9aa63902-a394-4f47-860d-e6c7968af60f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:21.601080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9aa63902-a394-4f47-860d-e6c7968af60f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:21.607402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9aa63902-a394-4f47-860d-e6c7968af60f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:21.607872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9aa63902-a394-4f47-860d-e6c7968af60f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:21.608293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9aa63902-a394-4f47-860d-e6c7968af60f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:21.608966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9aa63902-a394-4f47-860d-e6c7968af60f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:21.609404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9aa63902-a394-4f47-860d-e6c7968af60f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:21.609818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9aa63902-a394-4f47-860d-e6c7968af60f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:21.743405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9aa63902-a394-4f47-860d-e6c7968af60f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:21.751133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9aa63902-a394-4f47-860d-e6c7968af60f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.154442 Aug 24 04:56:21.751693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 134/287] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:21 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:22.772688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a4c77ad5-8c6d-46d3-8464-749e24c5a43e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:22.773287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a4c77ad5-8c6d-46d3-8464-749e24c5a43e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:22.779148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4c77ad5-8c6d-46d3-8464-749e24c5a43e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:22.779647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4c77ad5-8c6d-46d3-8464-749e24c5a43e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:22.780074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4c77ad5-8c6d-46d3-8464-749e24c5a43e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:22.780740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4c77ad5-8c6d-46d3-8464-749e24c5a43e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:22.781181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4c77ad5-8c6d-46d3-8464-749e24c5a43e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:22.781592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4c77ad5-8c6d-46d3-8464-749e24c5a43e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:22.910120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a4c77ad5-8c6d-46d3-8464-749e24c5a43e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:22.917964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a4c77ad5-8c6d-46d3-8464-749e24c5a43e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.149824 Aug 24 04:56:22.918529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 154/288] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:22 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:23.939823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f8ce3c16-6e0b-4b78-a71c-3667107d0d9f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:23.940350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f8ce3c16-6e0b-4b78-a71c-3667107d0d9f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:23.950256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ce3c16-6e0b-4b78-a71c-3667107d0d9f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:23.950769 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ce3c16-6e0b-4b78-a71c-3667107d0d9f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:23.951209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ce3c16-6e0b-4b78-a71c-3667107d0d9f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:23.953401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ce3c16-6e0b-4b78-a71c-3667107d0d9f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:23.953401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ce3c16-6e0b-4b78-a71c-3667107d0d9f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:23.953401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ce3c16-6e0b-4b78-a71c-3667107d0d9f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:24.238187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f8ce3c16-6e0b-4b78-a71c-3667107d0d9f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:24.249969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f8ce3c16-6e0b-4b78-a71c-3667107d0d9f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.314131 Aug 24 04:56:24.250660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 135/289] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:23 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:25.271582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d3179029-90a4-4c6f-87fa-8b6746229424 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:25.272217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d3179029-90a4-4c6f-87fa-8b6746229424 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:25.278287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3179029-90a4-4c6f-87fa-8b6746229424 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:25.278804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3179029-90a4-4c6f-87fa-8b6746229424 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:25.279242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3179029-90a4-4c6f-87fa-8b6746229424 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:25.279926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3179029-90a4-4c6f-87fa-8b6746229424 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:25.280375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3179029-90a4-4c6f-87fa-8b6746229424 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:25.280795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3179029-90a4-4c6f-87fa-8b6746229424 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:25.407200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d3179029-90a4-4c6f-87fa-8b6746229424 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:25.415424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d3179029-90a4-4c6f-87fa-8b6746229424 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.147829 Aug 24 04:56:25.415987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 155/290] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:25 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:26.437019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ac14fe20-1068-4e1a-8346-2e358316986e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:26.437689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ac14fe20-1068-4e1a-8346-2e358316986e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:26.444629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac14fe20-1068-4e1a-8346-2e358316986e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:26.445109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac14fe20-1068-4e1a-8346-2e358316986e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:26.445539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac14fe20-1068-4e1a-8346-2e358316986e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:26.446213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac14fe20-1068-4e1a-8346-2e358316986e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:26.446659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac14fe20-1068-4e1a-8346-2e358316986e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:26.447104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac14fe20-1068-4e1a-8346-2e358316986e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:26.573303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ac14fe20-1068-4e1a-8346-2e358316986e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:26.583895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ac14fe20-1068-4e1a-8346-2e358316986e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.151166 Aug 24 04:56:26.584476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 136/291] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:26 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:27.607176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-171b92fc-e148-4b06-a69a-e12ffdb4fc2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:27.607767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-171b92fc-e148-4b06-a69a-e12ffdb4fc2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:27.614265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-171b92fc-e148-4b06-a69a-e12ffdb4fc2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:27.614788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-171b92fc-e148-4b06-a69a-e12ffdb4fc2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:27.615224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-171b92fc-e148-4b06-a69a-e12ffdb4fc2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:27.615899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-171b92fc-e148-4b06-a69a-e12ffdb4fc2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:27.616352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-171b92fc-e148-4b06-a69a-e12ffdb4fc2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:27.616772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-171b92fc-e148-4b06-a69a-e12ffdb4fc2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:27.747491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-171b92fc-e148-4b06-a69a-e12ffdb4fc2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:27.757152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-171b92fc-e148-4b06-a69a-e12ffdb4fc2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.152589 Aug 24 04:56:27.757152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 156/292] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:27 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:28.777066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1dc9b802-5848-4953-bd4a-9f528f590425 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:28.777683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1dc9b802-5848-4953-bd4a-9f528f590425 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:28.784231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1dc9b802-5848-4953-bd4a-9f528f590425 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:28.784701 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1dc9b802-5848-4953-bd4a-9f528f590425 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:28.785121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1dc9b802-5848-4953-bd4a-9f528f590425 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:28.785906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1dc9b802-5848-4953-bd4a-9f528f590425 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:28.786347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1dc9b802-5848-4953-bd4a-9f528f590425 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:28.786776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1dc9b802-5848-4953-bd4a-9f528f590425 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:28.789368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:28.919480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1dc9b802-5848-4953-bd4a-9f528f590425 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:28.927509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1dc9b802-5848-4953-bd4a-9f528f590425 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.154241 Aug 24 04:56:28.928084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 137/293] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:28 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:29.953628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8db73e20-2860-4409-ad9a-f57c2e9b1013 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:29.954206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8db73e20-2860-4409-ad9a-f57c2e9b1013 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:29.960882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8db73e20-2860-4409-ad9a-f57c2e9b1013 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:29.961357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8db73e20-2860-4409-ad9a-f57c2e9b1013 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:29.961783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8db73e20-2860-4409-ad9a-f57c2e9b1013 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:29.962451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8db73e20-2860-4409-ad9a-f57c2e9b1013 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:29.962916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8db73e20-2860-4409-ad9a-f57c2e9b1013 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:29.963331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8db73e20-2860-4409-ad9a-f57c2e9b1013 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:30.091868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8db73e20-2860-4409-ad9a-f57c2e9b1013 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:30.099594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8db73e20-2860-4409-ad9a-f57c2e9b1013 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.149801 Aug 24 04:56:30.100153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 157/294] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:29 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:31.120153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-621f337d-b634-4ac1-ae8c-af64817f57f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:31.120790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-621f337d-b634-4ac1-ae8c-af64817f57f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:31.127260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-621f337d-b634-4ac1-ae8c-af64817f57f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:31.127729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-621f337d-b634-4ac1-ae8c-af64817f57f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:31.128154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-621f337d-b634-4ac1-ae8c-af64817f57f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:31.128827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-621f337d-b634-4ac1-ae8c-af64817f57f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:31.129776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-621f337d-b634-4ac1-ae8c-af64817f57f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:31.130202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-621f337d-b634-4ac1-ae8c-af64817f57f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:31.262711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-621f337d-b634-4ac1-ae8c-af64817f57f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:31.271329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-621f337d-b634-4ac1-ae8c-af64817f57f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.155003 Aug 24 04:56:31.271900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 138/295] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:31 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:31.837658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-748786074", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-776612737", "security_groups": [{"name": "tempest-secgroup-smoke-320450797"}], "block_device_mapping_v2": [{"uuid": "48414fe5-1080-49c5-9c4f-bc610759f223", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fe1b453b-00ae-410e-b60c-af6b5d416c32"}]}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:31.964916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.network.neutron [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] validate_networks() for [('fe1b453b-00ae-410e-b60c-af6b5d416c32', None, None, None, None, None)] {{(pid=120558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:56:32.293113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7a385cd5-a072-4539-8a9e-ebd7f88cee89 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:32.294312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7a385cd5-a072-4539-8a9e-ebd7f88cee89 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:32.301714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a385cd5-a072-4539-8a9e-ebd7f88cee89 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:32.302504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a385cd5-a072-4539-8a9e-ebd7f88cee89 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:32.303131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a385cd5-a072-4539-8a9e-ebd7f88cee89 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:32.303838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a385cd5-a072-4539-8a9e-ebd7f88cee89 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:32.304297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a385cd5-a072-4539-8a9e-ebd7f88cee89 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:32.304718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a385cd5-a072-4539-8a9e-ebd7f88cee89 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:32.409406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Flavor limits 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:56:32.409828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Image limits 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:56:32.410871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Flavor pref 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:56:32.411283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Image pref 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:56:32.411690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:56:32.421233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:32.421726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:32.422160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:32.422972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:32.423603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:32.424187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:32.433267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:32.446470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Getting quotas for project aaa96f5af1de4cf5a59cdca9c785db52. Resources: {'instances', 'ram', 'cores'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:56:32.450569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Getting quotas for user 81f88a5d0ffe4c5abd85cdfc19d18694 and project aaa96f5af1de4cf5a59cdca9c785db52. Resources: {'instances', 'ram', 'cores'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:56:32.465899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7a385cd5-a072-4539-8a9e-ebd7f88cee89 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:32.475454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7a385cd5-a072-4539-8a9e-ebd7f88cee89 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.186526 Aug 24 04:56:32.487158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 139/296] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:32 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:32.523381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Going to run 1 instances... {{(pid=120558) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:56:32.525840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48414fe5-1080-49c5-9c4f-bc610759f223',volume_size=None,volume_type=None)] {{(pid=120558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:56:32.666118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c7aaeefa-d1e8-4f9e-9298-55e79b42816c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.832412 Aug 24 04:56:32.670772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 158/297] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:56:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:56:32.678847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-db721902-c9cc-4254-9383-0405bc5c7451 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:32.679437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-db721902-c9cc-4254-9383-0405bc5c7451 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:32.682550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=28 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:32.754926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-db721902-c9cc-4254-9383-0405bc5c7451 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:32.761857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-db721902-c9cc-4254-9383-0405bc5c7451 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1093 microversion: 2.1 time: 0.087574 Aug 24 04:56:32.762428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 140/298] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:32 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:33.498015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cf83597c-fb0a-47d2-b0e6-41151b664a31 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:33.498615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cf83597c-fb0a-47d2-b0e6-41151b664a31 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:33.505249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf83597c-fb0a-47d2-b0e6-41151b664a31 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:33.505720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf83597c-fb0a-47d2-b0e6-41151b664a31 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:33.506142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf83597c-fb0a-47d2-b0e6-41151b664a31 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:33.506852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf83597c-fb0a-47d2-b0e6-41151b664a31 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:33.507296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf83597c-fb0a-47d2-b0e6-41151b664a31 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:33.507709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf83597c-fb0a-47d2-b0e6-41151b664a31 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:33.642966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cf83597c-fb0a-47d2-b0e6-41151b664a31 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:33.650791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cf83597c-fb0a-47d2-b0e6-41151b664a31 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.156667 Aug 24 04:56:33.651381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 159/299] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:33 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:33.782876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7a8d7524-e584-460a-b230-61b2519064fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:33.783489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7a8d7524-e584-460a-b230-61b2519064fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:33.790563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8d7524-e584-460a-b230-61b2519064fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:33.791075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8d7524-e584-460a-b230-61b2519064fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:33.791511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8d7524-e584-460a-b230-61b2519064fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:33.792216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8d7524-e584-460a-b230-61b2519064fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:33.792653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8d7524-e584-460a-b230-61b2519064fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:33.793078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a8d7524-e584-460a-b230-61b2519064fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:33.858793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7a8d7524-e584-460a-b230-61b2519064fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:33.868655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7a8d7524-e584-460a-b230-61b2519064fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1143 microversion: 2.1 time: 0.089639 Aug 24 04:56:33.869222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 141/300] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:33 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:34.672273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-84594b8f-3faa-42c0-be1e-61e17e8b18eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:34.673197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-84594b8f-3faa-42c0-be1e-61e17e8b18eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:34.676940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:34.681196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84594b8f-3faa-42c0-be1e-61e17e8b18eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:34.681857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84594b8f-3faa-42c0-be1e-61e17e8b18eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:34.682418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84594b8f-3faa-42c0-be1e-61e17e8b18eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:34.683067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84594b8f-3faa-42c0-be1e-61e17e8b18eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:34.683741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84594b8f-3faa-42c0-be1e-61e17e8b18eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:34.684167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84594b8f-3faa-42c0-be1e-61e17e8b18eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:34.818214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-84594b8f-3faa-42c0-be1e-61e17e8b18eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:34.825919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-84594b8f-3faa-42c0-be1e-61e17e8b18eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.158140 Aug 24 04:56:34.826480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 160/301] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:34 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:34.892053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2b51a04a-c462-4934-beaa-1abd127d9e40 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:34.892444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2b51a04a-c462-4934-beaa-1abd127d9e40 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:34.899127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b51a04a-c462-4934-beaa-1abd127d9e40 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:34.899613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b51a04a-c462-4934-beaa-1abd127d9e40 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:34.900043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b51a04a-c462-4934-beaa-1abd127d9e40 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:34.900731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b51a04a-c462-4934-beaa-1abd127d9e40 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:34.901182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b51a04a-c462-4934-beaa-1abd127d9e40 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:34.901600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b51a04a-c462-4934-beaa-1abd127d9e40 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:34.967423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2b51a04a-c462-4934-beaa-1abd127d9e40 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:34.975656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2b51a04a-c462-4934-beaa-1abd127d9e40 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1143 microversion: 2.1 time: 0.087965 Aug 24 04:56:34.976248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 142/302] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:34 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:35.846453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-530c629f-218e-40d7-9e1a-e18217e88aed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:35.847018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-530c629f-218e-40d7-9e1a-e18217e88aed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:35.852970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-530c629f-218e-40d7-9e1a-e18217e88aed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:35.853446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-530c629f-218e-40d7-9e1a-e18217e88aed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:35.853883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-530c629f-218e-40d7-9e1a-e18217e88aed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:35.854560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-530c629f-218e-40d7-9e1a-e18217e88aed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:35.855072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-530c629f-218e-40d7-9e1a-e18217e88aed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:35.855494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-530c629f-218e-40d7-9e1a-e18217e88aed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:35.986474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-530c629f-218e-40d7-9e1a-e18217e88aed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:35.994988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-530c629f-218e-40d7-9e1a-e18217e88aed tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.152473 Aug 24 04:56:35.995590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 161/303] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:35 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:35.996397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a4498a83-6a10-4a6b-9742-e1852255648c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:35.997012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a4498a83-6a10-4a6b-9742-e1852255648c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:36.003341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4498a83-6a10-4a6b-9742-e1852255648c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:36.003817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4498a83-6a10-4a6b-9742-e1852255648c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:36.004830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4498a83-6a10-4a6b-9742-e1852255648c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:36.005540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4498a83-6a10-4a6b-9742-e1852255648c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:36.006007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4498a83-6a10-4a6b-9742-e1852255648c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:36.006413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4498a83-6a10-4a6b-9742-e1852255648c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:36.065978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a4498a83-6a10-4a6b-9742-e1852255648c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:36.074566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a4498a83-6a10-4a6b-9742-e1852255648c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1135 microversion: 2.1 time: 0.082076 Aug 24 04:56:36.075555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 143/304] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:35 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1135 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:37.016198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-380cb932-6611-49ed-b930-983807f6a9a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:37.016807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-380cb932-6611-49ed-b930-983807f6a9a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:37.023593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380cb932-6611-49ed-b930-983807f6a9a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:37.024190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380cb932-6611-49ed-b930-983807f6a9a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:37.024493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380cb932-6611-49ed-b930-983807f6a9a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:37.025175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380cb932-6611-49ed-b930-983807f6a9a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:37.025616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380cb932-6611-49ed-b930-983807f6a9a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:37.026027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380cb932-6611-49ed-b930-983807f6a9a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:37.097312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a4b7516b-10e6-4713-8bdf-26df0852b6b7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:37.098561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a4b7516b-10e6-4713-8bdf-26df0852b6b7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:37.104559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4b7516b-10e6-4713-8bdf-26df0852b6b7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:37.105044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4b7516b-10e6-4713-8bdf-26df0852b6b7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:37.105476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4b7516b-10e6-4713-8bdf-26df0852b6b7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:37.106160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4b7516b-10e6-4713-8bdf-26df0852b6b7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:37.106610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4b7516b-10e6-4713-8bdf-26df0852b6b7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:37.107069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4b7516b-10e6-4713-8bdf-26df0852b6b7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:37.162302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-380cb932-6611-49ed-b930-983807f6a9a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:37.171212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-380cb932-6611-49ed-b930-983807f6a9a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1501 microversion: 2.1 time: 0.158778 Aug 24 04:56:37.171642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a4b7516b-10e6-4713-8bdf-26df0852b6b7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:37.171805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 162/305] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:37 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:37.180498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a4b7516b-10e6-4713-8bdf-26df0852b6b7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1199 microversion: 2.1 time: 0.087041 Aug 24 04:56:37.181103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 144/306] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:37 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:37.200225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61b799a7-787f-4bee-b8b2-25fdde6d7cfa"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:37.202875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:37.208799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:37.209280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:37.209828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:37.210409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:37.210861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:37.211296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:37.234899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] HTTP exception thrown: Cannot 'attach_volume' instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 while it is in vm_state rescued Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Request method failure captured: Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: POST /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89/os-volume_attachments HTTP/1.1 Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 74 Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa7vgEWxIH4xlLamu9K66ml8YuLDEp_YQA2qs7UtL-6Z69FWBvRKKNvJInfMymaPcGe2WBDYhavc6QIMajs2OFq6W5mcvXNzykLs7D4t7A3-UF_eNDqrK1uKmrHM8wulHTZatXbcXJ79hUK7zHBY0hq-oxViEgUTqYJZWbuPL5XRyfU Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 04:56:37.238401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3c309287c4964e60a66398d9841b9c29", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 246605916c884dfab9aa75297e358d6f Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {"volumeAttachment": {"volumeId": "61b799a7-787f-4bee-b8b2-25fdde6d7cfa"}} Aug 24 04:56:37.240748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Cannot 'attach_volume' instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 while it is in vm_state rescued Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'server_id': 'dc16ffe9-0180-4a64-b937-bfd52cacbc89', 'body': {'volumeAttachment': {'volumeId': '61b799a7-787f-4bee-b8b2-25fdde6d7cfa'}}} Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:56:37.241678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 while it is in vm_state rescued Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:56:37.243344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:56:37.244843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:56:37.244843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:56:37.244843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 while it is in vm_state rescued Aug 24 04:56:37.244843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 04:56:37.244843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Returning 409 to user: Cannot 'attach_volume' instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 while it is in vm_state rescued {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:56:37.244843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1fc68517-1395-4b2c-bfe8-94173c7123cf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044766 Aug 24 04:56:37.244843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 163/307] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 04:56:37 2022] POST /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 04:56:37.250575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7697006d-4f24-4d9f-9de9-a0244cb8286b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:37.251066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7697006d-4f24-4d9f-9de9-a0244cb8286b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:37.257257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7697006d-4f24-4d9f-9de9-a0244cb8286b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:37.257735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7697006d-4f24-4d9f-9de9-a0244cb8286b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:37.258160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7697006d-4f24-4d9f-9de9-a0244cb8286b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:37.258874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7697006d-4f24-4d9f-9de9-a0244cb8286b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:37.259322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7697006d-4f24-4d9f-9de9-a0244cb8286b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:37.259736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7697006d-4f24-4d9f-9de9-a0244cb8286b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:37.336033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7697006d-4f24-4d9f-9de9-a0244cb8286b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89/action" status: 202 len: 0 microversion: 2.1 time: 0.089107 Aug 24 04:56:37.336663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 145/308] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 04:56:37 2022] POST /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:56:37.345767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1c752caa-b0bd-4a38-89e7-c7450285bed5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:37.347364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1c752caa-b0bd-4a38-89e7-c7450285bed5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:37.356443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c752caa-b0bd-4a38-89e7-c7450285bed5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:37.356940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c752caa-b0bd-4a38-89e7-c7450285bed5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:37.357552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c752caa-b0bd-4a38-89e7-c7450285bed5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:37.358325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c752caa-b0bd-4a38-89e7-c7450285bed5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:37.359373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c752caa-b0bd-4a38-89e7-c7450285bed5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:37.360029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c752caa-b0bd-4a38-89e7-c7450285bed5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:37.821899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1c752caa-b0bd-4a38-89e7-c7450285bed5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:37.838850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1c752caa-b0bd-4a38-89e7-c7450285bed5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1509 microversion: 2.1 time: 0.496918 Aug 24 04:56:37.842084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 164/309] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:37 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1509 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:37.922498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-762397811", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452"}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:37.978574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] validate_networks() for None {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:56:38.214127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4dbd11eb-89db-4cae-b3da-6224d11f5818 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:38.216685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4dbd11eb-89db-4cae-b3da-6224d11f5818 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:38.226737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dbd11eb-89db-4cae-b3da-6224d11f5818 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:38.227491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dbd11eb-89db-4cae-b3da-6224d11f5818 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:38.227923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dbd11eb-89db-4cae-b3da-6224d11f5818 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:38.228684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dbd11eb-89db-4cae-b3da-6224d11f5818 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:38.229126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dbd11eb-89db-4cae-b3da-6224d11f5818 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:38.229714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dbd11eb-89db-4cae-b3da-6224d11f5818 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:38.398894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4dbd11eb-89db-4cae-b3da-6224d11f5818 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:38.412880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4dbd11eb-89db-4cae-b3da-6224d11f5818 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1276 microversion: 2.1 time: 0.209052 Aug 24 04:56:38.413918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 165/310] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:38 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:38.429139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:56:38.429687 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:56:38.430165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:56:38.430580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:56:38.431167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:56:38.446624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:38.449683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:38.451613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:38.452542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:38.453130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:38.454277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:38.497178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Getting quotas for project 1aad0244ef9c4fbe8877f26566c927a8. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:56:38.502908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Getting quotas for user abf7f64dfa824aa5915d040864d8101d and project 1aad0244ef9c4fbe8877f26566c927a8. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:56:38.522034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:56:38.525059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:56:38.591384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7ae41161-9268-4a07-a82f-b7608e9a4dd6 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.673647 Aug 24 04:56:38.592594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 146/311] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:56:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 676 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:56:38.604844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ffc8b72c-3d9b-4905-b20c-035b4167d7cd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:38.605630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ffc8b72c-3d9b-4905-b20c-035b4167d7cd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:38.677572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ffc8b72c-3d9b-4905-b20c-035b4167d7cd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:38.687324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ffc8b72c-3d9b-4905-b20c-035b4167d7cd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1214 microversion: 2.1 time: 0.087565 Aug 24 04:56:38.688671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 166/312] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:38 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:38.862002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b45dab94-ee67-4632-834a-67a2e843d9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:38.862544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b45dab94-ee67-4632-834a-67a2e843d9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:38.869546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b45dab94-ee67-4632-834a-67a2e843d9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:38.870028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b45dab94-ee67-4632-834a-67a2e843d9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:38.870463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b45dab94-ee67-4632-834a-67a2e843d9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:38.871223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b45dab94-ee67-4632-834a-67a2e843d9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:38.871683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b45dab94-ee67-4632-834a-67a2e843d9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:38.872104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b45dab94-ee67-4632-834a-67a2e843d9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:39.119506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b45dab94-ee67-4632-834a-67a2e843d9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:39.127847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b45dab94-ee67-4632-834a-67a2e843d9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1509 microversion: 2.1 time: 0.270212 Aug 24 04:56:39.128514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 147/313] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:38 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:39.434288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-49bf933d-ccba-4252-a259-d8b4125790c1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:39.434868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-49bf933d-ccba-4252-a259-d8b4125790c1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:39.440683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49bf933d-ccba-4252-a259-d8b4125790c1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:39.441170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49bf933d-ccba-4252-a259-d8b4125790c1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:39.442121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49bf933d-ccba-4252-a259-d8b4125790c1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:39.442829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49bf933d-ccba-4252-a259-d8b4125790c1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:39.443282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49bf933d-ccba-4252-a259-d8b4125790c1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:39.443703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49bf933d-ccba-4252-a259-d8b4125790c1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:39.496149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-67efffa9-1909-47cc-b64c-2bceca8574e3 req-d45fc361-5d59-4a25-b0d1-73d22aaf884a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf50e90-6712-4e3e-b813-653bfe69d460", "tag": "ec1c9364-3199-41cb-89a1-3a76d09fecc6"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:39.506419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-67efffa9-1909-47cc-b64c-2bceca8574e3 req-d45fc361-5d59-4a25-b0d1-73d22aaf884a service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:39.506930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-67efffa9-1909-47cc-b64c-2bceca8574e3 req-d45fc361-5d59-4a25-b0d1-73d22aaf884a service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:39.507359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-67efffa9-1909-47cc-b64c-2bceca8574e3 req-d45fc361-5d59-4a25-b0d1-73d22aaf884a service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:39.519172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-67efffa9-1909-47cc-b64c-2bceca8574e3 req-d45fc361-5d59-4a25-b0d1-73d22aaf884a service nova] Creating event network-changed:ec1c9364-3199-41cb-89a1-3a76d09fecc6 for instance 5bf50e90-6712-4e3e-b813-653bfe69d460 on hv-cinder-85426 Aug 24 04:56:39.525410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-67efffa9-1909-47cc-b64c-2bceca8574e3 req-d45fc361-5d59-4a25-b0d1-73d22aaf884a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032780 Aug 24 04:56:39.525949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 148/314] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:56:39.578364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-49bf933d-ccba-4252-a259-d8b4125790c1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:39.586054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-49bf933d-ccba-4252-a259-d8b4125790c1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1276 microversion: 2.1 time: 0.155776 Aug 24 04:56:39.586615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 167/315] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:39 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:39.708821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-edbca3e9-eed5-4881-966a-40c4ea4df35d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:39.709623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-edbca3e9-eed5-4881-966a-40c4ea4df35d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:39.715826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-edbca3e9-eed5-4881-966a-40c4ea4df35d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:39.716298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-edbca3e9-eed5-4881-966a-40c4ea4df35d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:39.716722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-edbca3e9-eed5-4881-966a-40c4ea4df35d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:39.717392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-edbca3e9-eed5-4881-966a-40c4ea4df35d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:39.717833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-edbca3e9-eed5-4881-966a-40c4ea4df35d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:39.718243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-edbca3e9-eed5-4881-966a-40c4ea4df35d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:39.784637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-edbca3e9-eed5-4881-966a-40c4ea4df35d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:39.793294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-edbca3e9-eed5-4881-966a-40c4ea4df35d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1218 microversion: 2.1 time: 0.088929 Aug 24 04:56:39.794242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 149/316] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:39 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:40.148724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b25568ae-bee2-4682-9dd6-78abadbd37fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:40.149318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b25568ae-bee2-4682-9dd6-78abadbd37fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:40.155287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b25568ae-bee2-4682-9dd6-78abadbd37fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:40.155761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b25568ae-bee2-4682-9dd6-78abadbd37fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:40.156192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b25568ae-bee2-4682-9dd6-78abadbd37fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:40.156865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b25568ae-bee2-4682-9dd6-78abadbd37fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:40.157315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b25568ae-bee2-4682-9dd6-78abadbd37fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:40.157738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b25568ae-bee2-4682-9dd6-78abadbd37fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:40.287834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b25568ae-bee2-4682-9dd6-78abadbd37fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:40.295801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b25568ae-bee2-4682-9dd6-78abadbd37fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1509 microversion: 2.1 time: 0.150981 Aug 24 04:56:40.296358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 168/317] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:40 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:40.606581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-623be740-e7c5-43a1-927e-d876081f5ec7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:40.607232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-623be740-e7c5-43a1-927e-d876081f5ec7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:40.614608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623be740-e7c5-43a1-927e-d876081f5ec7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:40.615133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623be740-e7c5-43a1-927e-d876081f5ec7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:40.615564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623be740-e7c5-43a1-927e-d876081f5ec7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:40.616236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623be740-e7c5-43a1-927e-d876081f5ec7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:40.616682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623be740-e7c5-43a1-927e-d876081f5ec7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:40.617094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623be740-e7c5-43a1-927e-d876081f5ec7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:40.750529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-623be740-e7c5-43a1-927e-d876081f5ec7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:40.758808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-623be740-e7c5-43a1-927e-d876081f5ec7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1276 microversion: 2.1 time: 0.156046 Aug 24 04:56:40.759363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 150/318] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:40 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1276 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:40.814404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-85c0e064-cba0-401f-8192-3a8bbd83efc0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:40.815042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-85c0e064-cba0-401f-8192-3a8bbd83efc0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:40.820888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85c0e064-cba0-401f-8192-3a8bbd83efc0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:40.821366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85c0e064-cba0-401f-8192-3a8bbd83efc0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:40.821797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85c0e064-cba0-401f-8192-3a8bbd83efc0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:40.822509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85c0e064-cba0-401f-8192-3a8bbd83efc0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:40.822991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85c0e064-cba0-401f-8192-3a8bbd83efc0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:40.823410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85c0e064-cba0-401f-8192-3a8bbd83efc0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:40.883903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-85c0e064-cba0-401f-8192-3a8bbd83efc0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:40.891414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-85c0e064-cba0-401f-8192-3a8bbd83efc0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1218 microversion: 2.1 time: 0.080872 Aug 24 04:56:40.891966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 169/319] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:40 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:41.317779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-69aa71b0-5f6f-46c8-a27d-a883a57612c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:41.318381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-69aa71b0-5f6f-46c8-a27d-a883a57612c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:41.324472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aa71b0-5f6f-46c8-a27d-a883a57612c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:41.324945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aa71b0-5f6f-46c8-a27d-a883a57612c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:41.325380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aa71b0-5f6f-46c8-a27d-a883a57612c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:41.326066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aa71b0-5f6f-46c8-a27d-a883a57612c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:41.326575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aa71b0-5f6f-46c8-a27d-a883a57612c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:41.326961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aa71b0-5f6f-46c8-a27d-a883a57612c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:41.462624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-69aa71b0-5f6f-46c8-a27d-a883a57612c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:41.470358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-69aa71b0-5f6f-46c8-a27d-a883a57612c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1509 microversion: 2.1 time: 0.156444 Aug 24 04:56:41.470965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 151/320] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:41 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1509 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:41.778077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-297bbdbe-8e37-47ac-bb5c-17fe02b0de82 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:41.778711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-297bbdbe-8e37-47ac-bb5c-17fe02b0de82 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:41.784886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-297bbdbe-8e37-47ac-bb5c-17fe02b0de82 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:41.785512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-297bbdbe-8e37-47ac-bb5c-17fe02b0de82 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:41.785964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-297bbdbe-8e37-47ac-bb5c-17fe02b0de82 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:41.786652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-297bbdbe-8e37-47ac-bb5c-17fe02b0de82 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:41.787130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-297bbdbe-8e37-47ac-bb5c-17fe02b0de82 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:41.787552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-297bbdbe-8e37-47ac-bb5c-17fe02b0de82 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:41.916088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a0ac86dd-a4c7-4576-8f5a-97842dc91d25 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:41.916806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a0ac86dd-a4c7-4576-8f5a-97842dc91d25 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:41.923610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0ac86dd-a4c7-4576-8f5a-97842dc91d25 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:41.924160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0ac86dd-a4c7-4576-8f5a-97842dc91d25 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:41.924595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0ac86dd-a4c7-4576-8f5a-97842dc91d25 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:41.925286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0ac86dd-a4c7-4576-8f5a-97842dc91d25 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:41.925789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0ac86dd-a4c7-4576-8f5a-97842dc91d25 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:41.926400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0ac86dd-a4c7-4576-8f5a-97842dc91d25 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:41.929713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-297bbdbe-8e37-47ac-bb5c-17fe02b0de82 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:41.937602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-297bbdbe-8e37-47ac-bb5c-17fe02b0de82 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1276 microversion: 2.1 time: 0.163219 Aug 24 04:56:41.938173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 170/321] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:41 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:42.005782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a0ac86dd-a4c7-4576-8f5a-97842dc91d25 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:42.014899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a0ac86dd-a4c7-4576-8f5a-97842dc91d25 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1218 microversion: 2.1 time: 0.102263 Aug 24 04:56:42.016001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 152/322] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:41 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:42.491443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9e704367-7d0b-491a-a410-36f5fa94e344 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:42.492075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9e704367-7d0b-491a-a410-36f5fa94e344 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:42.493901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:42.499624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e704367-7d0b-491a-a410-36f5fa94e344 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:42.500108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e704367-7d0b-491a-a410-36f5fa94e344 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:42.500544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e704367-7d0b-491a-a410-36f5fa94e344 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:42.501250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e704367-7d0b-491a-a410-36f5fa94e344 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:42.501713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e704367-7d0b-491a-a410-36f5fa94e344 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:42.502139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e704367-7d0b-491a-a410-36f5fa94e344 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:42.632713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9e704367-7d0b-491a-a410-36f5fa94e344 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:42.640421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9e704367-7d0b-491a-a410-36f5fa94e344 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1509 microversion: 2.1 time: 0.152911 Aug 24 04:56:42.640978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 171/323] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:42 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:42.957920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-90586746-c8f7-45b2-9bd2-265c71963b2a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:42.958532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-90586746-c8f7-45b2-9bd2-265c71963b2a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:42.965052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90586746-c8f7-45b2-9bd2-265c71963b2a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:42.965537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90586746-c8f7-45b2-9bd2-265c71963b2a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:42.965971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90586746-c8f7-45b2-9bd2-265c71963b2a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:42.966662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90586746-c8f7-45b2-9bd2-265c71963b2a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:42.967177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90586746-c8f7-45b2-9bd2-265c71963b2a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:42.967546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90586746-c8f7-45b2-9bd2-265c71963b2a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:43.036786 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fc2f03de-777a-44dd-be63-ca7166552435 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:43.037973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fc2f03de-777a-44dd-be63-ca7166552435 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:43.044204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc2f03de-777a-44dd-be63-ca7166552435 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:43.045310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc2f03de-777a-44dd-be63-ca7166552435 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:43.045762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc2f03de-777a-44dd-be63-ca7166552435 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:43.046462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc2f03de-777a-44dd-be63-ca7166552435 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:43.046933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc2f03de-777a-44dd-be63-ca7166552435 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:43.047360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc2f03de-777a-44dd-be63-ca7166552435 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:43.106875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-90586746-c8f7-45b2-9bd2-265c71963b2a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:43.110647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fc2f03de-777a-44dd-be63-ca7166552435 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:43.117279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-90586746-c8f7-45b2-9bd2-265c71963b2a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1276 microversion: 2.1 time: 0.163717 Aug 24 04:56:43.118314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 153/324] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:42 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1276 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:43.122548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fc2f03de-777a-44dd-be63-ca7166552435 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1266 microversion: 2.1 time: 0.089664 Aug 24 04:56:43.123084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 172/325] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:43 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:43.661852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-272d497a-68ef-4ed5-bd16-8bdefda355b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:43.662451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-272d497a-68ef-4ed5-bd16-8bdefda355b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:43.668370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-272d497a-68ef-4ed5-bd16-8bdefda355b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:43.669110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-272d497a-68ef-4ed5-bd16-8bdefda355b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:43.669542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-272d497a-68ef-4ed5-bd16-8bdefda355b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:43.670220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-272d497a-68ef-4ed5-bd16-8bdefda355b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:43.670667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-272d497a-68ef-4ed5-bd16-8bdefda355b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:43.671108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-272d497a-68ef-4ed5-bd16-8bdefda355b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:43.805057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-272d497a-68ef-4ed5-bd16-8bdefda355b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:43.812721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-272d497a-68ef-4ed5-bd16-8bdefda355b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1509 microversion: 2.1 time: 0.155529 Aug 24 04:56:43.813275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 154/326] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:43 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:44.147228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c064911c-f6ec-4ebb-b522-979aea1f797a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:44.147228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c064911c-f6ec-4ebb-b522-979aea1f797a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:44.148752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-277284eb-a5d5-4c4d-a9c6-e0193dab5528 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:44.149277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-277284eb-a5d5-4c4d-a9c6-e0193dab5528 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:44.153652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c064911c-f6ec-4ebb-b522-979aea1f797a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:44.154136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c064911c-f6ec-4ebb-b522-979aea1f797a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:44.154576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c064911c-f6ec-4ebb-b522-979aea1f797a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:44.155300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c064911c-f6ec-4ebb-b522-979aea1f797a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:44.155750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c064911c-f6ec-4ebb-b522-979aea1f797a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:44.155880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-277284eb-a5d5-4c4d-a9c6-e0193dab5528 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:44.156168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c064911c-f6ec-4ebb-b522-979aea1f797a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:44.156312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-277284eb-a5d5-4c4d-a9c6-e0193dab5528 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:44.156798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-277284eb-a5d5-4c4d-a9c6-e0193dab5528 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:44.157508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-277284eb-a5d5-4c4d-a9c6-e0193dab5528 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:44.157958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-277284eb-a5d5-4c4d-a9c6-e0193dab5528 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:44.158372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-277284eb-a5d5-4c4d-a9c6-e0193dab5528 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:44.161251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:44.225295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c064911c-f6ec-4ebb-b522-979aea1f797a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:44.234385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c064911c-f6ec-4ebb-b522-979aea1f797a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1266 microversion: 2.1 time: 0.093927 Aug 24 04:56:44.234991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 155/327] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:44 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:44.308313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-277284eb-a5d5-4c4d-a9c6-e0193dab5528 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:44.315969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-277284eb-a5d5-4c4d-a9c6-e0193dab5528 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1276 microversion: 2.1 time: 0.181083 Aug 24 04:56:44.317186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 173/328] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:44 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1276 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:44.833598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-27abe544-dd99-433a-8dd9-6b9be243e525 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:44.834198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-27abe544-dd99-433a-8dd9-6b9be243e525 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:44.840209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27abe544-dd99-433a-8dd9-6b9be243e525 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:44.840681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27abe544-dd99-433a-8dd9-6b9be243e525 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:44.841108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27abe544-dd99-433a-8dd9-6b9be243e525 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:44.841783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27abe544-dd99-433a-8dd9-6b9be243e525 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:44.842235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27abe544-dd99-433a-8dd9-6b9be243e525 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:44.842653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27abe544-dd99-433a-8dd9-6b9be243e525 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:45.013717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-27abe544-dd99-433a-8dd9-6b9be243e525 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:45.021672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-27abe544-dd99-433a-8dd9-6b9be243e525 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1515 microversion: 2.1 time: 0.192224 Aug 24 04:56:45.022233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 156/329] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:44 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:45.263512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-23de296d-e5aa-4ed8-bee8-81215bc98e3a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:45.264114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-23de296d-e5aa-4ed8-bee8-81215bc98e3a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:45.271547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23de296d-e5aa-4ed8-bee8-81215bc98e3a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:45.272036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23de296d-e5aa-4ed8-bee8-81215bc98e3a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:45.272461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23de296d-e5aa-4ed8-bee8-81215bc98e3a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:45.273156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23de296d-e5aa-4ed8-bee8-81215bc98e3a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:45.273683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23de296d-e5aa-4ed8-bee8-81215bc98e3a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:45.273992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23de296d-e5aa-4ed8-bee8-81215bc98e3a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:45.343048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-de46500a-a00a-4338-a6fb-aef164027ba6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:45.344705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-de46500a-a00a-4338-a6fb-aef164027ba6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:45.355007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de46500a-a00a-4338-a6fb-aef164027ba6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:45.355903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de46500a-a00a-4338-a6fb-aef164027ba6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:45.356811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de46500a-a00a-4338-a6fb-aef164027ba6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:45.358803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de46500a-a00a-4338-a6fb-aef164027ba6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:45.359517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de46500a-a00a-4338-a6fb-aef164027ba6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:45.360742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de46500a-a00a-4338-a6fb-aef164027ba6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:45.367379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-23de296d-e5aa-4ed8-bee8-81215bc98e3a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:45.377831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-23de296d-e5aa-4ed8-bee8-81215bc98e3a tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1272 microversion: 2.1 time: 0.118197 Aug 24 04:56:45.393664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 174/330] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:45 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:45.542935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-de46500a-a00a-4338-a6fb-aef164027ba6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:45.552066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-de46500a-a00a-4338-a6fb-aef164027ba6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.213249 Aug 24 04:56:45.552639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 157/331] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:45 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:46.401469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ea53a911-337e-4b0a-b9f3-7013ae086ce7 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:46.402645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ea53a911-337e-4b0a-b9f3-7013ae086ce7 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:46.409492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea53a911-337e-4b0a-b9f3-7013ae086ce7 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:46.409797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f0c9dd9f-708f-43d1-a227-b28bc31253eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'create', calling method: .version_select at 0x7f35905f70d0>, body: {"keypair": {"name": "tempest-keypair-1661748740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIuKcjYSRV6X1ZN58qg5+idLYCz/jQSfouJX5NvCBJOi22YQTf8rkFAECFfrSScM2VbsPMXyNdPU0VFRXISfcvuwiccHjCdx1J7iFotMq733au95kXMoxJusjHhfMvTzw=="}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:46.411422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea53a911-337e-4b0a-b9f3-7013ae086ce7 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:46.412645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea53a911-337e-4b0a-b9f3-7013ae086ce7 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:46.413542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea53a911-337e-4b0a-b9f3-7013ae086ce7 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:46.418049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea53a911-337e-4b0a-b9f3-7013ae086ce7 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:46.419133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea53a911-337e-4b0a-b9f3-7013ae086ce7 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:46.430109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-f0c9dd9f-708f-43d1-a227-b28bc31253eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Getting quotas for project 3c309287c4964e60a66398d9841b9c29. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:56:46.435853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-f0c9dd9f-708f-43d1-a227-b28bc31253eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Getting quotas for user 246605916c884dfab9aa75297e358d6f and project 3c309287c4964e60a66398d9841b9c29. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:56:46.471278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f0c9dd9f-708f-43d1-a227-b28bc31253eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063173 Aug 24 04:56:46.483544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 158/332] 10.222.0.97 () {60 vars in 1159 bytes} [Wed Aug 24 04:56:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:56:46.573535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-333c5747-6ded-4cf9-9bd8-c41e7c76b77d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:46.574240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-333c5747-6ded-4cf9-9bd8-c41e7c76b77d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:46.581714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-333c5747-6ded-4cf9-9bd8-c41e7c76b77d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:46.582392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-333c5747-6ded-4cf9-9bd8-c41e7c76b77d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:46.583093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-333c5747-6ded-4cf9-9bd8-c41e7c76b77d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:46.584435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-333c5747-6ded-4cf9-9bd8-c41e7c76b77d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:46.585108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-333c5747-6ded-4cf9-9bd8-c41e7c76b77d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:46.585600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-333c5747-6ded-4cf9-9bd8-c41e7c76b77d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:46.636223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ea53a911-337e-4b0a-b9f3-7013ae086ce7 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:46.644672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ea53a911-337e-4b0a-b9f3-7013ae086ce7 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.246885 Aug 24 04:56:46.645371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 175/333] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:46 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:46.772757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-333c5747-6ded-4cf9-9bd8-c41e7c76b77d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:46.780957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-333c5747-6ded-4cf9-9bd8-c41e7c76b77d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.211257 Aug 24 04:56:46.781724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 159/334] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:46 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:47.614640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-01c39f01-a945-4485-ad1b-18df5e3b262e req-7ae818d4-13a1-4eb5-bfd4-c010f410bcb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416b2fca-770f-4031-b545-db1103ce3144", "tag": "1622e5b0-41e8-4e08-91bc-2ea1780e9143"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:47.637931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-01c39f01-a945-4485-ad1b-18df5e3b262e req-7ae818d4-13a1-4eb5-bfd4-c010f410bcb4 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:47.638416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-01c39f01-a945-4485-ad1b-18df5e3b262e req-7ae818d4-13a1-4eb5-bfd4-c010f410bcb4 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:47.638879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-01c39f01-a945-4485-ad1b-18df5e3b262e req-7ae818d4-13a1-4eb5-bfd4-c010f410bcb4 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:47.666418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2b4e82cb-53e5-45e7-9f94-249796d32e72 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:47.675556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2b4e82cb-53e5-45e7-9f94-249796d32e72 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:47.682920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-01c39f01-a945-4485-ad1b-18df5e3b262e req-7ae818d4-13a1-4eb5-bfd4-c010f410bcb4 service nova] Creating event network-changed:1622e5b0-41e8-4e08-91bc-2ea1780e9143 for instance 416b2fca-770f-4031-b545-db1103ce3144 on hv-cinder-85426 Aug 24 04:56:47.688863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b4e82cb-53e5-45e7-9f94-249796d32e72 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:47.689361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b4e82cb-53e5-45e7-9f94-249796d32e72 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:47.689804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b4e82cb-53e5-45e7-9f94-249796d32e72 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:47.690598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b4e82cb-53e5-45e7-9f94-249796d32e72 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:47.691299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-01c39f01-a945-4485-ad1b-18df5e3b262e req-7ae818d4-13a1-4eb5-bfd4-c010f410bcb4 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082283 Aug 24 04:56:47.692877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 176/335] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:56:47.700450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b4e82cb-53e5-45e7-9f94-249796d32e72 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:47.700947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b4e82cb-53e5-45e7-9f94-249796d32e72 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:47.806332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a7d3b602-28b6-4dfd-933c-eac788d491f7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:47.807174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a7d3b602-28b6-4dfd-933c-eac788d491f7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:47.818800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7d3b602-28b6-4dfd-933c-eac788d491f7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:47.820904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7d3b602-28b6-4dfd-933c-eac788d491f7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:47.822618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7d3b602-28b6-4dfd-933c-eac788d491f7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:47.823578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7d3b602-28b6-4dfd-933c-eac788d491f7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:47.827320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7d3b602-28b6-4dfd-933c-eac788d491f7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:47.828170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7d3b602-28b6-4dfd-933c-eac788d491f7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:47.866318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:47.958363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2b4e82cb-53e5-45e7-9f94-249796d32e72 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:47.974641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2b4e82cb-53e5-45e7-9f94-249796d32e72 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.312199 Aug 24 04:56:47.976460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 160/336] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:47 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:48.130199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a7d3b602-28b6-4dfd-933c-eac788d491f7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:48.141889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a7d3b602-28b6-4dfd-933c-eac788d491f7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.340892 Aug 24 04:56:48.143287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 177/337] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:47 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:48.241346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1215723992", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "86f6a8b1-f4ca-4ffb-b7d1-ff8bb67eebf3"}], "security_groups": [{"name": "tempest-securitygroup--406386619"}], "key_name": "tempest-keypair-1661748740", "user_data": "}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:48.370535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] validate_networks() for [('86f6a8b1-f4ca-4ffb-b7d1-ff8bb67eebf3', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:56:48.491439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:48.796863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:56:48.796863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:56:48.797573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:56:48.797734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:56:48.798411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:56:48.808795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:48.809372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:48.809817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:48.810615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:48.811448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:48.812023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:48.831013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Getting quotas for project 3c309287c4964e60a66398d9841b9c29. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:56:48.837092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Getting quotas for user 246605916c884dfab9aa75297e358d6f and project 3c309287c4964e60a66398d9841b9c29. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:56:48.847146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:56:48.850241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:56:48.899059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-67b27683-4f89-48a1-84c5-f80c55348447 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.663750 Aug 24 04:56:48.900010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 161/338] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:56:48 2022] POST /compute/v2.1/servers => generated 408 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:56:48.912615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6f816852-bb73-4e6d-be60-fec0c6e254d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:48.913130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6f816852-bb73-4e6d-be60-fec0c6e254d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:48.916517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=8 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:48.984647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6f816852-bb73-4e6d-be60-fec0c6e254d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:48.996439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6f816852-bb73-4e6d-be60-fec0c6e254d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1246 microversion: 2.1 time: 0.088321 Aug 24 04:56:48.996549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6570c3ce-46f3-4ea2-bdb5-c7c697c68e3d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:48.997068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6570c3ce-46f3-4ea2-bdb5-c7c697c68e3d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:48.998653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 178/339] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:49.005757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6570c3ce-46f3-4ea2-bdb5-c7c697c68e3d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:49.006251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6570c3ce-46f3-4ea2-bdb5-c7c697c68e3d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:49.006701 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6570c3ce-46f3-4ea2-bdb5-c7c697c68e3d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:49.007408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6570c3ce-46f3-4ea2-bdb5-c7c697c68e3d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:49.007861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6570c3ce-46f3-4ea2-bdb5-c7c697c68e3d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:49.008595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6570c3ce-46f3-4ea2-bdb5-c7c697c68e3d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:49.165282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dc374e38-3672-4668-a035-fcda81f4a960 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:49.165882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dc374e38-3672-4668-a035-fcda81f4a960 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:49.173512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc374e38-3672-4668-a035-fcda81f4a960 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:49.173997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc374e38-3672-4668-a035-fcda81f4a960 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:49.174424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc374e38-3672-4668-a035-fcda81f4a960 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:49.175417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc374e38-3672-4668-a035-fcda81f4a960 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:49.176525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc374e38-3672-4668-a035-fcda81f4a960 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:49.177260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc374e38-3672-4668-a035-fcda81f4a960 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:49.182622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6570c3ce-46f3-4ea2-bdb5-c7c697c68e3d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:49.191981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6570c3ce-46f3-4ea2-bdb5-c7c697c68e3d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.198554 Aug 24 04:56:49.193319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 162/340] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:48 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:49.478393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dc374e38-3672-4668-a035-fcda81f4a960 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:49.486182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dc374e38-3672-4668-a035-fcda81f4a960 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.326612 Aug 24 04:56:49.486760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 179/341] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:49 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:50.020771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a81a3a77-bf52-4f8c-8cd2-877b1ce960b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:50.021412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a81a3a77-bf52-4f8c-8cd2-877b1ce960b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:50.027843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81a3a77-bf52-4f8c-8cd2-877b1ce960b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:50.028335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81a3a77-bf52-4f8c-8cd2-877b1ce960b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:50.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81a3a77-bf52-4f8c-8cd2-877b1ce960b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:50.029458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81a3a77-bf52-4f8c-8cd2-877b1ce960b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:50.029909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81a3a77-bf52-4f8c-8cd2-877b1ce960b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:50.030335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81a3a77-bf52-4f8c-8cd2-877b1ce960b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:50.091506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a81a3a77-bf52-4f8c-8cd2-877b1ce960b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:50.099453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a81a3a77-bf52-4f8c-8cd2-877b1ce960b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1250 microversion: 2.1 time: 0.083459 Aug 24 04:56:50.100025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 163/342] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1250 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:50.213287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ef20df76-d170-4ac4-a3bc-d3369eb3fddd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:50.213887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ef20df76-d170-4ac4-a3bc-d3369eb3fddd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:50.219822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef20df76-d170-4ac4-a3bc-d3369eb3fddd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:50.220393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef20df76-d170-4ac4-a3bc-d3369eb3fddd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:50.220821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef20df76-d170-4ac4-a3bc-d3369eb3fddd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:50.221491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef20df76-d170-4ac4-a3bc-d3369eb3fddd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:50.221933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef20df76-d170-4ac4-a3bc-d3369eb3fddd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:50.222412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef20df76-d170-4ac4-a3bc-d3369eb3fddd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:50.356298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ef20df76-d170-4ac4-a3bc-d3369eb3fddd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:50.364819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ef20df76-d170-4ac4-a3bc-d3369eb3fddd tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.155259 Aug 24 04:56:50.365464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 180/343] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:50 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:50.507057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f114f74d-9c5a-4c55-9c75-0ca73b59df61 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:50.507663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f114f74d-9c5a-4c55-9c75-0ca73b59df61 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:50.513607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f114f74d-9c5a-4c55-9c75-0ca73b59df61 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:50.514084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f114f74d-9c5a-4c55-9c75-0ca73b59df61 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:50.514515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f114f74d-9c5a-4c55-9c75-0ca73b59df61 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:50.515222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f114f74d-9c5a-4c55-9c75-0ca73b59df61 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:50.515677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f114f74d-9c5a-4c55-9c75-0ca73b59df61 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:50.516093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f114f74d-9c5a-4c55-9c75-0ca73b59df61 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:50.655569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f114f74d-9c5a-4c55-9c75-0ca73b59df61 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:50.663889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f114f74d-9c5a-4c55-9c75-0ca73b59df61 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.161281 Aug 24 04:56:50.664446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 164/344] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:50 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:51.126013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-08902def-c3bd-4bfa-85c4-9a304dc09c85 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:51.126587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-08902def-c3bd-4bfa-85c4-9a304dc09c85 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:51.136908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08902def-c3bd-4bfa-85c4-9a304dc09c85 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:51.137733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08902def-c3bd-4bfa-85c4-9a304dc09c85 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:51.139257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08902def-c3bd-4bfa-85c4-9a304dc09c85 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:51.140379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08902def-c3bd-4bfa-85c4-9a304dc09c85 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:51.140895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08902def-c3bd-4bfa-85c4-9a304dc09c85 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:51.141357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08902def-c3bd-4bfa-85c4-9a304dc09c85 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:51.229479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-08902def-c3bd-4bfa-85c4-9a304dc09c85 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:51.244436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-08902def-c3bd-4bfa-85c4-9a304dc09c85 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1242 microversion: 2.1 time: 0.123797 Aug 24 04:56:51.245190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 181/345] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1242 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:51.385546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-006f6090-2c36-4f53-8f5e-27530c61cc71 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:51.386156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-006f6090-2c36-4f53-8f5e-27530c61cc71 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:51.392845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-006f6090-2c36-4f53-8f5e-27530c61cc71 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:51.397921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-006f6090-2c36-4f53-8f5e-27530c61cc71 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:51.398497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-006f6090-2c36-4f53-8f5e-27530c61cc71 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:51.399276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-006f6090-2c36-4f53-8f5e-27530c61cc71 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:51.399730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-006f6090-2c36-4f53-8f5e-27530c61cc71 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:51.400150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-006f6090-2c36-4f53-8f5e-27530c61cc71 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:51.529688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-006f6090-2c36-4f53-8f5e-27530c61cc71 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:51.537362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-006f6090-2c36-4f53-8f5e-27530c61cc71 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.155676 Aug 24 04:56:51.537924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 165/346] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:51 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:51.685898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6c35dcd8-54fa-4278-8cdf-f14f7a0a6b3f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:51.686629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6c35dcd8-54fa-4278-8cdf-f14f7a0a6b3f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:51.693882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c35dcd8-54fa-4278-8cdf-f14f7a0a6b3f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:51.694519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c35dcd8-54fa-4278-8cdf-f14f7a0a6b3f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:51.695102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c35dcd8-54fa-4278-8cdf-f14f7a0a6b3f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:51.695802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c35dcd8-54fa-4278-8cdf-f14f7a0a6b3f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:51.696258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c35dcd8-54fa-4278-8cdf-f14f7a0a6b3f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:51.696682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c35dcd8-54fa-4278-8cdf-f14f7a0a6b3f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:51.826208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6c35dcd8-54fa-4278-8cdf-f14f7a0a6b3f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:51.833874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6c35dcd8-54fa-4278-8cdf-f14f7a0a6b3f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.152524 Aug 24 04:56:51.834417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 182/347] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:51 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:52.265501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-363d8ec6-4f00-4bc1-b930-3ac9176723bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:52.266116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-363d8ec6-4f00-4bc1-b930-3ac9176723bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:52.272030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-363d8ec6-4f00-4bc1-b930-3ac9176723bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:52.272504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-363d8ec6-4f00-4bc1-b930-3ac9176723bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:52.272930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-363d8ec6-4f00-4bc1-b930-3ac9176723bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:52.273605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-363d8ec6-4f00-4bc1-b930-3ac9176723bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:52.274047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-363d8ec6-4f00-4bc1-b930-3ac9176723bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:52.274460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-363d8ec6-4f00-4bc1-b930-3ac9176723bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:52.339599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-363d8ec6-4f00-4bc1-b930-3ac9176723bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:52.347222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-363d8ec6-4f00-4bc1-b930-3ac9176723bc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1316 microversion: 2.1 time: 0.085625 Aug 24 04:56:52.348383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 166/348] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1316 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:52.559197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-40439bb6-36f2-4d97-84e8-5539ef9fc662 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:52.559717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-40439bb6-36f2-4d97-84e8-5539ef9fc662 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:52.565844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40439bb6-36f2-4d97-84e8-5539ef9fc662 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:52.566321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40439bb6-36f2-4d97-84e8-5539ef9fc662 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:52.566778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40439bb6-36f2-4d97-84e8-5539ef9fc662 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:52.567464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40439bb6-36f2-4d97-84e8-5539ef9fc662 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:52.567911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40439bb6-36f2-4d97-84e8-5539ef9fc662 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:52.568329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40439bb6-36f2-4d97-84e8-5539ef9fc662 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:52.708993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-40439bb6-36f2-4d97-84e8-5539ef9fc662 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:52.717057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-40439bb6-36f2-4d97-84e8-5539ef9fc662 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.161699 Aug 24 04:56:52.717634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 183/349] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:52 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:52.854906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-28532386-895b-4edf-b023-afdeab658a0f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:52.855446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-28532386-895b-4edf-b023-afdeab658a0f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:52.861820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28532386-895b-4edf-b023-afdeab658a0f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:52.862297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28532386-895b-4edf-b023-afdeab658a0f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:52.862758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28532386-895b-4edf-b023-afdeab658a0f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:52.864062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28532386-895b-4edf-b023-afdeab658a0f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:52.864522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28532386-895b-4edf-b023-afdeab658a0f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:52.864941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28532386-895b-4edf-b023-afdeab658a0f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:53.004303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-28532386-895b-4edf-b023-afdeab658a0f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:53.011981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-28532386-895b-4edf-b023-afdeab658a0f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.161077 Aug 24 04:56:53.012543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 167/350] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:52 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:53.368613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1bc4491b-8f0d-4369-a26d-cf58f5702f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:53.369176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1bc4491b-8f0d-4369-a26d-cf58f5702f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:53.375119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bc4491b-8f0d-4369-a26d-cf58f5702f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:53.375588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bc4491b-8f0d-4369-a26d-cf58f5702f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:53.376011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bc4491b-8f0d-4369-a26d-cf58f5702f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:53.376683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bc4491b-8f0d-4369-a26d-cf58f5702f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:53.377123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bc4491b-8f0d-4369-a26d-cf58f5702f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:53.377540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bc4491b-8f0d-4369-a26d-cf58f5702f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:53.442261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1bc4491b-8f0d-4369-a26d-cf58f5702f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:53.449846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1bc4491b-8f0d-4369-a26d-cf58f5702f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1316 microversion: 2.1 time: 0.085135 Aug 24 04:56:53.450392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 184/351] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1316 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:53.737874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dfb7e313-78ed-4291-b09e-39807d52a165 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:53.738522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dfb7e313-78ed-4291-b09e-39807d52a165 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:53.744622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfb7e313-78ed-4291-b09e-39807d52a165 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:53.745107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfb7e313-78ed-4291-b09e-39807d52a165 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:53.745539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfb7e313-78ed-4291-b09e-39807d52a165 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:53.746225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfb7e313-78ed-4291-b09e-39807d52a165 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:53.746679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfb7e313-78ed-4291-b09e-39807d52a165 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:53.747147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfb7e313-78ed-4291-b09e-39807d52a165 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:53.875579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dfb7e313-78ed-4291-b09e-39807d52a165 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:53.883883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dfb7e313-78ed-4291-b09e-39807d52a165 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.149935 Aug 24 04:56:53.884442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 168/352] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:53 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:54.032235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-784c929a-2482-4070-b9c7-50b5720a954c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:54.032779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-784c929a-2482-4070-b9c7-50b5720a954c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:54.038671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784c929a-2482-4070-b9c7-50b5720a954c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:54.039170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784c929a-2482-4070-b9c7-50b5720a954c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:54.039601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784c929a-2482-4070-b9c7-50b5720a954c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:54.040287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784c929a-2482-4070-b9c7-50b5720a954c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:54.040732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784c929a-2482-4070-b9c7-50b5720a954c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:54.041147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784c929a-2482-4070-b9c7-50b5720a954c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:54.177372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-784c929a-2482-4070-b9c7-50b5720a954c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:54.186715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-784c929a-2482-4070-b9c7-50b5720a954c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.157795 Aug 24 04:56:54.199882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 185/353] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:54 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:54.471020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-44b31378-7e3f-41ac-8703-4d993e1b8d03 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:54.471684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-44b31378-7e3f-41ac-8703-4d993e1b8d03 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:54.474280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:54.480314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44b31378-7e3f-41ac-8703-4d993e1b8d03 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:54.480784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44b31378-7e3f-41ac-8703-4d993e1b8d03 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:54.481345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44b31378-7e3f-41ac-8703-4d993e1b8d03 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:54.482083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44b31378-7e3f-41ac-8703-4d993e1b8d03 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:54.482533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44b31378-7e3f-41ac-8703-4d993e1b8d03 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:54.482982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44b31378-7e3f-41ac-8703-4d993e1b8d03 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:54.551313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-44b31378-7e3f-41ac-8703-4d993e1b8d03 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:54.559192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-44b31378-7e3f-41ac-8703-4d993e1b8d03 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1316 microversion: 2.1 time: 0.092263 Aug 24 04:56:54.559751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 169/354] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1316 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:54.904645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4e5576f3-1f9e-4d13-8458-5b7f1d51e5bb tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:54.905238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4e5576f3-1f9e-4d13-8458-5b7f1d51e5bb tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:54.911774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5576f3-1f9e-4d13-8458-5b7f1d51e5bb tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:54.912245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5576f3-1f9e-4d13-8458-5b7f1d51e5bb tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:54.912668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5576f3-1f9e-4d13-8458-5b7f1d51e5bb tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:54.913336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5576f3-1f9e-4d13-8458-5b7f1d51e5bb tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:54.913776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5576f3-1f9e-4d13-8458-5b7f1d51e5bb tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:54.914188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5576f3-1f9e-4d13-8458-5b7f1d51e5bb tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:55.207095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-aa9ced95-e825-4dfe-871c-17311a02156d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:55.207794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-aa9ced95-e825-4dfe-871c-17311a02156d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:55.214460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9ced95-e825-4dfe-871c-17311a02156d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:55.215166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9ced95-e825-4dfe-871c-17311a02156d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:55.215606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9ced95-e825-4dfe-871c-17311a02156d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:55.216311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9ced95-e825-4dfe-871c-17311a02156d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:55.216750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9ced95-e825-4dfe-871c-17311a02156d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:55.217174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9ced95-e825-4dfe-871c-17311a02156d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:55.265381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4e5576f3-1f9e-4d13-8458-5b7f1d51e5bb tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:55.273222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4e5576f3-1f9e-4d13-8458-5b7f1d51e5bb tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.372478 Aug 24 04:56:55.273779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 186/355] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:54 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:55.350799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-aa9ced95-e825-4dfe-871c-17311a02156d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:55.358399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-aa9ced95-e825-4dfe-871c-17311a02156d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.155208 Aug 24 04:56:55.358986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 170/356] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:55 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:55.579468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a1ebb414-d20a-4849-aa9e-d3e78836f69d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:55.580065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a1ebb414-d20a-4849-aa9e-d3e78836f69d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:55.586284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1ebb414-d20a-4849-aa9e-d3e78836f69d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:55.586783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1ebb414-d20a-4849-aa9e-d3e78836f69d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:55.587213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1ebb414-d20a-4849-aa9e-d3e78836f69d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:55.587892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1ebb414-d20a-4849-aa9e-d3e78836f69d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:55.588338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1ebb414-d20a-4849-aa9e-d3e78836f69d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:55.588754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1ebb414-d20a-4849-aa9e-d3e78836f69d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:55.650663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a1ebb414-d20a-4849-aa9e-d3e78836f69d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:55.658318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a1ebb414-d20a-4849-aa9e-d3e78836f69d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1316 microversion: 2.1 time: 0.082673 Aug 24 04:56:55.658971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 187/357] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:55 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1316 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:56.295173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3b44ff9c-047b-4338-83e6-e7b902832fb1 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:56.295874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3b44ff9c-047b-4338-83e6-e7b902832fb1 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:56.303164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b44ff9c-047b-4338-83e6-e7b902832fb1 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:56.303645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b44ff9c-047b-4338-83e6-e7b902832fb1 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:56.304077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b44ff9c-047b-4338-83e6-e7b902832fb1 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:56.304773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b44ff9c-047b-4338-83e6-e7b902832fb1 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:56.305224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b44ff9c-047b-4338-83e6-e7b902832fb1 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:56.305641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b44ff9c-047b-4338-83e6-e7b902832fb1 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:56.379540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d3949c37-537e-474c-bd86-958e0b79e43f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:56.380268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d3949c37-537e-474c-bd86-958e0b79e43f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:56.386440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3949c37-537e-474c-bd86-958e0b79e43f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:56.387030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3949c37-537e-474c-bd86-958e0b79e43f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:56.387532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3949c37-537e-474c-bd86-958e0b79e43f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:56.388311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3949c37-537e-474c-bd86-958e0b79e43f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:56.388833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3949c37-537e-474c-bd86-958e0b79e43f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:56.389320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3949c37-537e-474c-bd86-958e0b79e43f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:56.438872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3b44ff9c-047b-4338-83e6-e7b902832fb1 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:56.447142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3b44ff9c-047b-4338-83e6-e7b902832fb1 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.156357 Aug 24 04:56:56.448260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 171/358] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:56 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:56.523615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d3949c37-537e-474c-bd86-958e0b79e43f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:56.531172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d3949c37-537e-474c-bd86-958e0b79e43f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.156292 Aug 24 04:56:56.531726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 188/359] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:56 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:56.680928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6f6b04ce-9a3c-4c7d-879c-357dfc6115e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:56.681526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6f6b04ce-9a3c-4c7d-879c-357dfc6115e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:56.687524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f6b04ce-9a3c-4c7d-879c-357dfc6115e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:56.687993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f6b04ce-9a3c-4c7d-879c-357dfc6115e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:56.688418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f6b04ce-9a3c-4c7d-879c-357dfc6115e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:56.689093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f6b04ce-9a3c-4c7d-879c-357dfc6115e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:56.689538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f6b04ce-9a3c-4c7d-879c-357dfc6115e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:56.689947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f6b04ce-9a3c-4c7d-879c-357dfc6115e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:56.756007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6f6b04ce-9a3c-4c7d-879c-357dfc6115e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:56.763718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6f6b04ce-9a3c-4c7d-879c-357dfc6115e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1316 microversion: 2.1 time: 0.087112 Aug 24 04:56:56.764279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 172/360] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1316 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:57.467870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-19e57440-a8aa-4ba2-b444-3ca62e9d4b38 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:57.468749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-19e57440-a8aa-4ba2-b444-3ca62e9d4b38 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:57.475158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19e57440-a8aa-4ba2-b444-3ca62e9d4b38 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:57.475635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19e57440-a8aa-4ba2-b444-3ca62e9d4b38 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:57.476246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19e57440-a8aa-4ba2-b444-3ca62e9d4b38 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:57.476945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19e57440-a8aa-4ba2-b444-3ca62e9d4b38 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:57.477413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19e57440-a8aa-4ba2-b444-3ca62e9d4b38 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:57.477824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19e57440-a8aa-4ba2-b444-3ca62e9d4b38 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:57.553044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9b48464d-ac0b-43bc-b4e0-32667ded4900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:57.553592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9b48464d-ac0b-43bc-b4e0-32667ded4900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:57.560928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b48464d-ac0b-43bc-b4e0-32667ded4900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:57.562113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b48464d-ac0b-43bc-b4e0-32667ded4900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:57.562552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b48464d-ac0b-43bc-b4e0-32667ded4900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:57.563370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b48464d-ac0b-43bc-b4e0-32667ded4900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:57.563990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b48464d-ac0b-43bc-b4e0-32667ded4900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:57.564412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b48464d-ac0b-43bc-b4e0-32667ded4900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:57.581354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:57.646069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-19e57440-a8aa-4ba2-b444-3ca62e9d4b38 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:57.653824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-19e57440-a8aa-4ba2-b444-3ca62e9d4b38 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.189783 Aug 24 04:56:57.654378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 189/361] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:57 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:57.712396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9b48464d-ac0b-43bc-b4e0-32667ded4900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:57.720464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9b48464d-ac0b-43bc-b4e0-32667ded4900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.172068 Aug 24 04:56:57.721086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 173/362] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:57 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:57.784223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ebfa2a48-ee18-4b5c-9f26-4233affd6d7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:57.785013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ebfa2a48-ee18-4b5c-9f26-4233affd6d7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:57.791176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa2a48-ee18-4b5c-9f26-4233affd6d7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:57.791647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa2a48-ee18-4b5c-9f26-4233affd6d7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:57.792074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa2a48-ee18-4b5c-9f26-4233affd6d7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:57.792738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa2a48-ee18-4b5c-9f26-4233affd6d7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:57.793178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa2a48-ee18-4b5c-9f26-4233affd6d7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:57.793593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebfa2a48-ee18-4b5c-9f26-4233affd6d7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:57.856228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ebfa2a48-ee18-4b5c-9f26-4233affd6d7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:57.864354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ebfa2a48-ee18-4b5c-9f26-4233affd6d7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1304 microversion: 2.1 time: 0.083999 Aug 24 04:56:57.864904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 190/363] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:58.674750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-965b1f99-f242-4a36-9c55-2454f0aeafe2 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:58.675547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-965b1f99-f242-4a36-9c55-2454f0aeafe2 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:58.681844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-965b1f99-f242-4a36-9c55-2454f0aeafe2 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:58.682324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-965b1f99-f242-4a36-9c55-2454f0aeafe2 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:58.682795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-965b1f99-f242-4a36-9c55-2454f0aeafe2 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:58.683480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-965b1f99-f242-4a36-9c55-2454f0aeafe2 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:58.683940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-965b1f99-f242-4a36-9c55-2454f0aeafe2 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:58.684363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-965b1f99-f242-4a36-9c55-2454f0aeafe2 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:58.740644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f5ba2dc4-6dc9-43cc-a10b-c418e6db41f4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:58.741378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f5ba2dc4-6dc9-43cc-a10b-c418e6db41f4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:58.747412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5ba2dc4-6dc9-43cc-a10b-c418e6db41f4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:58.747997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5ba2dc4-6dc9-43cc-a10b-c418e6db41f4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:58.748692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5ba2dc4-6dc9-43cc-a10b-c418e6db41f4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:58.749610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5ba2dc4-6dc9-43cc-a10b-c418e6db41f4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:58.750157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5ba2dc4-6dc9-43cc-a10b-c418e6db41f4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:58.750667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5ba2dc4-6dc9-43cc-a10b-c418e6db41f4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:58.821664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:58.835391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-965b1f99-f242-4a36-9c55-2454f0aeafe2 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:58.843411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-965b1f99-f242-4a36-9c55-2454f0aeafe2 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.172508 Aug 24 04:56:58.844304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 174/364] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:58 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:58.885218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-06a795c4-22d7-4bc4-97c9-a3392bcd5b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:58.885728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-06a795c4-22d7-4bc4-97c9-a3392bcd5b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:58.887573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=18 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:58.892959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06a795c4-22d7-4bc4-97c9-a3392bcd5b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:58.893435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06a795c4-22d7-4bc4-97c9-a3392bcd5b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:58.893860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06a795c4-22d7-4bc4-97c9-a3392bcd5b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:58.895246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06a795c4-22d7-4bc4-97c9-a3392bcd5b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:58.895691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06a795c4-22d7-4bc4-97c9-a3392bcd5b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:58.896105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06a795c4-22d7-4bc4-97c9-a3392bcd5b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:58.904090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f5ba2dc4-6dc9-43cc-a10b-c418e6db41f4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:58.912613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f5ba2dc4-6dc9-43cc-a10b-c418e6db41f4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.176576 Aug 24 04:56:58.913276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 191/365] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:58 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:56:58.959231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-06a795c4-22d7-4bc4-97c9-a3392bcd5b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:56:58.967148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-06a795c4-22d7-4bc4-97c9-a3392bcd5b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1304 microversion: 2.1 time: 0.085897 Aug 24 04:56:58.967734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 175/366] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:56:59.856123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-5702674e-1d78-4964-9002-ac0de77615dd req-6af5df1a-66a6-44a9-8258-12b14efd46a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416b2fca-770f-4031-b545-db1103ce3144", "name": "network-vif-plugged", "status": "completed", "tag": "1622e5b0-41e8-4e08-91bc-2ea1780e9143"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:56:59.864168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:59.872560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2802b4ba-6154-4a7c-8e7c-e64043f4de97 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:59.873813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2802b4ba-6154-4a7c-8e7c-e64043f4de97 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:59.875196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-5702674e-1d78-4964-9002-ac0de77615dd req-6af5df1a-66a6-44a9-8258-12b14efd46a5 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:59.875880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-5702674e-1d78-4964-9002-ac0de77615dd req-6af5df1a-66a6-44a9-8258-12b14efd46a5 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:59.877986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-5702674e-1d78-4964-9002-ac0de77615dd req-6af5df1a-66a6-44a9-8258-12b14efd46a5 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:59.882812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2802b4ba-6154-4a7c-8e7c-e64043f4de97 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:59.883558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2802b4ba-6154-4a7c-8e7c-e64043f4de97 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:59.885175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2802b4ba-6154-4a7c-8e7c-e64043f4de97 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:59.886468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2802b4ba-6154-4a7c-8e7c-e64043f4de97 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:59.887158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2802b4ba-6154-4a7c-8e7c-e64043f4de97 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:59.887900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2802b4ba-6154-4a7c-8e7c-e64043f4de97 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:59.896635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-5702674e-1d78-4964-9002-ac0de77615dd req-6af5df1a-66a6-44a9-8258-12b14efd46a5 service nova] Creating event network-vif-plugged:1622e5b0-41e8-4e08-91bc-2ea1780e9143 for instance 416b2fca-770f-4031-b545-db1103ce3144 on hv-cinder-85426 Aug 24 04:56:59.903589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-5702674e-1d78-4964-9002-ac0de77615dd req-6af5df1a-66a6-44a9-8258-12b14efd46a5 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056983 Aug 24 04:56:59.904839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 192/367] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:56:59.936770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5447be3f-004f-42ef-9d1c-75a02695a536 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:56:59.937540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5447be3f-004f-42ef-9d1c-75a02695a536 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:56:59.945428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5447be3f-004f-42ef-9d1c-75a02695a536 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:59.946149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5447be3f-004f-42ef-9d1c-75a02695a536 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:59.946803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5447be3f-004f-42ef-9d1c-75a02695a536 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:56:59.948439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5447be3f-004f-42ef-9d1c-75a02695a536 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:56:59.949302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5447be3f-004f-42ef-9d1c-75a02695a536 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:56:59.949874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5447be3f-004f-42ef-9d1c-75a02695a536 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:00.131460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5447be3f-004f-42ef-9d1c-75a02695a536 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:00.148975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5447be3f-004f-42ef-9d1c-75a02695a536 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.218020 Aug 24 04:57:00.150239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 193/368] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:59 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:00.167548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-36760769-a63e-4033-a096-cd415e62d64a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:00.168152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-36760769-a63e-4033-a096-cd415e62d64a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:00.174325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36760769-a63e-4033-a096-cd415e62d64a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:00.174829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36760769-a63e-4033-a096-cd415e62d64a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:00.175346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36760769-a63e-4033-a096-cd415e62d64a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:00.176682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36760769-a63e-4033-a096-cd415e62d64a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:00.177375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36760769-a63e-4033-a096-cd415e62d64a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:00.178053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36760769-a63e-4033-a096-cd415e62d64a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:00.190534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2802b4ba-6154-4a7c-8e7c-e64043f4de97 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:00.210069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2802b4ba-6154-4a7c-8e7c-e64043f4de97 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.346342 Aug 24 04:57:00.212134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 176/369] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:56:59 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:00.340542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-36760769-a63e-4033-a096-cd415e62d64a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:00.349787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-36760769-a63e-4033-a096-cd415e62d64a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.198155 Aug 24 04:57:00.354874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 194/370] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:01.172942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-48da97c8-792a-4c3c-82dd-8da45ef44ed3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:01.173566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-48da97c8-792a-4c3c-82dd-8da45ef44ed3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:01.182173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48da97c8-792a-4c3c-82dd-8da45ef44ed3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:01.182664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48da97c8-792a-4c3c-82dd-8da45ef44ed3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:01.183129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48da97c8-792a-4c3c-82dd-8da45ef44ed3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:01.183831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48da97c8-792a-4c3c-82dd-8da45ef44ed3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:01.184285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48da97c8-792a-4c3c-82dd-8da45ef44ed3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:01.185278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48da97c8-792a-4c3c-82dd-8da45ef44ed3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:01.231819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5b30dc38-6136-4cd5-943f-380743bd74a0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:01.232432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5b30dc38-6136-4cd5-943f-380743bd74a0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:01.239155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5b30dc38-6136-4cd5-943f-380743bd74a0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:01.239633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5b30dc38-6136-4cd5-943f-380743bd74a0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:01.240070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5b30dc38-6136-4cd5-943f-380743bd74a0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:01.240754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5b30dc38-6136-4cd5-943f-380743bd74a0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:01.241208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5b30dc38-6136-4cd5-943f-380743bd74a0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:01.241631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5b30dc38-6136-4cd5-943f-380743bd74a0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:01.387658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5b30dc38-6136-4cd5-943f-380743bd74a0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:01.390343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:01.398060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5b30dc38-6136-4cd5-943f-380743bd74a0 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1314 microversion: 2.1 time: 0.170025 Aug 24 04:57:01.398989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 195/371] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:01 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:01.407342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4c822f80-e2c4-4bc6-822a-3c30600d68f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:01.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4c822f80-e2c4-4bc6-822a-3c30600d68f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:01.417459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c822f80-e2c4-4bc6-822a-3c30600d68f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:01.417940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c822f80-e2c4-4bc6-822a-3c30600d68f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:01.418369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c822f80-e2c4-4bc6-822a-3c30600d68f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:01.419360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c822f80-e2c4-4bc6-822a-3c30600d68f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:01.419912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c822f80-e2c4-4bc6-822a-3c30600d68f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:01.420334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c822f80-e2c4-4bc6-822a-3c30600d68f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:01.467021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-48da97c8-792a-4c3c-82dd-8da45ef44ed3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:01.477145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-48da97c8-792a-4c3c-82dd-8da45ef44ed3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.308603 Aug 24 04:57:01.477720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 177/372] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:01 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:01.560067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4c822f80-e2c4-4bc6-822a-3c30600d68f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:01.569086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4c822f80-e2c4-4bc6-822a-3c30600d68f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.169073 Aug 24 04:57:01.591738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 196/373] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:01.609160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-c81cf4aa-14aa-4e02-93e9-9808322108d5 req-95f68bb1-4c1a-45d9-b20f-ef8fb3e96fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246c7f17-b6b8-470f-aa27-f23cac6e0df5", "tag": "0cfe0fe5-d04b-4a23-8aaa-9d12f5721acd"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:01.622309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-c81cf4aa-14aa-4e02-93e9-9808322108d5 req-95f68bb1-4c1a-45d9-b20f-ef8fb3e96fe7 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:01.623146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-c81cf4aa-14aa-4e02-93e9-9808322108d5 req-95f68bb1-4c1a-45d9-b20f-ef8fb3e96fe7 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:01.624373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-c81cf4aa-14aa-4e02-93e9-9808322108d5 req-95f68bb1-4c1a-45d9-b20f-ef8fb3e96fe7 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:01.637568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-c81cf4aa-14aa-4e02-93e9-9808322108d5 req-95f68bb1-4c1a-45d9-b20f-ef8fb3e96fe7 service nova] Creating event network-changed:0cfe0fe5-d04b-4a23-8aaa-9d12f5721acd for instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 on hv-cinder-85426 Aug 24 04:57:01.647001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-c81cf4aa-14aa-4e02-93e9-9808322108d5 req-95f68bb1-4c1a-45d9-b20f-ef8fb3e96fe7 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042332 Aug 24 04:57:01.648690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 178/374] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:02.421689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-58b41326-ed29-4a82-8e8a-b5f80e459c87 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:02.422300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-58b41326-ed29-4a82-8e8a-b5f80e459c87 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:02.429093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58b41326-ed29-4a82-8e8a-b5f80e459c87 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.429600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58b41326-ed29-4a82-8e8a-b5f80e459c87 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.430036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58b41326-ed29-4a82-8e8a-b5f80e459c87 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.430796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58b41326-ed29-4a82-8e8a-b5f80e459c87 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.431249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58b41326-ed29-4a82-8e8a-b5f80e459c87 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.431669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58b41326-ed29-4a82-8e8a-b5f80e459c87 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.499981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8ceaffd7-d465-4dd9-ab48-0c4a96cd09dd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:02.500690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8ceaffd7-d465-4dd9-ab48-0c4a96cd09dd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:02.507373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ceaffd7-d465-4dd9-ab48-0c4a96cd09dd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.507868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ceaffd7-d465-4dd9-ab48-0c4a96cd09dd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.508307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ceaffd7-d465-4dd9-ab48-0c4a96cd09dd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.509005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ceaffd7-d465-4dd9-ab48-0c4a96cd09dd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.509461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ceaffd7-d465-4dd9-ab48-0c4a96cd09dd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.509886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ceaffd7-d465-4dd9-ab48-0c4a96cd09dd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.567994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-58b41326-ed29-4a82-8e8a-b5f80e459c87 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:02.577179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-58b41326-ed29-4a82-8e8a-b5f80e459c87 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1463 microversion: 2.1 time: 0.159658 Aug 24 04:57:02.577896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 197/375] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:02 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1463 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:02.598982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ee19c861-43b4-4785-a6ed-22ad141b809c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:02.599847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ee19c861-43b4-4785-a6ed-22ad141b809c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:02.615175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee19c861-43b4-4785-a6ed-22ad141b809c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.615703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee19c861-43b4-4785-a6ed-22ad141b809c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.616146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee19c861-43b4-4785-a6ed-22ad141b809c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.616856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee19c861-43b4-4785-a6ed-22ad141b809c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.617305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee19c861-43b4-4785-a6ed-22ad141b809c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.617732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee19c861-43b4-4785-a6ed-22ad141b809c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.783317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ee19c861-43b4-4785-a6ed-22ad141b809c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:02.793207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ee19c861-43b4-4785-a6ed-22ad141b809c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.198747 Aug 24 04:57:02.794466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 198/376] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:02.799189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7def7ba6-b174-4e72-bdc3-47dbbeb56e73 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:02.799808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7def7ba6-b174-4e72-bdc3-47dbbeb56e73 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:02.806957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7def7ba6-b174-4e72-bdc3-47dbbeb56e73 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.807696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7def7ba6-b174-4e72-bdc3-47dbbeb56e73 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.808369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7def7ba6-b174-4e72-bdc3-47dbbeb56e73 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.809285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7def7ba6-b174-4e72-bdc3-47dbbeb56e73 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.809854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7def7ba6-b174-4e72-bdc3-47dbbeb56e73 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.810375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7def7ba6-b174-4e72-bdc3-47dbbeb56e73 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.838163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7def7ba6-b174-4e72-bdc3-47dbbeb56e73 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Going to try to terminate instance {{(pid=120558) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:57:02.930139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7def7ba6-b174-4e72-bdc3-47dbbeb56e73 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "DELETE /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 204 len: 0 microversion: 2.1 time: 0.133011 Aug 24 04:57:02.931342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 199/377] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 04:57:02 2022] DELETE /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 04:57:02.941295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ab871a6f-0725-42c9-bb80-4d39eb4ece1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:02.942404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ab871a6f-0725-42c9-bb80-4d39eb4ece1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:02.949966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab871a6f-0725-42c9-bb80-4d39eb4ece1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.950450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab871a6f-0725-42c9-bb80-4d39eb4ece1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.951139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab871a6f-0725-42c9-bb80-4d39eb4ece1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:02.951888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab871a6f-0725-42c9-bb80-4d39eb4ece1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:02.952338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab871a6f-0725-42c9-bb80-4d39eb4ece1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:02.952752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab871a6f-0725-42c9-bb80-4d39eb4ece1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:03.028545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8ceaffd7-d465-4dd9-ab48-0c4a96cd09dd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:03.037275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8ceaffd7-d465-4dd9-ab48-0c4a96cd09dd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.542814 Aug 24 04:57:03.048338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 179/378] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:02 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:03.099963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ab871a6f-0725-42c9-bb80-4d39eb4ece1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:03.107911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ab871a6f-0725-42c9-bb80-4d39eb4ece1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1469 microversion: 2.1 time: 0.172162 Aug 24 04:57:03.108526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 200/379] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:02 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1469 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:03.814465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-256d0bec-753d-4ae1-bd70-ec238b92bf1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:03.815101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-256d0bec-753d-4ae1-bd70-ec238b92bf1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:03.822179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-256d0bec-753d-4ae1-bd70-ec238b92bf1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:03.822655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-256d0bec-753d-4ae1-bd70-ec238b92bf1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:03.823129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-256d0bec-753d-4ae1-bd70-ec238b92bf1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:03.823813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-256d0bec-753d-4ae1-bd70-ec238b92bf1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:03.824267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-256d0bec-753d-4ae1-bd70-ec238b92bf1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:03.824691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-256d0bec-753d-4ae1-bd70-ec238b92bf1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:03.959201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-256d0bec-753d-4ae1-bd70-ec238b92bf1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:03.967178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-256d0bec-753d-4ae1-bd70-ec238b92bf1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.156450 Aug 24 04:57:03.967755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 180/380] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:03 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:04.058151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-77ad2e81-0be3-4e3c-9ebb-652e0d1287e8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:04.058792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-77ad2e81-0be3-4e3c-9ebb-652e0d1287e8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:04.064716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77ad2e81-0be3-4e3c-9ebb-652e0d1287e8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:04.065199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77ad2e81-0be3-4e3c-9ebb-652e0d1287e8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:04.065634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77ad2e81-0be3-4e3c-9ebb-652e0d1287e8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:04.066391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77ad2e81-0be3-4e3c-9ebb-652e0d1287e8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:04.067043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77ad2e81-0be3-4e3c-9ebb-652e0d1287e8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:04.067467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77ad2e81-0be3-4e3c-9ebb-652e0d1287e8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:04.130628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-11057f92-f5b3-42d2-9c30-607d1e1de36e tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:04.131518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-11057f92-f5b3-42d2-9c30-607d1e1de36e tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:04.138858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11057f92-f5b3-42d2-9c30-607d1e1de36e tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:04.139497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11057f92-f5b3-42d2-9c30-607d1e1de36e tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:04.140000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11057f92-f5b3-42d2-9c30-607d1e1de36e tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:04.140778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11057f92-f5b3-42d2-9c30-607d1e1de36e tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:04.141338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11057f92-f5b3-42d2-9c30-607d1e1de36e tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:04.142073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11057f92-f5b3-42d2-9c30-607d1e1de36e tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:04.218203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-77ad2e81-0be3-4e3c-9ebb-652e0d1287e8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:04.226978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-77ad2e81-0be3-4e3c-9ebb-652e0d1287e8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.172742 Aug 24 04:57:04.227533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 201/381] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:04 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:04.232088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-35c6b06b-b334-466d-adcc-6d5563477a5f req-8e4ace82-ce1b-4cd8-8052-bf878deb1a7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf50e90-6712-4e3e-b813-653bfe69d460", "name": "network-vif-plugged", "status": "completed", "tag": "ec1c9364-3199-41cb-89a1-3a76d09fecc6"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:04.241998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-35c6b06b-b334-466d-adcc-6d5563477a5f req-8e4ace82-ce1b-4cd8-8052-bf878deb1a7d service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:04.242465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-35c6b06b-b334-466d-adcc-6d5563477a5f req-8e4ace82-ce1b-4cd8-8052-bf878deb1a7d service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:04.242919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-35c6b06b-b334-466d-adcc-6d5563477a5f req-8e4ace82-ce1b-4cd8-8052-bf878deb1a7d service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:04.254521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-35c6b06b-b334-466d-adcc-6d5563477a5f req-8e4ace82-ce1b-4cd8-8052-bf878deb1a7d service nova] Creating event network-vif-plugged:ec1c9364-3199-41cb-89a1-3a76d09fecc6 for instance 5bf50e90-6712-4e3e-b813-653bfe69d460 on hv-cinder-85426 Aug 24 04:57:04.259513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-35c6b06b-b334-466d-adcc-6d5563477a5f req-8e4ace82-ce1b-4cd8-8052-bf878deb1a7d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030668 Aug 24 04:57:04.260096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 202/382] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:04.289023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-11057f92-f5b3-42d2-9c30-607d1e1de36e tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:04.299578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-11057f92-f5b3-42d2-9c30-607d1e1de36e tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1469 microversion: 2.1 time: 0.174361 Aug 24 04:57:04.300769 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 181/383] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:04 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:04.988965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-499859de-a049-44ae-b70a-12819de5ea67 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:04.989659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-499859de-a049-44ae-b70a-12819de5ea67 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:04.991632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:04.997429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-499859de-a049-44ae-b70a-12819de5ea67 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:04.997910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-499859de-a049-44ae-b70a-12819de5ea67 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:04.998345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-499859de-a049-44ae-b70a-12819de5ea67 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:04.999213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-499859de-a049-44ae-b70a-12819de5ea67 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:04.999663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-499859de-a049-44ae-b70a-12819de5ea67 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:05.000082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-499859de-a049-44ae-b70a-12819de5ea67 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:05.131240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-499859de-a049-44ae-b70a-12819de5ea67 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:05.138961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-499859de-a049-44ae-b70a-12819de5ea67 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.154929 Aug 24 04:57:05.139520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 203/384] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:05.248322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ea3bde85-9dc9-48b6-b768-bdfb6696d93e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:05.248902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ea3bde85-9dc9-48b6-b768-bdfb6696d93e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:05.255156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea3bde85-9dc9-48b6-b768-bdfb6696d93e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:05.255628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea3bde85-9dc9-48b6-b768-bdfb6696d93e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:05.256054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea3bde85-9dc9-48b6-b768-bdfb6696d93e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:05.256725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea3bde85-9dc9-48b6-b768-bdfb6696d93e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:05.257169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea3bde85-9dc9-48b6-b768-bdfb6696d93e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:05.257586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea3bde85-9dc9-48b6-b768-bdfb6696d93e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:05.321074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-98c812d8-3ff7-4bff-8cbf-1c7f9648ab4b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:05.321678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-98c812d8-3ff7-4bff-8cbf-1c7f9648ab4b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:05.327560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98c812d8-3ff7-4bff-8cbf-1c7f9648ab4b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:05.328035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98c812d8-3ff7-4bff-8cbf-1c7f9648ab4b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:05.328477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98c812d8-3ff7-4bff-8cbf-1c7f9648ab4b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:05.329143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98c812d8-3ff7-4bff-8cbf-1c7f9648ab4b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:05.329584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98c812d8-3ff7-4bff-8cbf-1c7f9648ab4b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:05.329999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98c812d8-3ff7-4bff-8cbf-1c7f9648ab4b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:05.388907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ea3bde85-9dc9-48b6-b768-bdfb6696d93e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:05.397216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ea3bde85-9dc9-48b6-b768-bdfb6696d93e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.152846 Aug 24 04:57:05.397784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 182/385] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:05 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:05.476923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-98c812d8-3ff7-4bff-8cbf-1c7f9648ab4b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:05.485617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-98c812d8-3ff7-4bff-8cbf-1c7f9648ab4b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1469 microversion: 2.1 time: 0.168373 Aug 24 04:57:05.486519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 204/386] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:05 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:06.012614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-21d32b77-54a9-43aa-8a66-cfb4651ab9f0 req-f32ec392-5a68-4be0-a032-f7b0cf427631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416b2fca-770f-4031-b545-db1103ce3144", "name": "network-vif-deleted", "tag": "1622e5b0-41e8-4e08-91bc-2ea1780e9143"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:06.023271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-21d32b77-54a9-43aa-8a66-cfb4651ab9f0 req-f32ec392-5a68-4be0-a032-f7b0cf427631 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:06.023748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-21d32b77-54a9-43aa-8a66-cfb4651ab9f0 req-f32ec392-5a68-4be0-a032-f7b0cf427631 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:06.024176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-21d32b77-54a9-43aa-8a66-cfb4651ab9f0 req-f32ec392-5a68-4be0-a032-f7b0cf427631 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:06.037418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-21d32b77-54a9-43aa-8a66-cfb4651ab9f0 req-f32ec392-5a68-4be0-a032-f7b0cf427631 service nova] Creating event network-vif-deleted:1622e5b0-41e8-4e08-91bc-2ea1780e9143 for instance 416b2fca-770f-4031-b545-db1103ce3144 on hv-cinder-85426 Aug 24 04:57:06.042735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-21d32b77-54a9-43aa-8a66-cfb4651ab9f0 req-f32ec392-5a68-4be0-a032-f7b0cf427631 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033800 Aug 24 04:57:06.043358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 183/387] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:06.161832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-309c58a2-446f-4034-ab75-61b3842a686b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:06.162439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-309c58a2-446f-4034-ab75-61b3842a686b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:06.171407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-309c58a2-446f-4034-ab75-61b3842a686b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:06.171905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-309c58a2-446f-4034-ab75-61b3842a686b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:06.172342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-309c58a2-446f-4034-ab75-61b3842a686b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:06.173037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-309c58a2-446f-4034-ab75-61b3842a686b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:06.173487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-309c58a2-446f-4034-ab75-61b3842a686b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:06.173907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-309c58a2-446f-4034-ab75-61b3842a686b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:06.351510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-309c58a2-446f-4034-ab75-61b3842a686b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:06.361373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-309c58a2-446f-4034-ab75-61b3842a686b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.205146 Aug 24 04:57:06.362369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 205/388] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:06.419163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4e22443a-a98f-42ee-b226-b17dc439e1bc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:06.419993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4e22443a-a98f-42ee-b226-b17dc439e1bc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:06.427727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e22443a-a98f-42ee-b226-b17dc439e1bc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:06.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e22443a-a98f-42ee-b226-b17dc439e1bc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:06.428651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e22443a-a98f-42ee-b226-b17dc439e1bc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:06.429342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e22443a-a98f-42ee-b226-b17dc439e1bc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:06.429795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e22443a-a98f-42ee-b226-b17dc439e1bc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:06.430216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e22443a-a98f-42ee-b226-b17dc439e1bc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:06.507608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ad1fa4d5-4e57-4818-b306-75f1333a25c9 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:06.508241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ad1fa4d5-4e57-4818-b306-75f1333a25c9 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:06.514959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1fa4d5-4e57-4818-b306-75f1333a25c9 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:06.515442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1fa4d5-4e57-4818-b306-75f1333a25c9 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:06.515866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1fa4d5-4e57-4818-b306-75f1333a25c9 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:06.516924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1fa4d5-4e57-4818-b306-75f1333a25c9 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:06.517044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1fa4d5-4e57-4818-b306-75f1333a25c9 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:06.517409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ad1fa4d5-4e57-4818-b306-75f1333a25c9 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:06.578299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4e22443a-a98f-42ee-b226-b17dc439e1bc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:06.586953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ad1fa4d5-4e57-4818-b306-75f1333a25c9 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:06.587330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4e22443a-a98f-42ee-b226-b17dc439e1bc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.172513 Aug 24 04:57:06.588000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 184/389] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:06 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:06.594825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ad1fa4d5-4e57-4818-b306-75f1333a25c9 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1299 microversion: 2.1 time: 0.091883 Aug 24 04:57:06.595429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 206/390] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:06 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1299 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:07.382747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-59ba245e-e18a-4f01-b5fb-595f6fe0147d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:07.383260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-59ba245e-e18a-4f01-b5fb-595f6fe0147d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:07.389314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ba245e-e18a-4f01-b5fb-595f6fe0147d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:07.389785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ba245e-e18a-4f01-b5fb-595f6fe0147d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:07.390208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ba245e-e18a-4f01-b5fb-595f6fe0147d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:07.390921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ba245e-e18a-4f01-b5fb-595f6fe0147d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:07.391369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ba245e-e18a-4f01-b5fb-595f6fe0147d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:07.391781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ba245e-e18a-4f01-b5fb-595f6fe0147d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:07.520669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-59ba245e-e18a-4f01-b5fb-595f6fe0147d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:07.528272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-59ba245e-e18a-4f01-b5fb-595f6fe0147d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.149951 Aug 24 04:57:07.528837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 185/391] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:07.607927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d78dcde5-7542-4d50-bea1-dbef2981726f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:07.608671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d78dcde5-7542-4d50-bea1-dbef2981726f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:07.616135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78dcde5-7542-4d50-bea1-dbef2981726f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:07.616622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78dcde5-7542-4d50-bea1-dbef2981726f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:07.617215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78dcde5-7542-4d50-bea1-dbef2981726f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:07.617970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78dcde5-7542-4d50-bea1-dbef2981726f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:07.618748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78dcde5-7542-4d50-bea1-dbef2981726f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:07.619334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78dcde5-7542-4d50-bea1-dbef2981726f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:07.619922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:07.620529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:07.626804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:07.627508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:07.629165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:07.630104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:07.630781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:07.631377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:07.666188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:07.666589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:07.667050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:07.667677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lazy-loading 'fault' on Instance uuid 416b2fca-770f-4031-b545-db1103ce3144 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:57:07.718531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:07.729795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ef5d243e-6ac4-4be6-96b8-bbe68b2c0d1d tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1304 microversion: 2.1 time: 0.113535 Aug 24 04:57:07.740830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 186/392] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:07 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:07.785792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d78dcde5-7542-4d50-bea1-dbef2981726f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:07.794888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d78dcde5-7542-4d50-bea1-dbef2981726f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1264 microversion: 2.1 time: 0.190917 Aug 24 04:57:07.796454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 207/393] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:07 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:08.549575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-175b72d9-8b9f-4fd1-8f74-95624e2b1097 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:08.550131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-175b72d9-8b9f-4fd1-8f74-95624e2b1097 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:08.556782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175b72d9-8b9f-4fd1-8f74-95624e2b1097 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.557277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175b72d9-8b9f-4fd1-8f74-95624e2b1097 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.557706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175b72d9-8b9f-4fd1-8f74-95624e2b1097 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:08.558377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175b72d9-8b9f-4fd1-8f74-95624e2b1097 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.558851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175b72d9-8b9f-4fd1-8f74-95624e2b1097 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.559263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175b72d9-8b9f-4fd1-8f74-95624e2b1097 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:08.687112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-175b72d9-8b9f-4fd1-8f74-95624e2b1097 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:08.695250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-175b72d9-8b9f-4fd1-8f74-95624e2b1097 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.149571 Aug 24 04:57:08.695803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 187/394] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:08.754392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:08.755035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:08.761042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.761516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.761947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:08.762624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.763100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.763513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:08.795458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.795928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.796357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:08.796790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lazy-loading 'fault' on Instance uuid 416b2fca-770f-4031-b545-db1103ce3144 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:57:08.818286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d9cdf2fc-7202-422e-ba58-02b671dbd003 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:08.818850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d9cdf2fc-7202-422e-ba58-02b671dbd003 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:08.825073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9cdf2fc-7202-422e-ba58-02b671dbd003 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.825558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9cdf2fc-7202-422e-ba58-02b671dbd003 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.825994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9cdf2fc-7202-422e-ba58-02b671dbd003 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:08.826705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9cdf2fc-7202-422e-ba58-02b671dbd003 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.827174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9cdf2fc-7202-422e-ba58-02b671dbd003 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.827597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9cdf2fc-7202-422e-ba58-02b671dbd003 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:08.841999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:08.849959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-110c72b5-8e30-41eb-81ad-1a0556287590 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1304 microversion: 2.1 time: 0.099762 Aug 24 04:57:08.850621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 208/395] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:08 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:08.959809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d9cdf2fc-7202-422e-ba58-02b671dbd003 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:08.967611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d9cdf2fc-7202-422e-ba58-02b671dbd003 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1451 microversion: 2.1 time: 0.154207 Aug 24 04:57:08.968177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 188/396] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:08 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:08.988852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f7b82f26-0bfa-4f6a-b11a-a15d0afe21c6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:08.989452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f7b82f26-0bfa-4f6a-b11a-a15d0afe21c6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:08.995454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7b82f26-0bfa-4f6a-b11a-a15d0afe21c6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.995921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7b82f26-0bfa-4f6a-b11a-a15d0afe21c6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.996344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7b82f26-0bfa-4f6a-b11a-a15d0afe21c6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:08.997008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7b82f26-0bfa-4f6a-b11a-a15d0afe21c6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:08.997447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7b82f26-0bfa-4f6a-b11a-a15d0afe21c6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:08.997860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7b82f26-0bfa-4f6a-b11a-a15d0afe21c6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:09.132601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f7b82f26-0bfa-4f6a-b11a-a15d0afe21c6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:09.140191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f7b82f26-0bfa-4f6a-b11a-a15d0afe21c6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1451 microversion: 2.1 time: 0.155860 Aug 24 04:57:09.140748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 209/397] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:08 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:09.716256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-36768c79-fd39-4f8b-895a-f294dfb13642 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:09.716947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-36768c79-fd39-4f8b-895a-f294dfb13642 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:09.724270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36768c79-fd39-4f8b-895a-f294dfb13642 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:09.724831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36768c79-fd39-4f8b-895a-f294dfb13642 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:09.725354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36768c79-fd39-4f8b-895a-f294dfb13642 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:09.726109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36768c79-fd39-4f8b-895a-f294dfb13642 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:09.726623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36768c79-fd39-4f8b-895a-f294dfb13642 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:09.727126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36768c79-fd39-4f8b-895a-f294dfb13642 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:09.871539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:09.872239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:09.878244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:09.878756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:09.879197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:09.879891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:09.880340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:09.880761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:09.912682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:09.913155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:09.913587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:09.914028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lazy-loading 'fault' on Instance uuid 416b2fca-770f-4031-b545-db1103ce3144 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:57:09.948338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-36768c79-fd39-4f8b-895a-f294dfb13642 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:09.955580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:09.957133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-36768c79-fd39-4f8b-895a-f294dfb13642 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.244026 Aug 24 04:57:09.957726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 189/398] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:09.958821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:09.967564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c2ab3bae-2f31-47bc-b238-5c82a0a16cea tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1304 microversion: 2.1 time: 0.099869 Aug 24 04:57:09.968436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 210/399] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:09 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:57:10.930296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-caae8c86-6bd8-4c4f-9167-95b4f1dfb5ad req-aee92d5b-edfa-41a2-93e2-eb29c9275b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bf50e90-6712-4e3e-b813-653bfe69d460", "tag": "ec1c9364-3199-41cb-89a1-3a76d09fecc6"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:10.940061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-caae8c86-6bd8-4c4f-9167-95b4f1dfb5ad req-aee92d5b-edfa-41a2-93e2-eb29c9275b90 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:10.941129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-caae8c86-6bd8-4c4f-9167-95b4f1dfb5ad req-aee92d5b-edfa-41a2-93e2-eb29c9275b90 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:10.941683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-caae8c86-6bd8-4c4f-9167-95b4f1dfb5ad req-aee92d5b-edfa-41a2-93e2-eb29c9275b90 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:10.952596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-caae8c86-6bd8-4c4f-9167-95b4f1dfb5ad req-aee92d5b-edfa-41a2-93e2-eb29c9275b90 service nova] Creating event network-changed:ec1c9364-3199-41cb-89a1-3a76d09fecc6 for instance 5bf50e90-6712-4e3e-b813-653bfe69d460 on hv-cinder-85426 Aug 24 04:57:10.958154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-caae8c86-6bd8-4c4f-9167-95b4f1dfb5ad req-aee92d5b-edfa-41a2-93e2-eb29c9275b90 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031551 Aug 24 04:57:10.958766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 190/400] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:10.978438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-80c28b20-4ee9-4d25-9bcc-a417b3cff37d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:10.979290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-80c28b20-4ee9-4d25-9bcc-a417b3cff37d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:10.987525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-80c28b20-4ee9-4d25-9bcc-a417b3cff37d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:10.988100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-80c28b20-4ee9-4d25-9bcc-a417b3cff37d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:10.988789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-80c28b20-4ee9-4d25-9bcc-a417b3cff37d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:10.989504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:10.989983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-80c28b20-4ee9-4d25-9bcc-a417b3cff37d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:10.990343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:10.990593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-80c28b20-4ee9-4d25-9bcc-a417b3cff37d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:10.991113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-80c28b20-4ee9-4d25-9bcc-a417b3cff37d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:10.999389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:10.999949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:11.000458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:11.002006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:11.002554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:11.003735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:11.046084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:11.046484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:11.046939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:11.047385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lazy-loading 'fault' on Instance uuid 416b2fca-770f-4031-b545-db1103ce3144 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:57:11.050723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:11.096804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:11.104684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f201ecab-4c90-492c-a16b-b19b648bc33c tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1304 microversion: 2.1 time: 0.119942 Aug 24 04:57:11.105258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 191/401] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:10 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:11.127090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-80c28b20-4ee9-4d25-9bcc-a417b3cff37d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:11.135574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-80c28b20-4ee9-4d25-9bcc-a417b3cff37d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.162123 Aug 24 04:57:11.136159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 211/402] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:12.125920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:12.126528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:12.133365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:12.133846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:12.134280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:12.134999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:12.135480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:12.135901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:12.156242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-44b39e47-97ce-4fda-9696-484411f8b03b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:12.156851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-44b39e47-97ce-4fda-9696-484411f8b03b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:12.163486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b39e47-97ce-4fda-9696-484411f8b03b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:12.163962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b39e47-97ce-4fda-9696-484411f8b03b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:12.164393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b39e47-97ce-4fda-9696-484411f8b03b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:12.165090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b39e47-97ce-4fda-9696-484411f8b03b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:12.165524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b39e47-97ce-4fda-9696-484411f8b03b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:12.165945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b39e47-97ce-4fda-9696-484411f8b03b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:12.168689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:12.169420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:12.169850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:12.170285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lazy-loading 'fault' on Instance uuid 416b2fca-770f-4031-b545-db1103ce3144 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:57:12.212658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf7f64dfa824aa5915d040864d8101d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aad0244ef9c4fbe8877f26566c927a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:12.220512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-415880a9-8369-48fa-9299-c6f1d9479b1b tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 200 len: 1304 microversion: 2.1 time: 0.098507 Aug 24 04:57:12.221088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 192/403] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:12 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:12.305098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-44b39e47-97ce-4fda-9696-484411f8b03b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:12.312686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-44b39e47-97ce-4fda-9696-484411f8b03b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.160639 Aug 24 04:57:12.313249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 212/404] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:13.241128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:13.241914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] [instance: 416b2fca-770f-4031-b545-db1103ce3144] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:13.248276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:13.248970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:13.249410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:13.250102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:13.250554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:13.251174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:13.269477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] HTTP exception thrown: Instance 416b2fca-770f-4031-b545-db1103ce3144 could not be found. Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Request method failure captured: Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 HTTP/1.1 Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa-CwcZt5dSnf6RG48owID45-xzGICVF6997Ok0ckVjnqj90g__B3Ca4bMPtVFBRKVZ2uZ045ST3qOr3JYmAKmoYjsEAr0hKKDGkRxeOc_Xf-KdC3sGsv1EwWFOYriEsSmt-hXu2tMOsD1D7qKPZnuGTNHKNuiyRR38OontVxK0Rtwg Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 1aad0244ef9c4fbe8877f26566c927a8 Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-VolumesNegativeTest-1751964281 Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:57:13.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/1aad0244ef9c4fbe8877f26566c927a8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_1aad0244ef9c4fbe8877f26566c927a8", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1aad0244ef9c4fbe8877f26566c927a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/1aad0244ef9c4fbe8877f26566c927a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-VolumesNegativeTest-1751964281 Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 1aad0244ef9c4fbe8877f26566c927a8 Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-VolumesNegativeTest-1751964281 Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-VolumesNegativeTest-1751964281-project Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: abf7f64dfa824aa5915d040864d8101d Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-VolumesNegativeTest-1751964281-project Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 416b2fca-770f-4031-b545-db1103ce3144 could not be found. Aug 24 04:57:13.272905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '416b2fca-770f-4031-b545-db1103ce3144'} Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 416b2fca-770f-4031-b545-db1103ce3144 could not be found. Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:57:13.273770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 416b2fca-770f-4031-b545-db1103ce3144 could not be found. Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 416b2fca-770f-4031-b545-db1103ce3144 could not be found. Aug 24 04:57:13.275173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:57:13.277208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] Returning 404 to user: Instance 416b2fca-770f-4031-b545-db1103ce3144 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:57:13.278361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e821940a-c9ae-40aa-9ec0-414be69ee1e8 tempest-VolumesNegativeTest-1751964281 tempest-VolumesNegativeTest-1751964281-project] 10.222.0.97 "GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144" status: 404 len: 111 microversion: 2.1 time: 0.041465 Aug 24 04:57:13.278952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 193/405] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:13 2022] GET /compute/v2.1/servers/416b2fca-770f-4031-b545-db1103ce3144 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 04:57:13.335482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b0ebbb2e-4bfa-4f9a-b30a-e2353cee8a17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:13.336096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b0ebbb2e-4bfa-4f9a-b30a-e2353cee8a17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:13.343027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0ebbb2e-4bfa-4f9a-b30a-e2353cee8a17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:13.343756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0ebbb2e-4bfa-4f9a-b30a-e2353cee8a17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:13.344197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0ebbb2e-4bfa-4f9a-b30a-e2353cee8a17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:13.344894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0ebbb2e-4bfa-4f9a-b30a-e2353cee8a17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:13.345343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0ebbb2e-4bfa-4f9a-b30a-e2353cee8a17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:13.345937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0ebbb2e-4bfa-4f9a-b30a-e2353cee8a17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:13.495959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b0ebbb2e-4bfa-4f9a-b30a-e2353cee8a17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:13.506788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b0ebbb2e-4bfa-4f9a-b30a-e2353cee8a17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.176651 Aug 24 04:57:13.511055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 213/406] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:14.527048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-afc5a052-a99f-4ff7-950b-8320882345e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:14.527678 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-afc5a052-a99f-4ff7-950b-8320882345e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:14.534113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afc5a052-a99f-4ff7-950b-8320882345e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:14.534644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afc5a052-a99f-4ff7-950b-8320882345e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:14.535069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afc5a052-a99f-4ff7-950b-8320882345e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:14.535752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afc5a052-a99f-4ff7-950b-8320882345e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:14.536196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afc5a052-a99f-4ff7-950b-8320882345e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:14.536617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afc5a052-a99f-4ff7-950b-8320882345e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:14.684036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-afc5a052-a99f-4ff7-950b-8320882345e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:14.693077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-afc5a052-a99f-4ff7-950b-8320882345e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.169889 Aug 24 04:57:14.693641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 194/407] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:14 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:15.715304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-192702a7-3f01-4885-b30c-c9637f9a420e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:15.715905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-192702a7-3f01-4885-b30c-c9637f9a420e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:15.722496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-192702a7-3f01-4885-b30c-c9637f9a420e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:15.723012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-192702a7-3f01-4885-b30c-c9637f9a420e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:15.723442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-192702a7-3f01-4885-b30c-c9637f9a420e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:15.724120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-192702a7-3f01-4885-b30c-c9637f9a420e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:15.724564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-192702a7-3f01-4885-b30c-c9637f9a420e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:15.724977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-192702a7-3f01-4885-b30c-c9637f9a420e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:15.870499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-192702a7-3f01-4885-b30c-c9637f9a420e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:15.878203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-192702a7-3f01-4885-b30c-c9637f9a420e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.166851 Aug 24 04:57:15.878789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 214/408] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:16.150649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-cbfe8a13-130b-4080-bed0-b9a7258772d2 req-6104e856-449a-46ed-bcc5-c241dce13701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246c7f17-b6b8-470f-aa27-f23cac6e0df5", "name": "network-vif-plugged", "status": "completed", "tag": "0cfe0fe5-d04b-4a23-8aaa-9d12f5721acd"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:16.161876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-cbfe8a13-130b-4080-bed0-b9a7258772d2 req-6104e856-449a-46ed-bcc5-c241dce13701 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:16.162359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-cbfe8a13-130b-4080-bed0-b9a7258772d2 req-6104e856-449a-46ed-bcc5-c241dce13701 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:16.162793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-cbfe8a13-130b-4080-bed0-b9a7258772d2 req-6104e856-449a-46ed-bcc5-c241dce13701 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:16.175069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-cbfe8a13-130b-4080-bed0-b9a7258772d2 req-6104e856-449a-46ed-bcc5-c241dce13701 service nova] Creating event network-vif-plugged:0cfe0fe5-d04b-4a23-8aaa-9d12f5721acd for instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 on hv-cinder-85426 Aug 24 04:57:16.181977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-cbfe8a13-130b-4080-bed0-b9a7258772d2 req-6104e856-449a-46ed-bcc5-c241dce13701 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035662 Aug 24 04:57:16.182619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 195/409] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:16.899125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6565cb51-9d8e-4236-b23f-fcd99c249ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:16.899649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6565cb51-9d8e-4236-b23f-fcd99c249ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:16.905599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6565cb51-9d8e-4236-b23f-fcd99c249ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:16.906075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6565cb51-9d8e-4236-b23f-fcd99c249ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:16.906506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6565cb51-9d8e-4236-b23f-fcd99c249ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:16.907214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6565cb51-9d8e-4236-b23f-fcd99c249ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:16.907663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6565cb51-9d8e-4236-b23f-fcd99c249ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:16.908081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6565cb51-9d8e-4236-b23f-fcd99c249ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:17.035959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6565cb51-9d8e-4236-b23f-fcd99c249ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:17.043557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6565cb51-9d8e-4236-b23f-fcd99c249ef6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.148361 Aug 24 04:57:17.044390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 215/410] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:18.065773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cf0ad750-1981-413d-bde9-4c01bfc437fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:18.066600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cf0ad750-1981-413d-bde9-4c01bfc437fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:18.075757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf0ad750-1981-413d-bde9-4c01bfc437fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:18.076433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf0ad750-1981-413d-bde9-4c01bfc437fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:18.076864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf0ad750-1981-413d-bde9-4c01bfc437fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:18.077556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf0ad750-1981-413d-bde9-4c01bfc437fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:18.078168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf0ad750-1981-413d-bde9-4c01bfc437fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:18.078426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cf0ad750-1981-413d-bde9-4c01bfc437fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:18.219074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cf0ad750-1981-413d-bde9-4c01bfc437fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:18.227038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cf0ad750-1981-413d-bde9-4c01bfc437fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1371 microversion: 2.1 time: 0.165941 Aug 24 04:57:18.227602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 196/411] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:19.247707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cf0cd199-4da5-4cbb-8711-b1b21d18b403 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:19.248314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cf0cd199-4da5-4cbb-8711-b1b21d18b403 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:19.254360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf0cd199-4da5-4cbb-8711-b1b21d18b403 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:19.254936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf0cd199-4da5-4cbb-8711-b1b21d18b403 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:19.255366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf0cd199-4da5-4cbb-8711-b1b21d18b403 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:19.256104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf0cd199-4da5-4cbb-8711-b1b21d18b403 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:19.256586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf0cd199-4da5-4cbb-8711-b1b21d18b403 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:19.257003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf0cd199-4da5-4cbb-8711-b1b21d18b403 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:19.389305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cf0cd199-4da5-4cbb-8711-b1b21d18b403 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:19.397514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cf0cd199-4da5-4cbb-8711-b1b21d18b403 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1565 microversion: 2.1 time: 0.153718 Aug 24 04:57:19.398078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 216/412] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:19.417981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a1c054dc-a15e-4d6c-a73d-e22f2daef58d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:19.418478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a1c054dc-a15e-4d6c-a73d-e22f2daef58d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:19.425233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1c054dc-a15e-4d6c-a73d-e22f2daef58d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:19.425708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1c054dc-a15e-4d6c-a73d-e22f2daef58d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:19.426138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1c054dc-a15e-4d6c-a73d-e22f2daef58d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:19.426871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1c054dc-a15e-4d6c-a73d-e22f2daef58d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:19.427321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1c054dc-a15e-4d6c-a73d-e22f2daef58d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:19.427738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1c054dc-a15e-4d6c-a73d-e22f2daef58d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:19.502369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a1c054dc-a15e-4d6c-a73d-e22f2daef58d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088173 Aug 24 04:57:19.503004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 197/413] 10.222.0.97 () {58 vars in 1275 bytes} [Wed Aug 24 04:57:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:57:20.716826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-e8dba011-1c9b-4302-b2c2-b40f6e37b5f5 req-68ffdaaf-c42f-4ce6-b053-f3ad3dcdefc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "246c7f17-b6b8-470f-aa27-f23cac6e0df5", "tag": "0cfe0fe5-d04b-4a23-8aaa-9d12f5721acd"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:20.727956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-e8dba011-1c9b-4302-b2c2-b40f6e37b5f5 req-68ffdaaf-c42f-4ce6-b053-f3ad3dcdefc0 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:20.728510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-e8dba011-1c9b-4302-b2c2-b40f6e37b5f5 req-68ffdaaf-c42f-4ce6-b053-f3ad3dcdefc0 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:20.729005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-e8dba011-1c9b-4302-b2c2-b40f6e37b5f5 req-68ffdaaf-c42f-4ce6-b053-f3ad3dcdefc0 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:20.744074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-e8dba011-1c9b-4302-b2c2-b40f6e37b5f5 req-68ffdaaf-c42f-4ce6-b053-f3ad3dcdefc0 service nova] Creating event network-changed:0cfe0fe5-d04b-4a23-8aaa-9d12f5721acd for instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 on hv-cinder-85426 Aug 24 04:57:20.749866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-e8dba011-1c9b-4302-b2c2-b40f6e37b5f5 req-68ffdaaf-c42f-4ce6-b053-f3ad3dcdefc0 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036572 Aug 24 04:57:20.750780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 217/414] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:26.556178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-693438661", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "networks": [{"uuid": "18edd128-d86f-4aed-9486-9d8caf6c19dc"}]}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:26.564784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=64 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:26.610704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] validate_networks() for [('18edd128-d86f-4aed-9486-9d8caf6c19dc', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:57:26.959741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:57:26.960150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:57:26.960639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:57:26.961036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:57:26.961436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:57:26.971069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:26.972112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:26.972545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:26.973253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:26.973700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:26.974113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:26.991236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Getting quotas for project 3b37fd4d710b4a7ba471c224324d2a87. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:57:26.995155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Getting quotas for user fde5a0eecb8d411c82238c1ac3d4c0f1 and project 3b37fd4d710b4a7ba471c224324d2a87. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:57:27.005863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:57:27.008125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:57:27.053072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fb551f49-7e30-49c6-a982-e5df6fdfe820 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501253 Aug 24 04:57:27.053701 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 198/415] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:57:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:57:27.064725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3d96c2b5-4e87-472b-b3b2-ca4022de7747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:27.065673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3d96c2b5-4e87-472b-b3b2-ca4022de7747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:27.120474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3d96c2b5-4e87-472b-b3b2-ca4022de7747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:27.127503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3d96c2b5-4e87-472b-b3b2-ca4022de7747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1218 microversion: 2.1 time: 0.066884 Aug 24 04:57:27.128230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 218/416] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:27 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:28.149003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2612c994-7a7d-4939-aca8-7810f959c5e1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:28.149517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2612c994-7a7d-4939-aca8-7810f959c5e1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:28.155539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2612c994-7a7d-4939-aca8-7810f959c5e1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:28.156006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2612c994-7a7d-4939-aca8-7810f959c5e1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:28.156431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2612c994-7a7d-4939-aca8-7810f959c5e1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:28.157100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2612c994-7a7d-4939-aca8-7810f959c5e1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:28.157542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2612c994-7a7d-4939-aca8-7810f959c5e1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:28.157952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2612c994-7a7d-4939-aca8-7810f959c5e1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:28.218853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2612c994-7a7d-4939-aca8-7810f959c5e1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:28.227201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2612c994-7a7d-4939-aca8-7810f959c5e1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1222 microversion: 2.1 time: 0.082630 Aug 24 04:57:28.227762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 199/417] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:28 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:29.247636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-916b272d-6f58-483c-b782-4c60c3fcfffd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:29.248242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-916b272d-6f58-483c-b782-4c60c3fcfffd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:29.254552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-916b272d-6f58-483c-b782-4c60c3fcfffd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:29.255063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-916b272d-6f58-483c-b782-4c60c3fcfffd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:29.255496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-916b272d-6f58-483c-b782-4c60c3fcfffd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:29.256178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-916b272d-6f58-483c-b782-4c60c3fcfffd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:29.256629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-916b272d-6f58-483c-b782-4c60c3fcfffd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:29.257051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-916b272d-6f58-483c-b782-4c60c3fcfffd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:29.317279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-916b272d-6f58-483c-b782-4c60c3fcfffd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:29.324858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-916b272d-6f58-483c-b782-4c60c3fcfffd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1222 microversion: 2.1 time: 0.081127 Aug 24 04:57:29.325420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 219/418] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:29 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:30.345653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-775a1adc-e54d-45fb-ba79-18563774aafd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:30.346203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-775a1adc-e54d-45fb-ba79-18563774aafd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:30.352806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-775a1adc-e54d-45fb-ba79-18563774aafd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:30.353288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-775a1adc-e54d-45fb-ba79-18563774aafd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:30.353755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-775a1adc-e54d-45fb-ba79-18563774aafd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:30.354436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-775a1adc-e54d-45fb-ba79-18563774aafd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:30.354915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-775a1adc-e54d-45fb-ba79-18563774aafd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:30.355340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-775a1adc-e54d-45fb-ba79-18563774aafd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:30.420477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-775a1adc-e54d-45fb-ba79-18563774aafd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:30.429339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-775a1adc-e54d-45fb-ba79-18563774aafd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1214 microversion: 2.1 time: 0.087635 Aug 24 04:57:30.429920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 200/419] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:30 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:31.452877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2381b378-601b-42e0-b0cb-9353d1d04229 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:31.453728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2381b378-601b-42e0-b0cb-9353d1d04229 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:31.460597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2381b378-601b-42e0-b0cb-9353d1d04229 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:31.461452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2381b378-601b-42e0-b0cb-9353d1d04229 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:31.461890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2381b378-601b-42e0-b0cb-9353d1d04229 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:31.462578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2381b378-601b-42e0-b0cb-9353d1d04229 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:31.463055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2381b378-601b-42e0-b0cb-9353d1d04229 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:31.463507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2381b378-601b-42e0-b0cb-9353d1d04229 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:31.528604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2381b378-601b-42e0-b0cb-9353d1d04229 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:31.537861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2381b378-601b-42e0-b0cb-9353d1d04229 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1276 microversion: 2.1 time: 0.088881 Aug 24 04:57:31.539036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 220/420] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:31 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:32.434072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-58bf5d36-6b38-4073-968f-cf3359524297 req-1eeaef30-bf27-47c9-b175-4afce9b00c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d091aa0-b746-4b6a-96d6-f09eadcac6f3", "tag": "7e56121e-83d5-4171-94e4-2b46d8be4bd5"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:32.444013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-58bf5d36-6b38-4073-968f-cf3359524297 req-1eeaef30-bf27-47c9-b175-4afce9b00c0c service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:32.444502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-58bf5d36-6b38-4073-968f-cf3359524297 req-1eeaef30-bf27-47c9-b175-4afce9b00c0c service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:32.444932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-58bf5d36-6b38-4073-968f-cf3359524297 req-1eeaef30-bf27-47c9-b175-4afce9b00c0c service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:32.456200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-58bf5d36-6b38-4073-968f-cf3359524297 req-1eeaef30-bf27-47c9-b175-4afce9b00c0c service nova] Creating event network-changed:7e56121e-83d5-4171-94e4-2b46d8be4bd5 for instance 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 on hv-cinder-85426 Aug 24 04:57:32.461036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-58bf5d36-6b38-4073-968f-cf3359524297 req-1eeaef30-bf27-47c9-b175-4afce9b00c0c service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030573 Aug 24 04:57:32.461633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 201/421] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:32.559093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c64cafed-b5ed-4a0b-b919-0caca5dc43d5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:32.559706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c64cafed-b5ed-4a0b-b919-0caca5dc43d5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:32.565612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c64cafed-b5ed-4a0b-b919-0caca5dc43d5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:32.566090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c64cafed-b5ed-4a0b-b919-0caca5dc43d5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:32.566519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c64cafed-b5ed-4a0b-b919-0caca5dc43d5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:32.567225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c64cafed-b5ed-4a0b-b919-0caca5dc43d5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:32.567672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c64cafed-b5ed-4a0b-b919-0caca5dc43d5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:32.568088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c64cafed-b5ed-4a0b-b919-0caca5dc43d5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:32.697566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c64cafed-b5ed-4a0b-b919-0caca5dc43d5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:32.705101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c64cafed-b5ed-4a0b-b919-0caca5dc43d5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.149858 Aug 24 04:57:32.706173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 221/422] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:32 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:33.727780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-094f52ab-19d1-45e8-988a-6eafa3835a36 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:33.728497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-094f52ab-19d1-45e8-988a-6eafa3835a36 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:33.734623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-094f52ab-19d1-45e8-988a-6eafa3835a36 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:33.735458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-094f52ab-19d1-45e8-988a-6eafa3835a36 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:33.736223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-094f52ab-19d1-45e8-988a-6eafa3835a36 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:33.736545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-094f52ab-19d1-45e8-988a-6eafa3835a36 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:33.737660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-094f52ab-19d1-45e8-988a-6eafa3835a36 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:33.738079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-094f52ab-19d1-45e8-988a-6eafa3835a36 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:33.868837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-094f52ab-19d1-45e8-988a-6eafa3835a36 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:33.876405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-094f52ab-19d1-45e8-988a-6eafa3835a36 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.153419 Aug 24 04:57:33.876964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 202/423] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:33 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:34.897277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-627f1739-f718-4e5d-9cfb-711b831d7c12 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:34.897886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-627f1739-f718-4e5d-9cfb-711b831d7c12 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:34.903849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-627f1739-f718-4e5d-9cfb-711b831d7c12 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:34.904324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-627f1739-f718-4e5d-9cfb-711b831d7c12 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:34.904752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-627f1739-f718-4e5d-9cfb-711b831d7c12 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:34.905425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-627f1739-f718-4e5d-9cfb-711b831d7c12 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:34.905868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-627f1739-f718-4e5d-9cfb-711b831d7c12 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:34.906310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-627f1739-f718-4e5d-9cfb-711b831d7c12 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:35.036529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-627f1739-f718-4e5d-9cfb-711b831d7c12 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:35.044476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-627f1739-f718-4e5d-9cfb-711b831d7c12 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.150975 Aug 24 04:57:35.044975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 222/424] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:34 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:36.065649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1bac6e61-dbfd-4efa-a55f-99e3568a6911 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:36.066390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1bac6e61-dbfd-4efa-a55f-99e3568a6911 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:36.072915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bac6e61-dbfd-4efa-a55f-99e3568a6911 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:36.073395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bac6e61-dbfd-4efa-a55f-99e3568a6911 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:36.073832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bac6e61-dbfd-4efa-a55f-99e3568a6911 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:36.074518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bac6e61-dbfd-4efa-a55f-99e3568a6911 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:36.075006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bac6e61-dbfd-4efa-a55f-99e3568a6911 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:36.075428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1bac6e61-dbfd-4efa-a55f-99e3568a6911 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:36.208362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1bac6e61-dbfd-4efa-a55f-99e3568a6911 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:36.215947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1bac6e61-dbfd-4efa-a55f-99e3568a6911 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.154261 Aug 24 04:57:36.216496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 203/425] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:36 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:37.237001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f9e000ac-4b75-4b58-be44-7189a51c1292 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:37.237628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f9e000ac-4b75-4b58-be44-7189a51c1292 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:37.240384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:37.241020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=46 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:37.246665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9e000ac-4b75-4b58-be44-7189a51c1292 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:37.247170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9e000ac-4b75-4b58-be44-7189a51c1292 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:37.247600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9e000ac-4b75-4b58-be44-7189a51c1292 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:37.248277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9e000ac-4b75-4b58-be44-7189a51c1292 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:37.248724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9e000ac-4b75-4b58-be44-7189a51c1292 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:37.249138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9e000ac-4b75-4b58-be44-7189a51c1292 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:37.379601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f9e000ac-4b75-4b58-be44-7189a51c1292 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:37.389465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f9e000ac-4b75-4b58-be44-7189a51c1292 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.156445 Aug 24 04:57:37.390033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 223/426] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:37 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:38.410566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-66ae2df0-7c46-4a02-8af0-891c17a224af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:38.412869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-66ae2df0-7c46-4a02-8af0-891c17a224af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:38.414863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:38.415530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=6 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:38.422079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66ae2df0-7c46-4a02-8af0-891c17a224af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:38.422566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66ae2df0-7c46-4a02-8af0-891c17a224af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:38.423028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66ae2df0-7c46-4a02-8af0-891c17a224af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:38.423722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66ae2df0-7c46-4a02-8af0-891c17a224af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:38.424176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66ae2df0-7c46-4a02-8af0-891c17a224af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:38.424598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66ae2df0-7c46-4a02-8af0-891c17a224af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:38.560377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-66ae2df0-7c46-4a02-8af0-891c17a224af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:38.569140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-66ae2df0-7c46-4a02-8af0-891c17a224af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.162544 Aug 24 04:57:38.569795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 204/427] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:38 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:39.589696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a2501d2a-e5f5-4eb3-8394-9a4cbc6d575d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:39.590302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a2501d2a-e5f5-4eb3-8394-9a4cbc6d575d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:39.596343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2501d2a-e5f5-4eb3-8394-9a4cbc6d575d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:39.596819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2501d2a-e5f5-4eb3-8394-9a4cbc6d575d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:39.597250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2501d2a-e5f5-4eb3-8394-9a4cbc6d575d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:39.597928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2501d2a-e5f5-4eb3-8394-9a4cbc6d575d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:39.598383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2501d2a-e5f5-4eb3-8394-9a4cbc6d575d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:39.598828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2501d2a-e5f5-4eb3-8394-9a4cbc6d575d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:39.724585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a2501d2a-e5f5-4eb3-8394-9a4cbc6d575d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:39.732376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a2501d2a-e5f5-4eb3-8394-9a4cbc6d575d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.146502 Aug 24 04:57:39.733079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 224/428] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:39 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:40.557676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:57:40.557840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 04:57:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:57:40.753411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-57ac48d5-3d84-41b3-a95b-d190679b2356 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:40.753977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-57ac48d5-3d84-41b3-a95b-d190679b2356 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:40.761243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57ac48d5-3d84-41b3-a95b-d190679b2356 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:40.761727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57ac48d5-3d84-41b3-a95b-d190679b2356 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:40.762161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57ac48d5-3d84-41b3-a95b-d190679b2356 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:40.762888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57ac48d5-3d84-41b3-a95b-d190679b2356 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:40.763349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57ac48d5-3d84-41b3-a95b-d190679b2356 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:40.763772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57ac48d5-3d84-41b3-a95b-d190679b2356 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:40.890713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-57ac48d5-3d84-41b3-a95b-d190679b2356 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:40.899752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-57ac48d5-3d84-41b3-a95b-d190679b2356 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.149832 Aug 24 04:57:40.899863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 205/429] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:40 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:41.920183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b735ade3-e46c-4717-b283-cc2e6c47e58c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:41.920787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b735ade3-e46c-4717-b283-cc2e6c47e58c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:41.926925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b735ade3-e46c-4717-b283-cc2e6c47e58c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:41.927403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b735ade3-e46c-4717-b283-cc2e6c47e58c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:41.927830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b735ade3-e46c-4717-b283-cc2e6c47e58c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:41.928507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b735ade3-e46c-4717-b283-cc2e6c47e58c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:41.928956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b735ade3-e46c-4717-b283-cc2e6c47e58c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:41.929369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b735ade3-e46c-4717-b283-cc2e6c47e58c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:41.931882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=76 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:42.072317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b735ade3-e46c-4717-b283-cc2e6c47e58c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:42.080742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b735ade3-e46c-4717-b283-cc2e6c47e58c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.164630 Aug 24 04:57:42.081445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 225/430] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:41 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:43.102317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-89245d35-9910-45af-83c4-5aff320e41a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:43.102943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-89245d35-9910-45af-83c4-5aff320e41a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:43.109536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89245d35-9910-45af-83c4-5aff320e41a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:43.110015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89245d35-9910-45af-83c4-5aff320e41a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:43.110443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89245d35-9910-45af-83c4-5aff320e41a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:43.111155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89245d35-9910-45af-83c4-5aff320e41a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:43.111608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89245d35-9910-45af-83c4-5aff320e41a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:43.112024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89245d35-9910-45af-83c4-5aff320e41a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:43.114567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=72 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:43.248915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-89245d35-9910-45af-83c4-5aff320e41a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:43.257741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-89245d35-9910-45af-83c4-5aff320e41a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.159307 Aug 24 04:57:43.258321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 206/431] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:43 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:44.278338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-24973555-d33e-4a3a-9211-3a59dc73c8da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:44.278963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-24973555-d33e-4a3a-9211-3a59dc73c8da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:44.284844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24973555-d33e-4a3a-9211-3a59dc73c8da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:44.285314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24973555-d33e-4a3a-9211-3a59dc73c8da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:44.286494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24973555-d33e-4a3a-9211-3a59dc73c8da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:44.287198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24973555-d33e-4a3a-9211-3a59dc73c8da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:44.287642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24973555-d33e-4a3a-9211-3a59dc73c8da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:44.288053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24973555-d33e-4a3a-9211-3a59dc73c8da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:44.413029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-24973555-d33e-4a3a-9211-3a59dc73c8da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:44.420965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-24973555-d33e-4a3a-9211-3a59dc73c8da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.146415 Aug 24 04:57:44.421519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 226/432] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:44 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:44.736909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-e7a7ed67-6950-42cf-8b12-27d50d50fe45 req-c454ca63-fc9a-4f2e-8ab6-d457837ad05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d091aa0-b746-4b6a-96d6-f09eadcac6f3", "name": "network-vif-plugged", "status": "completed", "tag": "7e56121e-83d5-4171-94e4-2b46d8be4bd5"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:57:44.748299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-e7a7ed67-6950-42cf-8b12-27d50d50fe45 req-c454ca63-fc9a-4f2e-8ab6-d457837ad05d service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:44.748780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-e7a7ed67-6950-42cf-8b12-27d50d50fe45 req-c454ca63-fc9a-4f2e-8ab6-d457837ad05d service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:44.749377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-e7a7ed67-6950-42cf-8b12-27d50d50fe45 req-c454ca63-fc9a-4f2e-8ab6-d457837ad05d service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:44.761524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-e7a7ed67-6950-42cf-8b12-27d50d50fe45 req-c454ca63-fc9a-4f2e-8ab6-d457837ad05d service nova] Creating event network-vif-plugged:7e56121e-83d5-4171-94e4-2b46d8be4bd5 for instance 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 on hv-cinder-85426 Aug 24 04:57:44.766508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-e7a7ed67-6950-42cf-8b12-27d50d50fe45 req-c454ca63-fc9a-4f2e-8ab6-d457837ad05d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033610 Aug 24 04:57:44.767324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 207/433] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:57:45.442327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dc0a81ce-af91-4f1d-bf6d-8fd6e45d9e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:45.443155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dc0a81ce-af91-4f1d-bf6d-8fd6e45d9e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:45.449121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0a81ce-af91-4f1d-bf6d-8fd6e45d9e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:45.449596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0a81ce-af91-4f1d-bf6d-8fd6e45d9e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:45.450027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0a81ce-af91-4f1d-bf6d-8fd6e45d9e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:45.450712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0a81ce-af91-4f1d-bf6d-8fd6e45d9e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:45.451170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0a81ce-af91-4f1d-bf6d-8fd6e45d9e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:45.451584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0a81ce-af91-4f1d-bf6d-8fd6e45d9e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:45.576915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dc0a81ce-af91-4f1d-bf6d-8fd6e45d9e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:45.584490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dc0a81ce-af91-4f1d-bf6d-8fd6e45d9e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.146624 Aug 24 04:57:45.585074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 227/434] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:45 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:46.605718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5da48862-3a89-43ce-8df9-bb72a2d68584 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:46.606417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5da48862-3a89-43ce-8df9-bb72a2d68584 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:46.613087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5da48862-3a89-43ce-8df9-bb72a2d68584 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:46.614094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5da48862-3a89-43ce-8df9-bb72a2d68584 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:46.614578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5da48862-3a89-43ce-8df9-bb72a2d68584 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:46.615357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5da48862-3a89-43ce-8df9-bb72a2d68584 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:46.615809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5da48862-3a89-43ce-8df9-bb72a2d68584 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:46.616228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5da48862-3a89-43ce-8df9-bb72a2d68584 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:46.755181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5da48862-3a89-43ce-8df9-bb72a2d68584 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:46.764247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5da48862-3a89-43ce-8df9-bb72a2d68584 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1318 microversion: 2.1 time: 0.162576 Aug 24 04:57:46.764746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 208/435] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:46 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:57:47.785373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c69665b6-6924-48ba-9f53-4765cbad4044 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:57:47.786725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c69665b6-6924-48ba-9f53-4765cbad4044 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:57:47.792674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c69665b6-6924-48ba-9f53-4765cbad4044 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:47.793149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c69665b6-6924-48ba-9f53-4765cbad4044 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:47.793584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c69665b6-6924-48ba-9f53-4765cbad4044 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:47.794529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c69665b6-6924-48ba-9f53-4765cbad4044 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:57:47.795002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c69665b6-6924-48ba-9f53-4765cbad4044 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:57:47.795438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c69665b6-6924-48ba-9f53-4765cbad4044 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:57:47.924441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c69665b6-6924-48ba-9f53-4765cbad4044 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:57:47.932397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c69665b6-6924-48ba-9f53-4765cbad4044 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1507 microversion: 2.1 time: 0.150941 Aug 24 04:57:47.932955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 228/436] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:57:47 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:11.717433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-626d122e-33b4-4628-8f97-1f4c2942a709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:11.718031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-626d122e-33b4-4628-8f97-1f4c2942a709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:11.720123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:11.720843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=13 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:11.727102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-626d122e-33b4-4628-8f97-1f4c2942a709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:11.727586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-626d122e-33b4-4628-8f97-1f4c2942a709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:11.728022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-626d122e-33b4-4628-8f97-1f4c2942a709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:11.728723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-626d122e-33b4-4628-8f97-1f4c2942a709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:11.729177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-626d122e-33b4-4628-8f97-1f4c2942a709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:11.729600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-626d122e-33b4-4628-8f97-1f4c2942a709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:11.756883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-626d122e-33b4-4628-8f97-1f4c2942a709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/ips" status: 200 len: 145 microversion: 2.1 time: 0.043565 Aug 24 04:58:11.757535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 209/437] 10.222.0.97 () {58 vars in 1248 bytes} [Wed Aug 24 04:58:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:58:12.675731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-94ffb425-f7b3-4b52-bccd-913845ed231a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:12.676218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-94ffb425-f7b3-4b52-bccd-913845ed231a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:12.681891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=11 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:12.682859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=23 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:12.684835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94ffb425-f7b3-4b52-bccd-913845ed231a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:12.685541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94ffb425-f7b3-4b52-bccd-913845ed231a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:12.685995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94ffb425-f7b3-4b52-bccd-913845ed231a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:12.686672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94ffb425-f7b3-4b52-bccd-913845ed231a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:12.687142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94ffb425-f7b3-4b52-bccd-913845ed231a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:12.687559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94ffb425-f7b3-4b52-bccd-913845ed231a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:12.713001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-94ffb425-f7b3-4b52-bccd-913845ed231a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/ips" status: 200 len: 148 microversion: 2.1 time: 0.041044 Aug 24 04:58:12.713874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 229/438] 10.222.0.97 () {58 vars in 1248 bytes} [Wed Aug 24 04:58:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:58:13.635687 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-504fcad1-04a4-4871-a253-1b372d63e24e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d507227-101c-4259-a336-6d22a9768e17", "device": "/dev/sdb"}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:58:13.638490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-504fcad1-04a4-4871-a253-1b372d63e24e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:13.644930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-504fcad1-04a4-4871-a253-1b372d63e24e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:13.646226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-504fcad1-04a4-4871-a253-1b372d63e24e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:13.646662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-504fcad1-04a4-4871-a253-1b372d63e24e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:13.647367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-504fcad1-04a4-4871-a253-1b372d63e24e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:13.647817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-504fcad1-04a4-4871-a253-1b372d63e24e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:13.648237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-504fcad1-04a4-4871-a253-1b372d63e24e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:13.943772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-504fcad1-04a4-4871-a253-1b372d63e24e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "POST /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311961 Aug 24 04:58:13.944447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 210/439] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 04:58:13 2022] POST /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:58:14.852243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0a515ed0-1da5-42ae-bd3a-9261b181799b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a41d43cd-8f3b-4903-87e9-f197542e059f"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:58:14.854705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0a515ed0-1da5-42ae-bd3a-9261b181799b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:14.860671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a515ed0-1da5-42ae-bd3a-9261b181799b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:14.861136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a515ed0-1da5-42ae-bd3a-9261b181799b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:14.861559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a515ed0-1da5-42ae-bd3a-9261b181799b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:14.862226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a515ed0-1da5-42ae-bd3a-9261b181799b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:14.862669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a515ed0-1da5-42ae-bd3a-9261b181799b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:14.863103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a515ed0-1da5-42ae-bd3a-9261b181799b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:15.152065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-263ac256-5d4a-4333-bee0-563f8c0ed498 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cda133e-f89a-444c-bfa5-9a4d23378818"}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:58:15.155317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-263ac256-5d4a-4333-bee0-563f8c0ed498 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:15.162921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-263ac256-5d4a-4333-bee0-563f8c0ed498 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:15.163611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-263ac256-5d4a-4333-bee0-563f8c0ed498 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:15.164341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-263ac256-5d4a-4333-bee0-563f8c0ed498 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:15.165175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-263ac256-5d4a-4333-bee0-563f8c0ed498 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:15.165633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-263ac256-5d4a-4333-bee0-563f8c0ed498 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:15.166060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-263ac256-5d4a-4333-bee0-563f8c0ed498 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:15.169746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0a515ed0-1da5-42ae-bd3a-9261b181799b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "POST /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321086 Aug 24 04:58:15.170731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 230/440] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 04:58:14 2022] POST /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:58:15.448189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-263ac256-5d4a-4333-bee0-563f8c0ed498 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300821 Aug 24 04:58:15.448797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 211/441] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 04:58:15 2022] POST /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:58:31.154456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=4 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:31.155249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:31.159453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a03a9248-fabd-4d22-b363-92b4d56bdaed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:58:31.167424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a03a9248-fabd-4d22-b363-92b4d56bdaed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:31.167897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a03a9248-fabd-4d22-b363-92b4d56bdaed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:31.168326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a03a9248-fabd-4d22-b363-92b4d56bdaed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:31.229576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a03a9248-fabd-4d22-b363-92b4d56bdaed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Going to try to stop instance {{(pid=120558) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 24 04:58:31.270442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a03a9248-fabd-4d22-b363-92b4d56bdaed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "POST /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/action" status: 202 len: 0 microversion: 2.1 time: 0.116683 Aug 24 04:58:31.271080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 231/442] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 04:58:31 2022] POST /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:58:31.276983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=6 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:31.277742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:31.281804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-36ee2445-9eb1-4aab-a390-b6e945f46442 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:31.282524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-36ee2445-9eb1-4aab-a390-b6e945f46442 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:31.290223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36ee2445-9eb1-4aab-a390-b6e945f46442 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:31.290713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36ee2445-9eb1-4aab-a390-b6e945f46442 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:31.291140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36ee2445-9eb1-4aab-a390-b6e945f46442 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:31.291858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36ee2445-9eb1-4aab-a390-b6e945f46442 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:31.292252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36ee2445-9eb1-4aab-a390-b6e945f46442 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:31.292663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36ee2445-9eb1-4aab-a390-b6e945f46442 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:31.425638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-36ee2445-9eb1-4aab-a390-b6e945f46442 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:31.436047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-36ee2445-9eb1-4aab-a390-b6e945f46442 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.160580 Aug 24 04:58:31.436616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 212/443] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:32.458438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bbe30694-6d50-4adf-a8d9-36914c438ede tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:32.459250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bbe30694-6d50-4adf-a8d9-36914c438ede tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:32.465281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bbe30694-6d50-4adf-a8d9-36914c438ede tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:32.465752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bbe30694-6d50-4adf-a8d9-36914c438ede tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:32.466180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bbe30694-6d50-4adf-a8d9-36914c438ede tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:32.466887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bbe30694-6d50-4adf-a8d9-36914c438ede tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:32.467337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bbe30694-6d50-4adf-a8d9-36914c438ede tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:32.467749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bbe30694-6d50-4adf-a8d9-36914c438ede tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:32.601130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bbe30694-6d50-4adf-a8d9-36914c438ede tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:32.610447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bbe30694-6d50-4adf-a8d9-36914c438ede tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.157013 Aug 24 04:58:32.610971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 232/444] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:33.633183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9b4c9699-8d30-440e-bae1-a6b91d4d6343 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:33.634082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9b4c9699-8d30-440e-bae1-a6b91d4d6343 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:33.641653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b4c9699-8d30-440e-bae1-a6b91d4d6343 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:33.642146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b4c9699-8d30-440e-bae1-a6b91d4d6343 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:33.642564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b4c9699-8d30-440e-bae1-a6b91d4d6343 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:33.643271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b4c9699-8d30-440e-bae1-a6b91d4d6343 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:33.643721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b4c9699-8d30-440e-bae1-a6b91d4d6343 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:33.644137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b4c9699-8d30-440e-bae1-a6b91d4d6343 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:33.772143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9b4c9699-8d30-440e-bae1-a6b91d4d6343 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:33.780362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9b4c9699-8d30-440e-bae1-a6b91d4d6343 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.152230 Aug 24 04:58:33.780926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 213/445] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:34.802200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3ecbc72f-ac47-45c6-89ae-fa4ec0eaa598 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:34.802848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3ecbc72f-ac47-45c6-89ae-fa4ec0eaa598 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:34.809240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ecbc72f-ac47-45c6-89ae-fa4ec0eaa598 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:34.809709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ecbc72f-ac47-45c6-89ae-fa4ec0eaa598 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:34.810160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ecbc72f-ac47-45c6-89ae-fa4ec0eaa598 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:34.810858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ecbc72f-ac47-45c6-89ae-fa4ec0eaa598 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:34.811299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ecbc72f-ac47-45c6-89ae-fa4ec0eaa598 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:34.811705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ecbc72f-ac47-45c6-89ae-fa4ec0eaa598 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:34.942981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3ecbc72f-ac47-45c6-89ae-fa4ec0eaa598 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:34.951073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3ecbc72f-ac47-45c6-89ae-fa4ec0eaa598 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.153392 Aug 24 04:58:34.951631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 233/446] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:35.972029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5845986f-6d0f-4fa4-875a-4430f9782733 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:35.972644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5845986f-6d0f-4fa4-875a-4430f9782733 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:35.979763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5845986f-6d0f-4fa4-875a-4430f9782733 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:35.980303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5845986f-6d0f-4fa4-875a-4430f9782733 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:35.980760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5845986f-6d0f-4fa4-875a-4430f9782733 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:35.981454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5845986f-6d0f-4fa4-875a-4430f9782733 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:35.981907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5845986f-6d0f-4fa4-875a-4430f9782733 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:35.982328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5845986f-6d0f-4fa4-875a-4430f9782733 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:36.359886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5845986f-6d0f-4fa4-875a-4430f9782733 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:36.368122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5845986f-6d0f-4fa4-875a-4430f9782733 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.399970 Aug 24 04:58:36.368682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 214/447] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:37.389028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8d54dde3-a254-4352-ada3-782341279fe0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:37.389609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8d54dde3-a254-4352-ada3-782341279fe0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:37.396215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d54dde3-a254-4352-ada3-782341279fe0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:37.396693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d54dde3-a254-4352-ada3-782341279fe0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:37.397124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d54dde3-a254-4352-ada3-782341279fe0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:37.397811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d54dde3-a254-4352-ada3-782341279fe0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:37.398260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d54dde3-a254-4352-ada3-782341279fe0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:37.398704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d54dde3-a254-4352-ada3-782341279fe0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:37.525356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8d54dde3-a254-4352-ada3-782341279fe0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:37.533336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8d54dde3-a254-4352-ada3-782341279fe0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.148189 Aug 24 04:58:37.533888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 234/448] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:38.556129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1733d58c-374b-4261-ad38-1940b9a073d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:38.556737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1733d58c-374b-4261-ad38-1940b9a073d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:38.563230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1733d58c-374b-4261-ad38-1940b9a073d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:38.563711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1733d58c-374b-4261-ad38-1940b9a073d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:38.564145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1733d58c-374b-4261-ad38-1940b9a073d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:38.564828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1733d58c-374b-4261-ad38-1940b9a073d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:38.565281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1733d58c-374b-4261-ad38-1940b9a073d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:38.565703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1733d58c-374b-4261-ad38-1940b9a073d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:38.693760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1733d58c-374b-4261-ad38-1940b9a073d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:38.701936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1733d58c-374b-4261-ad38-1940b9a073d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.149642 Aug 24 04:58:38.702535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 215/449] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:39.723591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a078a584-4eb0-4428-aa74-cec255e42173 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:39.724131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a078a584-4eb0-4428-aa74-cec255e42173 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:39.730520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a078a584-4eb0-4428-aa74-cec255e42173 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:39.731041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a078a584-4eb0-4428-aa74-cec255e42173 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:39.731475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a078a584-4eb0-4428-aa74-cec255e42173 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:39.732167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a078a584-4eb0-4428-aa74-cec255e42173 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:39.732630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a078a584-4eb0-4428-aa74-cec255e42173 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:39.733050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a078a584-4eb0-4428-aa74-cec255e42173 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:39.877098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a078a584-4eb0-4428-aa74-cec255e42173 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:39.885903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a078a584-4eb0-4428-aa74-cec255e42173 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.166945 Aug 24 04:58:39.886466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 235/450] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:40.908369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e7c73d3d-f658-4ebb-bac1-9bff17fb1680 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:40.909209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e7c73d3d-f658-4ebb-bac1-9bff17fb1680 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:40.915886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c73d3d-f658-4ebb-bac1-9bff17fb1680 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:40.916372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c73d3d-f658-4ebb-bac1-9bff17fb1680 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:40.916807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c73d3d-f658-4ebb-bac1-9bff17fb1680 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:40.917497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c73d3d-f658-4ebb-bac1-9bff17fb1680 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:40.917951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c73d3d-f658-4ebb-bac1-9bff17fb1680 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:40.918369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c73d3d-f658-4ebb-bac1-9bff17fb1680 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:40.948141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c536868b-98e2-4496-bd49-c552273f2002 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: .version_select at 0x7f35904f5d30>, body: {"keypair": {"name": "tempest-keypair-217694854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQkoDMDvsG5Nt85kHWFJ7J27OEAe3uYVVNcK0XwGRhRfuZFB14PwFRJYLtu0CszV13yw1zGWUyteYMZm9ayx7dCaIG1dUe+vLWxBPzEp2pwVdfhjMmkhpUGwxW7y/DcPg=="}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:58:40.964115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-c536868b-98e2-4496-bd49-c552273f2002 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'key_pairs'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:58:40.967986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-c536868b-98e2-4496-bd49-c552273f2002 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for user 4bc6971289b943aebec90909ffb8096a and project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'key_pairs'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:58:40.993104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c536868b-98e2-4496-bd49-c552273f2002 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048879 Aug 24 04:58:40.993707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 236/451] 10.222.0.97 () {60 vars in 1159 bytes} [Wed Aug 24 04:58:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:58:41.062930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e7c73d3d-f658-4ebb-bac1-9bff17fb1680 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:41.073275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e7c73d3d-f658-4ebb-bac1-9bff17fb1680 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.169591 Aug 24 04:58:41.073894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 216/452] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:42.096804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8b12078a-185b-472f-9741-5e217c6ef8e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:42.096804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8b12078a-185b-472f-9741-5e217c6ef8e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:42.104899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b12078a-185b-472f-9741-5e217c6ef8e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:42.105391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b12078a-185b-472f-9741-5e217c6ef8e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:42.105819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b12078a-185b-472f-9741-5e217c6ef8e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:42.106508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b12078a-185b-472f-9741-5e217c6ef8e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:42.106984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b12078a-185b-472f-9741-5e217c6ef8e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:42.107439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b12078a-185b-472f-9741-5e217c6ef8e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:42.241474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8b12078a-185b-472f-9741-5e217c6ef8e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:42.249972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8b12078a-185b-472f-9741-5e217c6ef8e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.158520 Aug 24 04:58:42.250539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 237/453] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:42.283834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-719693223", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b192333e-49cd-4bbd-809a-5981852bd697"}], "security_groups": [{"name": "tempest-securitygroup--1751551464"}], "key_name": "tempest-keypair-217694854", "user_data": "}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:58:42.390867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] validate_networks() for [('b192333e-49cd-4bbd-809a-5981852bd697', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:58:42.762525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:58:42.762979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:58:42.763449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:58:42.763850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:58:42.764254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:58:42.773579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:42.774054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:42.774483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:42.775238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:42.775691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:42.776110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:42.793445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:58:42.797686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for user 4bc6971289b943aebec90909ffb8096a and project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:58:42.808634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f3b44efa-8451-46a6-807b-9a5dec1e9b5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:42.808915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:58:42.809121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f3b44efa-8451-46a6-807b-9a5dec1e9b5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:42.811275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:58:42.814900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b44efa-8451-46a6-807b-9a5dec1e9b5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:42.815373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b44efa-8451-46a6-807b-9a5dec1e9b5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:42.815799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b44efa-8451-46a6-807b-9a5dec1e9b5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:42.817123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b44efa-8451-46a6-807b-9a5dec1e9b5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:42.817667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b44efa-8451-46a6-807b-9a5dec1e9b5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:42.818081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b44efa-8451-46a6-807b-9a5dec1e9b5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:42.859014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1764753d-8b93-48cb-b795-ab9b13a01a1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.579284 Aug 24 04:58:42.859963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 217/454] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:58:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:58:42.870625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d90a664f-3696-44b4-859b-af32b7f71f53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:42.871264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d90a664f-3696-44b4-859b-af32b7f71f53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:42.929112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d90a664f-3696-44b4-859b-af32b7f71f53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:42.939809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d90a664f-3696-44b4-859b-af32b7f71f53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1240 microversion: 2.1 time: 0.072585 Aug 24 04:58:42.953542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 218/455] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:42 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:58:42.954068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-f3b44efa-8451-46a6-807b-9a5dec1e9b5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lazy-loading 'services' on Instance uuid 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:58:43.070854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f3b44efa-8451-46a6-807b-9a5dec1e9b5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "DELETE /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3/os-volume_attachments/4d507227-101c-4259-a336-6d22a9768e17" status: 202 len: 0 microversion: 2.1 time: 0.265843 Aug 24 04:58:43.071439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 238/456] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 04:58:42 2022] DELETE /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3/os-volume_attachments/4d507227-101c-4259-a336-6d22a9768e17 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 04:58:43.271570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-525c9289-6649-4d88-a4c7-37bc70f72cf1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:43.272182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-525c9289-6649-4d88-a4c7-37bc70f72cf1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:43.278128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-525c9289-6649-4d88-a4c7-37bc70f72cf1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:43.278612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-525c9289-6649-4d88-a4c7-37bc70f72cf1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:43.279084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-525c9289-6649-4d88-a4c7-37bc70f72cf1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:43.279766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-525c9289-6649-4d88-a4c7-37bc70f72cf1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:43.280216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-525c9289-6649-4d88-a4c7-37bc70f72cf1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:43.280635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-525c9289-6649-4d88-a4c7-37bc70f72cf1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:43.413107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-525c9289-6649-4d88-a4c7-37bc70f72cf1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:43.421602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-525c9289-6649-4d88-a4c7-37bc70f72cf1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.154644 Aug 24 04:58:43.422164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 219/457] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:43.961396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-399f10ec-bd4e-442e-ab72-a675d94c23e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:43.962180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-399f10ec-bd4e-442e-ab72-a675d94c23e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:43.968746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-399f10ec-bd4e-442e-ab72-a675d94c23e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:43.969213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-399f10ec-bd4e-442e-ab72-a675d94c23e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:43.969637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-399f10ec-bd4e-442e-ab72-a675d94c23e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:43.970309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-399f10ec-bd4e-442e-ab72-a675d94c23e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:43.970785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-399f10ec-bd4e-442e-ab72-a675d94c23e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:43.971199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-399f10ec-bd4e-442e-ab72-a675d94c23e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:44.039759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-399f10ec-bd4e-442e-ab72-a675d94c23e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:44.047729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-399f10ec-bd4e-442e-ab72-a675d94c23e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1236 microversion: 2.1 time: 0.091125 Aug 24 04:58:44.048309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 239/458] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:43 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1236 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:44.443814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-41b091b2-64cd-432a-95cf-d3376fd26740 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:44.444480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-41b091b2-64cd-432a-95cf-d3376fd26740 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:44.450945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b091b2-64cd-432a-95cf-d3376fd26740 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:44.451431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b091b2-64cd-432a-95cf-d3376fd26740 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:44.451868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b091b2-64cd-432a-95cf-d3376fd26740 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:44.452561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b091b2-64cd-432a-95cf-d3376fd26740 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:44.453367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b091b2-64cd-432a-95cf-d3376fd26740 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:44.453469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41b091b2-64cd-432a-95cf-d3376fd26740 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:44.659796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-41b091b2-64cd-432a-95cf-d3376fd26740 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:44.669602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-41b091b2-64cd-432a-95cf-d3376fd26740 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.230024 Aug 24 04:58:44.670262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 220/459] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:58:45.069991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0552fa8c-1470-400e-bad7-9a69562db208 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:45.070635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0552fa8c-1470-400e-bad7-9a69562db208 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:45.077797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0552fa8c-1470-400e-bad7-9a69562db208 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:45.078213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0552fa8c-1470-400e-bad7-9a69562db208 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:45.078647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0552fa8c-1470-400e-bad7-9a69562db208 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:45.079351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0552fa8c-1470-400e-bad7-9a69562db208 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:45.079797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0552fa8c-1470-400e-bad7-9a69562db208 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:45.080218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0552fa8c-1470-400e-bad7-9a69562db208 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:45.143867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0552fa8c-1470-400e-bad7-9a69562db208 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:45.153721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0552fa8c-1470-400e-bad7-9a69562db208 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1298 microversion: 2.1 time: 0.087769 Aug 24 04:58:45.154867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 240/460] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:45 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:45.260411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-52fa8d4d-d7cf-4d17-adaf-d27ef2579536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:45.260978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-52fa8d4d-d7cf-4d17-adaf-d27ef2579536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:45.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52fa8d4d-d7cf-4d17-adaf-d27ef2579536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:45.267453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52fa8d4d-d7cf-4d17-adaf-d27ef2579536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:45.267873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52fa8d4d-d7cf-4d17-adaf-d27ef2579536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:45.268545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52fa8d4d-d7cf-4d17-adaf-d27ef2579536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:45.268985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52fa8d4d-d7cf-4d17-adaf-d27ef2579536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:45.269462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52fa8d4d-d7cf-4d17-adaf-d27ef2579536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:45.293996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-52fa8d4d-d7cf-4d17-adaf-d27ef2579536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Going to try to terminate instance {{(pid=120557) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 04:58:45.369975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-52fa8d4d-d7cf-4d17-adaf-d27ef2579536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "DELETE /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 204 len: 0 microversion: 2.1 time: 0.113172 Aug 24 04:58:45.370552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 221/461] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 04:58:45 2022] DELETE /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 04:58:45.378833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7f9a26ff-eb0f-4510-851e-26e53b39d9fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:45.380024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7f9a26ff-eb0f-4510-851e-26e53b39d9fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:45.386101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f9a26ff-eb0f-4510-851e-26e53b39d9fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:45.386661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f9a26ff-eb0f-4510-851e-26e53b39d9fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:45.387179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f9a26ff-eb0f-4510-851e-26e53b39d9fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:45.387923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f9a26ff-eb0f-4510-851e-26e53b39d9fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:45.388428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f9a26ff-eb0f-4510-851e-26e53b39d9fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:45.388903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f9a26ff-eb0f-4510-851e-26e53b39d9fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:45.556942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7f9a26ff-eb0f-4510-851e-26e53b39d9fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:45.564804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7f9a26ff-eb0f-4510-851e-26e53b39d9fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1513 microversion: 2.1 time: 0.189827 Aug 24 04:58:45.565376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 241/462] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:45 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1513 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:58:45.692174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1695eeda-7725-49bc-9e63-2bc1969bdcb8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:45.692929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1695eeda-7725-49bc-9e63-2bc1969bdcb8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:45.699489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1695eeda-7725-49bc-9e63-2bc1969bdcb8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:45.699972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1695eeda-7725-49bc-9e63-2bc1969bdcb8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:45.700409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1695eeda-7725-49bc-9e63-2bc1969bdcb8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:45.701105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1695eeda-7725-49bc-9e63-2bc1969bdcb8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:45.701553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1695eeda-7725-49bc-9e63-2bc1969bdcb8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:45.701972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1695eeda-7725-49bc-9e63-2bc1969bdcb8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:45.838166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1695eeda-7725-49bc-9e63-2bc1969bdcb8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:45.846382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1695eeda-7725-49bc-9e63-2bc1969bdcb8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.158669 Aug 24 04:58:45.846978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 222/463] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:46.181352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-034530d5-f92e-40cb-b3ba-40c2c55e20f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:46.181961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-034530d5-f92e-40cb-b3ba-40c2c55e20f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:46.188420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-034530d5-f92e-40cb-b3ba-40c2c55e20f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:46.188894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-034530d5-f92e-40cb-b3ba-40c2c55e20f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:46.189326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-034530d5-f92e-40cb-b3ba-40c2c55e20f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:46.189996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-034530d5-f92e-40cb-b3ba-40c2c55e20f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:46.190439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-034530d5-f92e-40cb-b3ba-40c2c55e20f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:46.190895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-034530d5-f92e-40cb-b3ba-40c2c55e20f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:46.322241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-034530d5-f92e-40cb-b3ba-40c2c55e20f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:46.329828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-034530d5-f92e-40cb-b3ba-40c2c55e20f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.152356 Aug 24 04:58:46.330391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 242/464] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:46 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:46.586336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7d299329-e408-40c7-91e3-37e0c1abac06 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:46.587007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7d299329-e408-40c7-91e3-37e0c1abac06 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:46.592959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d299329-e408-40c7-91e3-37e0c1abac06 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:46.593457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d299329-e408-40c7-91e3-37e0c1abac06 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:46.593869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d299329-e408-40c7-91e3-37e0c1abac06 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:46.594550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d299329-e408-40c7-91e3-37e0c1abac06 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:46.595050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d299329-e408-40c7-91e3-37e0c1abac06 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:46.595477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d299329-e408-40c7-91e3-37e0c1abac06 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:46.726592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7d299329-e408-40c7-91e3-37e0c1abac06 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:46.735052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7d299329-e408-40c7-91e3-37e0c1abac06 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1513 microversion: 2.1 time: 0.153100 Aug 24 04:58:46.735656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 223/465] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:46 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:46.868471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1d9445f3-79f7-480e-ab19-1a9f6858f337 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:46.868995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1d9445f3-79f7-480e-ab19-1a9f6858f337 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:46.874935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d9445f3-79f7-480e-ab19-1a9f6858f337 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:46.875415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d9445f3-79f7-480e-ab19-1a9f6858f337 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:46.875848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d9445f3-79f7-480e-ab19-1a9f6858f337 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:46.876529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d9445f3-79f7-480e-ab19-1a9f6858f337 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:46.876977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d9445f3-79f7-480e-ab19-1a9f6858f337 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:46.877398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d9445f3-79f7-480e-ab19-1a9f6858f337 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:47.003917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1d9445f3-79f7-480e-ab19-1a9f6858f337 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:47.012820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1d9445f3-79f7-480e-ab19-1a9f6858f337 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.148833 Aug 24 04:58:47.013407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 243/466] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:47.350754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-44a21eab-a887-455f-a265-74bbb17c9a7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:47.351370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-44a21eab-a887-455f-a265-74bbb17c9a7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:47.357306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44a21eab-a887-455f-a265-74bbb17c9a7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:47.357787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44a21eab-a887-455f-a265-74bbb17c9a7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:47.358222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44a21eab-a887-455f-a265-74bbb17c9a7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:47.358943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44a21eab-a887-455f-a265-74bbb17c9a7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:47.359395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44a21eab-a887-455f-a265-74bbb17c9a7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:47.359816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44a21eab-a887-455f-a265-74bbb17c9a7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:47.561139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-44a21eab-a887-455f-a265-74bbb17c9a7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:47.570424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-44a21eab-a887-455f-a265-74bbb17c9a7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.223508 Aug 24 04:58:47.571256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 224/467] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:47 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:47.760615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-426357f0-0858-4bb0-9fc2-5142469f56ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:47.761225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-426357f0-0858-4bb0-9fc2-5142469f56ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:47.768392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-426357f0-0858-4bb0-9fc2-5142469f56ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:47.769320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-426357f0-0858-4bb0-9fc2-5142469f56ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:47.769818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-426357f0-0858-4bb0-9fc2-5142469f56ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:47.770731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-426357f0-0858-4bb0-9fc2-5142469f56ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:47.771645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-426357f0-0858-4bb0-9fc2-5142469f56ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:47.772384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-426357f0-0858-4bb0-9fc2-5142469f56ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:47.800413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-86a9551d-e55f-4c07-beca-f9a9ee144a2a req-3b176a63-6ae7-4094-8c42-19ce5ab52d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd", "tag": "cc519303-087a-484b-acbf-05093327140d"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:58:47.813351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-86a9551d-e55f-4c07-beca-f9a9ee144a2a req-3b176a63-6ae7-4094-8c42-19ce5ab52d48 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:47.813830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-86a9551d-e55f-4c07-beca-f9a9ee144a2a req-3b176a63-6ae7-4094-8c42-19ce5ab52d48 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:47.814258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-86a9551d-e55f-4c07-beca-f9a9ee144a2a req-3b176a63-6ae7-4094-8c42-19ce5ab52d48 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:47.827636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-86a9551d-e55f-4c07-beca-f9a9ee144a2a req-3b176a63-6ae7-4094-8c42-19ce5ab52d48 service nova] Creating event network-changed:cc519303-087a-484b-acbf-05093327140d for instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd on hv-cinder-85426 Aug 24 04:58:47.834975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-86a9551d-e55f-4c07-beca-f9a9ee144a2a req-3b176a63-6ae7-4094-8c42-19ce5ab52d48 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040990 Aug 24 04:58:47.835816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 225/468] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:58:48.025409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-426357f0-0858-4bb0-9fc2-5142469f56ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:48.033187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-426357f0-0858-4bb0-9fc2-5142469f56ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1513 microversion: 2.1 time: 0.278107 Aug 24 04:58:48.034050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 244/469] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:47 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:48.034407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-02d4c456-5963-4aa4-bd0d-8b998fe06ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:48.035199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-02d4c456-5963-4aa4-bd0d-8b998fe06ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:48.041553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d4c456-5963-4aa4-bd0d-8b998fe06ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:48.042030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d4c456-5963-4aa4-bd0d-8b998fe06ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:48.042457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d4c456-5963-4aa4-bd0d-8b998fe06ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:48.043170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d4c456-5963-4aa4-bd0d-8b998fe06ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:48.043616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d4c456-5963-4aa4-bd0d-8b998fe06ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:48.044031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d4c456-5963-4aa4-bd0d-8b998fe06ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:48.273886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-02d4c456-5963-4aa4-bd0d-8b998fe06ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:48.285408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-02d4c456-5963-4aa4-bd0d-8b998fe06ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1723 microversion: 2.1 time: 0.255661 Aug 24 04:58:48.286725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 226/470] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:58:48.341312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-7dda3c0b-2674-49ff-944b-937c9a7760eb req-eeeb858c-0f5d-4260-a16a-f5591b37c1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d091aa0-b746-4b6a-96d6-f09eadcac6f3", "name": "network-vif-deleted", "tag": "7e56121e-83d5-4171-94e4-2b46d8be4bd5"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:58:48.351243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-7dda3c0b-2674-49ff-944b-937c9a7760eb req-eeeb858c-0f5d-4260-a16a-f5591b37c1e3 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:48.351713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-7dda3c0b-2674-49ff-944b-937c9a7760eb req-eeeb858c-0f5d-4260-a16a-f5591b37c1e3 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:48.352135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-7dda3c0b-2674-49ff-944b-937c9a7760eb req-eeeb858c-0f5d-4260-a16a-f5591b37c1e3 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:48.363689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-7dda3c0b-2674-49ff-944b-937c9a7760eb req-eeeb858c-0f5d-4260-a16a-f5591b37c1e3 service nova] Creating event network-vif-deleted:7e56121e-83d5-4171-94e4-2b46d8be4bd5 for instance 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 on hv-cinder-85426 Aug 24 04:58:48.370211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-7dda3c0b-2674-49ff-944b-937c9a7760eb req-eeeb858c-0f5d-4260-a16a-f5591b37c1e3 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032851 Aug 24 04:58:48.370999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 245/471] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:58:48.592434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c0bf8dcb-9cf3-4588-8dcf-bcad223a04e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:48.593103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c0bf8dcb-9cf3-4588-8dcf-bcad223a04e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:48.599896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0bf8dcb-9cf3-4588-8dcf-bcad223a04e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:48.600417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0bf8dcb-9cf3-4588-8dcf-bcad223a04e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:48.600843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0bf8dcb-9cf3-4588-8dcf-bcad223a04e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:48.601552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0bf8dcb-9cf3-4588-8dcf-bcad223a04e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:48.601990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0bf8dcb-9cf3-4588-8dcf-bcad223a04e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:48.602608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0bf8dcb-9cf3-4588-8dcf-bcad223a04e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:48.734998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c0bf8dcb-9cf3-4588-8dcf-bcad223a04e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:48.743424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c0bf8dcb-9cf3-4588-8dcf-bcad223a04e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.155068 Aug 24 04:58:48.743984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 227/472] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:48 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:49.055748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:49.056436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:49.062492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:49.062996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:49.063428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:49.064107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:49.064552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:49.064968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:49.096069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:49.096537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:49.096963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:49.097400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lazy-loading 'fault' on Instance uuid 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:58:49.139498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:49.147608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6a41ab0d-72ff-4f7f-a511-c7fe72f5582a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1308 microversion: 2.1 time: 0.097089 Aug 24 04:58:49.148163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 246/473] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:49 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:49.306903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-01fce9ff-b716-4cfa-9e43-13bf2063bc6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:49.307430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-01fce9ff-b716-4cfa-9e43-13bf2063bc6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:49.313824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01fce9ff-b716-4cfa-9e43-13bf2063bc6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:49.314303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01fce9ff-b716-4cfa-9e43-13bf2063bc6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:49.314765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01fce9ff-b716-4cfa-9e43-13bf2063bc6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:49.315444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01fce9ff-b716-4cfa-9e43-13bf2063bc6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:49.315893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01fce9ff-b716-4cfa-9e43-13bf2063bc6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:49.316308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01fce9ff-b716-4cfa-9e43-13bf2063bc6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:49.446154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-01fce9ff-b716-4cfa-9e43-13bf2063bc6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:49.454272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-01fce9ff-b716-4cfa-9e43-13bf2063bc6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1700 microversion: 2.1 time: 0.151739 Aug 24 04:58:49.454854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 228/474] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1700 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:49.474981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7afc662b-8687-45bf-83d9-a812d9f18269 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:58:49.480859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7afc662b-8687-45bf-83d9-a812d9f18269 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:49.481333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7afc662b-8687-45bf-83d9-a812d9f18269 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:49.481768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7afc662b-8687-45bf-83d9-a812d9f18269 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:49.485293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:49.504827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7afc662b-8687-45bf-83d9-a812d9f18269 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Going to try to start instance {{(pid=120558) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 24 04:58:49.546486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7afc662b-8687-45bf-83d9-a812d9f18269 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "POST /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/action" status: 202 len: 0 microversion: 2.1 time: 0.075315 Aug 24 04:58:49.547112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 247/475] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 04:58:49 2022] POST /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 04:58:49.555150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-81ac9618-adb6-45a6-bff4-16420d61c470 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:49.555756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-81ac9618-adb6-45a6-bff4-16420d61c470 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:49.561883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ac9618-adb6-45a6-bff4-16420d61c470 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:49.562316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ac9618-adb6-45a6-bff4-16420d61c470 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:49.562811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ac9618-adb6-45a6-bff4-16420d61c470 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:49.563498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ac9618-adb6-45a6-bff4-16420d61c470 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:49.563951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ac9618-adb6-45a6-bff4-16420d61c470 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:49.564373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ac9618-adb6-45a6-bff4-16420d61c470 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:49.569039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:49.700470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-81ac9618-adb6-45a6-bff4-16420d61c470 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:49.709248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-81ac9618-adb6-45a6-bff4-16420d61c470 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1709 microversion: 2.1 time: 0.157438 Aug 24 04:58:49.709803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 229/476] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1709 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:49.765085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c404f576-baa7-4a64-9b39-15f9adb990eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:49.765783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c404f576-baa7-4a64-9b39-15f9adb990eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:49.772396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c404f576-baa7-4a64-9b39-15f9adb990eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:49.772904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c404f576-baa7-4a64-9b39-15f9adb990eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:49.773414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c404f576-baa7-4a64-9b39-15f9adb990eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:49.774275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c404f576-baa7-4a64-9b39-15f9adb990eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:49.774764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c404f576-baa7-4a64-9b39-15f9adb990eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:49.774994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c404f576-baa7-4a64-9b39-15f9adb990eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:49.907017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c404f576-baa7-4a64-9b39-15f9adb990eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:49.915404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c404f576-baa7-4a64-9b39-15f9adb990eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.154606 Aug 24 04:58:49.915970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 248/477] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:49 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:50.168248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:50.168782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:50.175060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:50.175545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:50.175981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:50.176671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:50.177184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:50.177607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:50.210540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:50.211039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:50.211473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:50.211921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lazy-loading 'fault' on Instance uuid 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:58:50.254405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:50.262699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9763273f-b8bb-4d0b-b2b4-e6231afa27fd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1308 microversion: 2.1 time: 0.098391 Aug 24 04:58:50.263261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 230/478] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:50 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:50.732105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aa2d56c4-52a0-4522-8122-8f64920073e2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:50.732720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aa2d56c4-52a0-4522-8122-8f64920073e2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:50.739249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2d56c4-52a0-4522-8122-8f64920073e2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:50.740399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2d56c4-52a0-4522-8122-8f64920073e2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:50.740847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2d56c4-52a0-4522-8122-8f64920073e2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:50.741533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2d56c4-52a0-4522-8122-8f64920073e2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:50.741988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2d56c4-52a0-4522-8122-8f64920073e2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:50.742404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2d56c4-52a0-4522-8122-8f64920073e2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:50.871041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aa2d56c4-52a0-4522-8122-8f64920073e2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:50.879173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aa2d56c4-52a0-4522-8122-8f64920073e2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1709 microversion: 2.1 time: 0.150994 Aug 24 04:58:50.879734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 249/479] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1709 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:50.935128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-04d498f9-152d-4b68-8b66-0023e88f3070 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:50.935730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-04d498f9-152d-4b68-8b66-0023e88f3070 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:50.942012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d498f9-152d-4b68-8b66-0023e88f3070 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:50.942485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d498f9-152d-4b68-8b66-0023e88f3070 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:50.942982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d498f9-152d-4b68-8b66-0023e88f3070 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:50.943665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d498f9-152d-4b68-8b66-0023e88f3070 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:50.944112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d498f9-152d-4b68-8b66-0023e88f3070 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:50.944530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04d498f9-152d-4b68-8b66-0023e88f3070 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:51.071983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-04d498f9-152d-4b68-8b66-0023e88f3070 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:51.079447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-04d498f9-152d-4b68-8b66-0023e88f3070 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.148254 Aug 24 04:58:51.079999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 231/480] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:50 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:51.284125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:51.284729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:51.287465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=4 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:51.292917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:51.293396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:51.293834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:51.294791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:51.295240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:51.295659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:51.326509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:51.326952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:51.327378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:51.327818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lazy-loading 'fault' on Instance uuid 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 04:58:51.367742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:51.375361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a6744e7e-651f-4a27-b1e6-1ae1b73a0698 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 200 len: 1308 microversion: 2.1 time: 0.095094 Aug 24 04:58:51.375923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 250/481] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:51 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:51.900276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-37cec3b5-1def-4aa0-a788-1accfb036947 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:51.900898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-37cec3b5-1def-4aa0-a788-1accfb036947 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:51.907140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37cec3b5-1def-4aa0-a788-1accfb036947 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:51.907627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37cec3b5-1def-4aa0-a788-1accfb036947 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:51.908059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37cec3b5-1def-4aa0-a788-1accfb036947 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:51.908761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37cec3b5-1def-4aa0-a788-1accfb036947 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:51.909216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37cec3b5-1def-4aa0-a788-1accfb036947 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:51.909635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37cec3b5-1def-4aa0-a788-1accfb036947 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:52.062598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-37cec3b5-1def-4aa0-a788-1accfb036947 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:52.071241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-37cec3b5-1def-4aa0-a788-1accfb036947 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1709 microversion: 2.1 time: 0.174858 Aug 24 04:58:52.071801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 232/482] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1709 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:52.100432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-734406e4-c6d4-418d-92f3-46cc66e96984 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:52.101030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-734406e4-c6d4-418d-92f3-46cc66e96984 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:52.109951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-734406e4-c6d4-418d-92f3-46cc66e96984 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:52.110404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-734406e4-c6d4-418d-92f3-46cc66e96984 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:52.110888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-734406e4-c6d4-418d-92f3-46cc66e96984 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:52.111589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-734406e4-c6d4-418d-92f3-46cc66e96984 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:52.112040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-734406e4-c6d4-418d-92f3-46cc66e96984 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:52.112458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-734406e4-c6d4-418d-92f3-46cc66e96984 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:52.318260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-734406e4-c6d4-418d-92f3-46cc66e96984 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:52.326135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-734406e4-c6d4-418d-92f3-46cc66e96984 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.230155 Aug 24 04:58:52.326976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 251/483] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:52 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:52.396689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:52.397491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 2d091aa0-b746-4b6a-96d6-f09eadcac6f3] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:52.403549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:52.404014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:52.404445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:52.405124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:52.405576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:52.405993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:52.422384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] HTTP exception thrown: Instance 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 could not be found. Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Request method failure captured: Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 HTTP/1.1 Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa-xlX3G9LOFLr04Nwqz1haUhntNT1pzMDR4l37h-gUPSUg5pKaGXY1S3amAlCumK0pZYXWtygIusHjy4Ul-5gGjluXdok-RTmzF0zHWk17MrZ9KqcVOfOOJvT-LSx9LJBY1bL9FaeCpYehvxCR9gaRyiedmGVR-uc6aR6VIx92F6aA Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 3b37fd4d710b4a7ba471c224324d2a87 Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 04:58:52.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3b37fd4d710b4a7ba471c224324d2a87", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 3b37fd4d710b4a7ba471c224324d2a87 Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-VolumesSnapshotTestJSON-2011091351-project Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: fde5a0eecb8d411c82238c1ac3d4c0f1 Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-VolumesSnapshotTestJSON-2011091351-project Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 could not be found. Aug 24 04:58:52.425657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '2d091aa0-b746-4b6a-96d6-f09eadcac6f3'} Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 could not be found. Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 04:58:52.426577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 could not be found. Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 could not be found. Aug 24 04:58:52.428243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 04:58:52.429637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Returning 404 to user: Instance 2d091aa0-b746-4b6a-96d6-f09eadcac6f3 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 04:58:52.429637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-81c9c040-e363-47df-89ed-a902520029d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3" status: 404 len: 111 microversion: 2.1 time: 0.033240 Aug 24 04:58:52.429637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 233/484] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:52 2022] GET /compute/v2.1/servers/2d091aa0-b746-4b6a-96d6-f09eadcac6f3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 04:58:53.092826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e092eace-97f4-4d18-ba21-5e0d55df7080 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:53.093433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e092eace-97f4-4d18-ba21-5e0d55df7080 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:53.099468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e092eace-97f4-4d18-ba21-5e0d55df7080 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:53.099866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e092eace-97f4-4d18-ba21-5e0d55df7080 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:53.100382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e092eace-97f4-4d18-ba21-5e0d55df7080 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:53.101035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e092eace-97f4-4d18-ba21-5e0d55df7080 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:53.101556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e092eace-97f4-4d18-ba21-5e0d55df7080 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:53.101831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e092eace-97f4-4d18-ba21-5e0d55df7080 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:53.231156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e092eace-97f4-4d18-ba21-5e0d55df7080 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:53.241166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e092eace-97f4-4d18-ba21-5e0d55df7080 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1709 microversion: 2.1 time: 0.151113 Aug 24 04:58:53.242109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 252/485] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:53.347688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-456f13d2-f7b3-4199-90d6-6e8b6402b2b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:53.348300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-456f13d2-f7b3-4199-90d6-6e8b6402b2b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:53.350373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:53.351127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=8 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:53.357591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-456f13d2-f7b3-4199-90d6-6e8b6402b2b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:53.358069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-456f13d2-f7b3-4199-90d6-6e8b6402b2b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:53.358504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-456f13d2-f7b3-4199-90d6-6e8b6402b2b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:53.359218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-456f13d2-f7b3-4199-90d6-6e8b6402b2b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:53.359669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-456f13d2-f7b3-4199-90d6-6e8b6402b2b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:53.360093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-456f13d2-f7b3-4199-90d6-6e8b6402b2b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:53.490646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-456f13d2-f7b3-4199-90d6-6e8b6402b2b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:53.498326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-456f13d2-f7b3-4199-90d6-6e8b6402b2b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.154433 Aug 24 04:58:53.498845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 234/486] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:53 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:54.263547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6a90df56-6b38-4089-bd84-cd62fb8571a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:54.264149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6a90df56-6b38-4089-bd84-cd62fb8571a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:54.270471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a90df56-6b38-4089-bd84-cd62fb8571a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:54.271594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a90df56-6b38-4089-bd84-cd62fb8571a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:54.272027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a90df56-6b38-4089-bd84-cd62fb8571a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:54.272701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a90df56-6b38-4089-bd84-cd62fb8571a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:54.273149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a90df56-6b38-4089-bd84-cd62fb8571a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:54.273593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a90df56-6b38-4089-bd84-cd62fb8571a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:54.403600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6a90df56-6b38-4089-bd84-cd62fb8571a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:54.412322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6a90df56-6b38-4089-bd84-cd62fb8571a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1709 microversion: 2.1 time: 0.151961 Aug 24 04:58:54.412881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 253/487] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1709 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:54.519289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cb14a0fb-c1bc-4008-b310-fe702d5d4f14 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:54.519879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cb14a0fb-c1bc-4008-b310-fe702d5d4f14 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:54.526916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb14a0fb-c1bc-4008-b310-fe702d5d4f14 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:54.527391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb14a0fb-c1bc-4008-b310-fe702d5d4f14 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:54.527813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb14a0fb-c1bc-4008-b310-fe702d5d4f14 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:54.528483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb14a0fb-c1bc-4008-b310-fe702d5d4f14 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:54.528927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb14a0fb-c1bc-4008-b310-fe702d5d4f14 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:54.529341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb14a0fb-c1bc-4008-b310-fe702d5d4f14 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:54.661904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cb14a0fb-c1bc-4008-b310-fe702d5d4f14 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:54.670127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cb14a0fb-c1bc-4008-b310-fe702d5d4f14 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.154663 Aug 24 04:58:54.670711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 235/488] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:54 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:55.433563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-78efc847-359f-44b7-a078-3a07a250de20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:55.434183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-78efc847-359f-44b7-a078-3a07a250de20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:55.440660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78efc847-359f-44b7-a078-3a07a250de20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:55.441132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78efc847-359f-44b7-a078-3a07a250de20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:55.441562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78efc847-359f-44b7-a078-3a07a250de20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:55.442239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78efc847-359f-44b7-a078-3a07a250de20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:55.443215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78efc847-359f-44b7-a078-3a07a250de20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:55.443632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78efc847-359f-44b7-a078-3a07a250de20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:55.691595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dbd665f6-7d42-47b3-9ab1-1151100e086d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:55.692199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dbd665f6-7d42-47b3-9ab1-1151100e086d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:55.699467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbd665f6-7d42-47b3-9ab1-1151100e086d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:55.699949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbd665f6-7d42-47b3-9ab1-1151100e086d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:55.700378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbd665f6-7d42-47b3-9ab1-1151100e086d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:55.701066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbd665f6-7d42-47b3-9ab1-1151100e086d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:55.701512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbd665f6-7d42-47b3-9ab1-1151100e086d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:55.701925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbd665f6-7d42-47b3-9ab1-1151100e086d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:55.725382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-78efc847-359f-44b7-a078-3a07a250de20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:55.733996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-78efc847-359f-44b7-a078-3a07a250de20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1709 microversion: 2.1 time: 0.304303 Aug 24 04:58:55.736866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 254/489] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1709 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:55.898759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dbd665f6-7d42-47b3-9ab1-1151100e086d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:55.906403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dbd665f6-7d42-47b3-9ab1-1151100e086d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.218955 Aug 24 04:58:55.907071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 236/490] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:55 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:58:56.756219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d88c7943-f718-4e15-98f9-bbbc91402984 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:56.756823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d88c7943-f718-4e15-98f9-bbbc91402984 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:56.763210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88c7943-f718-4e15-98f9-bbbc91402984 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:56.763682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88c7943-f718-4e15-98f9-bbbc91402984 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:56.764112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88c7943-f718-4e15-98f9-bbbc91402984 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:56.764788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88c7943-f718-4e15-98f9-bbbc91402984 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:56.765229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88c7943-f718-4e15-98f9-bbbc91402984 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:56.765641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88c7943-f718-4e15-98f9-bbbc91402984 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:56.898531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d88c7943-f718-4e15-98f9-bbbc91402984 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:56.906773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d88c7943-f718-4e15-98f9-bbbc91402984 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1713 microversion: 2.1 time: 0.154514 Aug 24 04:58:56.907346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 255/491] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1713 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:56.927095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ea5ebd30-430d-453c-96a4-83642db45bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:56.927704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ea5ebd30-430d-453c-96a4-83642db45bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:56.934157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea5ebd30-430d-453c-96a4-83642db45bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:56.934643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea5ebd30-430d-453c-96a4-83642db45bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:56.935110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea5ebd30-430d-453c-96a4-83642db45bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:56.935794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea5ebd30-430d-453c-96a4-83642db45bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:56.936244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea5ebd30-430d-453c-96a4-83642db45bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:56.936666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea5ebd30-430d-453c-96a4-83642db45bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:57.070635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ea5ebd30-430d-453c-96a4-83642db45bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:57.078395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ea5ebd30-430d-453c-96a4-83642db45bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.155101 Aug 24 04:58:57.078991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 237/492] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:56 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:58.100164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bdd1e3d4-4777-4d38-aa03-7fb7802996e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:58.100683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bdd1e3d4-4777-4d38-aa03-7fb7802996e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:58.107977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bdd1e3d4-4777-4d38-aa03-7fb7802996e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:58.108454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bdd1e3d4-4777-4d38-aa03-7fb7802996e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:58.108885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bdd1e3d4-4777-4d38-aa03-7fb7802996e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:58.109565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bdd1e3d4-4777-4d38-aa03-7fb7802996e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:58.110044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bdd1e3d4-4777-4d38-aa03-7fb7802996e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:58.110459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bdd1e3d4-4777-4d38-aa03-7fb7802996e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:58.241057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bdd1e3d4-4777-4d38-aa03-7fb7802996e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:58.250253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bdd1e3d4-4777-4d38-aa03-7fb7802996e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.153840 Aug 24 04:58:58.250910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 256/493] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:58 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:58:59.263730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-105737fa-7986-477d-9d9b-6ffcce8bf1b8 req-d1dd6144-9829-4f9e-95dc-565abb713d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd", "name": "network-vif-plugged", "status": "completed", "tag": "cc519303-087a-484b-acbf-05093327140d"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:58:59.272125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2fbc57fe-bc47-489f-87d7-6d40955458ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:58:59.272732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2fbc57fe-bc47-489f-87d7-6d40955458ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:58:59.276233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-105737fa-7986-477d-9d9b-6ffcce8bf1b8 req-d1dd6144-9829-4f9e-95dc-565abb713d5f service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:59.276727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-105737fa-7986-477d-9d9b-6ffcce8bf1b8 req-d1dd6144-9829-4f9e-95dc-565abb713d5f service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:59.278407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-105737fa-7986-477d-9d9b-6ffcce8bf1b8 req-d1dd6144-9829-4f9e-95dc-565abb713d5f service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:59.280299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fbc57fe-bc47-489f-87d7-6d40955458ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:59.280779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fbc57fe-bc47-489f-87d7-6d40955458ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:59.281383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fbc57fe-bc47-489f-87d7-6d40955458ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:59.282119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fbc57fe-bc47-489f-87d7-6d40955458ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:58:59.282820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fbc57fe-bc47-489f-87d7-6d40955458ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:58:59.283244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fbc57fe-bc47-489f-87d7-6d40955458ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:58:59.290404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-105737fa-7986-477d-9d9b-6ffcce8bf1b8 req-d1dd6144-9829-4f9e-95dc-565abb713d5f service nova] Creating event network-vif-plugged:cc519303-087a-484b-acbf-05093327140d for instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd on hv-cinder-85426 Aug 24 04:58:59.296253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-105737fa-7986-477d-9d9b-6ffcce8bf1b8 req-d1dd6144-9829-4f9e-95dc-565abb713d5f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035959 Aug 24 04:58:59.296935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 238/494] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:58:59.414590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2fbc57fe-bc47-489f-87d7-6d40955458ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:58:59.422891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2fbc57fe-bc47-489f-87d7-6d40955458ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.154989 Aug 24 04:58:59.423465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 257/495] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:58:59 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:59:00.444594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-89c04c44-1d0c-41a7-b741-9eb6d43f4e01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:00.445204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-89c04c44-1d0c-41a7-b741-9eb6d43f4e01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:00.451899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89c04c44-1d0c-41a7-b741-9eb6d43f4e01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:00.452373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89c04c44-1d0c-41a7-b741-9eb6d43f4e01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:00.452798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89c04c44-1d0c-41a7-b741-9eb6d43f4e01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:00.453482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89c04c44-1d0c-41a7-b741-9eb6d43f4e01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:00.453929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89c04c44-1d0c-41a7-b741-9eb6d43f4e01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:00.454349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89c04c44-1d0c-41a7-b741-9eb6d43f4e01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:00.584345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-89c04c44-1d0c-41a7-b741-9eb6d43f4e01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:00.592775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-89c04c44-1d0c-41a7-b741-9eb6d43f4e01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.152477 Aug 24 04:59:00.593339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 239/496] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:00 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:01.613521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-311f37ff-ce9d-4523-9adf-d022739bd617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:01.614249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-311f37ff-ce9d-4523-9adf-d022739bd617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:01.617340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:01.622904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-311f37ff-ce9d-4523-9adf-d022739bd617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:01.623383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-311f37ff-ce9d-4523-9adf-d022739bd617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:01.623813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-311f37ff-ce9d-4523-9adf-d022739bd617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:01.624523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-311f37ff-ce9d-4523-9adf-d022739bd617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:01.624974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-311f37ff-ce9d-4523-9adf-d022739bd617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:01.625394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-311f37ff-ce9d-4523-9adf-d022739bd617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:01.757302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-311f37ff-ce9d-4523-9adf-d022739bd617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:01.767616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-311f37ff-ce9d-4523-9adf-d022739bd617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.157940 Aug 24 04:59:01.768192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 258/497] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:01 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:02.789553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9288ac51-8d60-4514-9510-1ca5c78760d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:02.790171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9288ac51-8d60-4514-9510-1ca5c78760d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:02.792685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:02.798210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9288ac51-8d60-4514-9510-1ca5c78760d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:02.798707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9288ac51-8d60-4514-9510-1ca5c78760d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:02.799143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9288ac51-8d60-4514-9510-1ca5c78760d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:02.799828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9288ac51-8d60-4514-9510-1ca5c78760d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:02.800280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9288ac51-8d60-4514-9510-1ca5c78760d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:02.800706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9288ac51-8d60-4514-9510-1ca5c78760d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:02.934431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9288ac51-8d60-4514-9510-1ca5c78760d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:02.942108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9288ac51-8d60-4514-9510-1ca5c78760d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.156902 Aug 24 04:59:02.942658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 240/498] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:02 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:03.963281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-81355d89-79ab-4b04-ade4-31c59e525e91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:03.963885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-81355d89-79ab-4b04-ade4-31c59e525e91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:03.970335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81355d89-79ab-4b04-ade4-31c59e525e91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:03.970840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81355d89-79ab-4b04-ade4-31c59e525e91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:03.971272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81355d89-79ab-4b04-ade4-31c59e525e91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:03.971950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81355d89-79ab-4b04-ade4-31c59e525e91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:03.972432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81355d89-79ab-4b04-ade4-31c59e525e91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:03.972844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81355d89-79ab-4b04-ade4-31c59e525e91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:04.104534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-81355d89-79ab-4b04-ade4-31c59e525e91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:04.112329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-81355d89-79ab-4b04-ade4-31c59e525e91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.153231 Aug 24 04:59:04.112977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 259/499] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:03 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:04.386554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-151159863", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "networks": [{"uuid": "18edd128-d86f-4aed-9486-9d8caf6c19dc"}]}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:04.440505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] validate_networks() for [('18edd128-d86f-4aed-9486-9d8caf6c19dc', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 04:59:04.783656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 04:59:04.784169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 04:59:04.784734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 04:59:04.785150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 04:59:04.785561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 04:59:04.796131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:04.796608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:04.797038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:04.797754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:04.798204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:04.798626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:04.815186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Getting quotas for project 3b37fd4d710b4a7ba471c224324d2a87. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 04:59:04.819110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Getting quotas for user fde5a0eecb8d411c82238c1ac3d4c0f1 and project 3b37fd4d710b4a7ba471c224324d2a87. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 04:59:04.830260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 04:59:04.832745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 04:59:04.879744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-754540b3-9f3b-4b46-b5c7-38b0acf1b7dd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496916 Aug 24 04:59:04.880389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 241/500] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 04:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 04:59:04.891319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5423d47d-efd7-4aa3-8e9d-2a3c69403779 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:04.892020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5423d47d-efd7-4aa3-8e9d-2a3c69403779 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:04.949993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5423d47d-efd7-4aa3-8e9d-2a3c69403779 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:04.957022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5423d47d-efd7-4aa3-8e9d-2a3c69403779 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1218 microversion: 2.1 time: 0.069361 Aug 24 04:59:04.958604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 260/501] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:04 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:59:05.135669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3fad24c9-e7ed-483d-ba11-dfa7fbddc34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:05.136280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3fad24c9-e7ed-483d-ba11-dfa7fbddc34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:05.143027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fad24c9-e7ed-483d-ba11-dfa7fbddc34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:05.143505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fad24c9-e7ed-483d-ba11-dfa7fbddc34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:05.143942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fad24c9-e7ed-483d-ba11-dfa7fbddc34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:05.144621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fad24c9-e7ed-483d-ba11-dfa7fbddc34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:05.145075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fad24c9-e7ed-483d-ba11-dfa7fbddc34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:05.145498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fad24c9-e7ed-483d-ba11-dfa7fbddc34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:05.280836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3fad24c9-e7ed-483d-ba11-dfa7fbddc34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:05.290249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3fad24c9-e7ed-483d-ba11-dfa7fbddc34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1366 microversion: 2.1 time: 0.159583 Aug 24 04:59:05.291098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 242/502] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:05 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:05.978590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c5f5afd4-f169-4149-9920-c83d1ee74a75 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:05.979225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c5f5afd4-f169-4149-9920-c83d1ee74a75 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:05.985776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5f5afd4-f169-4149-9920-c83d1ee74a75 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:05.986253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5f5afd4-f169-4149-9920-c83d1ee74a75 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:05.986706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5f5afd4-f169-4149-9920-c83d1ee74a75 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:05.987390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5f5afd4-f169-4149-9920-c83d1ee74a75 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:05.987836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5f5afd4-f169-4149-9920-c83d1ee74a75 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:05.988250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5f5afd4-f169-4149-9920-c83d1ee74a75 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:06.055379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c5f5afd4-f169-4149-9920-c83d1ee74a75 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:06.063380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c5f5afd4-f169-4149-9920-c83d1ee74a75 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1222 microversion: 2.1 time: 0.088666 Aug 24 04:59:06.063945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 261/503] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:05 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:06.312234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7accf9e9-b011-4b41-93e2-d0907b6d880a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:06.312776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7accf9e9-b011-4b41-93e2-d0907b6d880a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:06.319213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7accf9e9-b011-4b41-93e2-d0907b6d880a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:06.319693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7accf9e9-b011-4b41-93e2-d0907b6d880a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:06.320177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7accf9e9-b011-4b41-93e2-d0907b6d880a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:06.321494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7accf9e9-b011-4b41-93e2-d0907b6d880a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:06.321940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7accf9e9-b011-4b41-93e2-d0907b6d880a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:06.322354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7accf9e9-b011-4b41-93e2-d0907b6d880a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:06.454701 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7accf9e9-b011-4b41-93e2-d0907b6d880a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:06.462929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7accf9e9-b011-4b41-93e2-d0907b6d880a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1555 microversion: 2.1 time: 0.154607 Aug 24 04:59:06.463490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 243/504] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:06 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:06.482804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-950e1ec7-9998-409e-b468-4f3ca99ff8fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:06.483289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-950e1ec7-9998-409e-b468-4f3ca99ff8fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:06.489066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-950e1ec7-9998-409e-b468-4f3ca99ff8fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:06.489529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-950e1ec7-9998-409e-b468-4f3ca99ff8fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:06.489950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-950e1ec7-9998-409e-b468-4f3ca99ff8fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:06.490615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-950e1ec7-9998-409e-b468-4f3ca99ff8fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:06.491079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-950e1ec7-9998-409e-b468-4f3ca99ff8fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:06.491490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-950e1ec7-9998-409e-b468-4f3ca99ff8fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:06.567046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-950e1ec7-9998-409e-b468-4f3ca99ff8fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087990 Aug 24 04:59:06.567640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 262/505] 10.222.0.97 () {58 vars in 1275 bytes} [Wed Aug 24 04:59:06 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:59:07.084582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-97f69191-dade-454f-a54b-7b9dcff7e4e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:07.085347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-97f69191-dade-454f-a54b-7b9dcff7e4e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:07.092971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f69191-dade-454f-a54b-7b9dcff7e4e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:07.093517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f69191-dade-454f-a54b-7b9dcff7e4e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:07.093954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f69191-dade-454f-a54b-7b9dcff7e4e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:07.094647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f69191-dade-454f-a54b-7b9dcff7e4e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:07.095155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f69191-dade-454f-a54b-7b9dcff7e4e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:07.095580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f69191-dade-454f-a54b-7b9dcff7e4e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:07.163199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-97f69191-dade-454f-a54b-7b9dcff7e4e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:07.174098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-97f69191-dade-454f-a54b-7b9dcff7e4e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1278 microversion: 2.1 time: 0.092098 Aug 24 04:59:07.174098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 244/506] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:07 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:07.704032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-c3f45df7-e2a7-4e9d-8e0a-10e43bbe02f3 req-b302e3bf-8bcd-40ff-9de5-17ff467fa072 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd", "tag": "cc519303-087a-484b-acbf-05093327140d"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:07.724263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-c3f45df7-e2a7-4e9d-8e0a-10e43bbe02f3 req-b302e3bf-8bcd-40ff-9de5-17ff467fa072 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:07.724740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-c3f45df7-e2a7-4e9d-8e0a-10e43bbe02f3 req-b302e3bf-8bcd-40ff-9de5-17ff467fa072 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:07.725368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-c3f45df7-e2a7-4e9d-8e0a-10e43bbe02f3 req-b302e3bf-8bcd-40ff-9de5-17ff467fa072 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:07.743263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-c3f45df7-e2a7-4e9d-8e0a-10e43bbe02f3 req-b302e3bf-8bcd-40ff-9de5-17ff467fa072 service nova] Creating event network-changed:cc519303-087a-484b-acbf-05093327140d for instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd on hv-cinder-85426 Aug 24 04:59:07.757340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-c3f45df7-e2a7-4e9d-8e0a-10e43bbe02f3 req-b302e3bf-8bcd-40ff-9de5-17ff467fa072 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056278 Aug 24 04:59:07.759127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 263/507] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:08.195321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cd40f796-dec6-4374-bc83-ffe24a89fc54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:08.196673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cd40f796-dec6-4374-bc83-ffe24a89fc54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:08.204542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd40f796-dec6-4374-bc83-ffe24a89fc54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:08.205402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd40f796-dec6-4374-bc83-ffe24a89fc54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:08.206043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd40f796-dec6-4374-bc83-ffe24a89fc54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:08.207054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd40f796-dec6-4374-bc83-ffe24a89fc54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:08.207717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd40f796-dec6-4374-bc83-ffe24a89fc54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:08.208339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd40f796-dec6-4374-bc83-ffe24a89fc54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:08.564104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cd40f796-dec6-4374-bc83-ffe24a89fc54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:08.576054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cd40f796-dec6-4374-bc83-ffe24a89fc54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1318 microversion: 2.1 time: 0.384854 Aug 24 04:59:08.586839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 245/508] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:08 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:09.598662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f7737b45-a2ed-4d1a-8ac8-30fa69bdd47a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:09.599376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f7737b45-a2ed-4d1a-8ac8-30fa69bdd47a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:09.605730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7737b45-a2ed-4d1a-8ac8-30fa69bdd47a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:09.606199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7737b45-a2ed-4d1a-8ac8-30fa69bdd47a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:09.606655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7737b45-a2ed-4d1a-8ac8-30fa69bdd47a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:09.607390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7737b45-a2ed-4d1a-8ac8-30fa69bdd47a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:09.607843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7737b45-a2ed-4d1a-8ac8-30fa69bdd47a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:09.608257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7737b45-a2ed-4d1a-8ac8-30fa69bdd47a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:09.628066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:09.759367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f7737b45-a2ed-4d1a-8ac8-30fa69bdd47a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:09.768575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f7737b45-a2ed-4d1a-8ac8-30fa69bdd47a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1318 microversion: 2.1 time: 0.174475 Aug 24 04:59:09.768996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 264/509] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:09 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:09.782504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-3abf01fc-f63d-4eaa-9987-3596c1966517 req-c4161685-0136-42bb-99d1-3ea780721d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f9cc46-e608-4e87-8a41-cbd6058576a0", "tag": "a8ec641b-f5c0-4262-ae7a-a531d6ad11dd"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:09.794164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-3abf01fc-f63d-4eaa-9987-3596c1966517 req-c4161685-0136-42bb-99d1-3ea780721d68 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:09.795156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-3abf01fc-f63d-4eaa-9987-3596c1966517 req-c4161685-0136-42bb-99d1-3ea780721d68 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:09.795585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-3abf01fc-f63d-4eaa-9987-3596c1966517 req-c4161685-0136-42bb-99d1-3ea780721d68 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:09.814222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-3abf01fc-f63d-4eaa-9987-3596c1966517 req-c4161685-0136-42bb-99d1-3ea780721d68 service nova] Creating event network-changed:a8ec641b-f5c0-4262-ae7a-a531d6ad11dd for instance 61f9cc46-e608-4e87-8a41-cbd6058576a0 on hv-cinder-85426 Aug 24 04:59:09.821847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-3abf01fc-f63d-4eaa-9987-3596c1966517 req-c4161685-0136-42bb-99d1-3ea780721d68 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047118 Aug 24 04:59:09.822434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 246/510] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:59:10.791537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7bda64e6-4301-49f3-a842-baacf5daf1ad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:10.792141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7bda64e6-4301-49f3-a842-baacf5daf1ad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:10.798840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bda64e6-4301-49f3-a842-baacf5daf1ad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:10.799315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bda64e6-4301-49f3-a842-baacf5daf1ad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:10.799744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bda64e6-4301-49f3-a842-baacf5daf1ad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:10.800418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bda64e6-4301-49f3-a842-baacf5daf1ad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:10.800861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bda64e6-4301-49f3-a842-baacf5daf1ad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:10.801284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bda64e6-4301-49f3-a842-baacf5daf1ad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:10.931985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7bda64e6-4301-49f3-a842-baacf5daf1ad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:10.939733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7bda64e6-4301-49f3-a842-baacf5daf1ad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1318 microversion: 2.1 time: 0.152614 Aug 24 04:59:10.940303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 265/511] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:10 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:11.962484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e6ea59a3-ab6d-42f4-bc93-ffc7853cc69f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:11.963234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e6ea59a3-ab6d-42f4-bc93-ffc7853cc69f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:11.969435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6ea59a3-ab6d-42f4-bc93-ffc7853cc69f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:11.969911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6ea59a3-ab6d-42f4-bc93-ffc7853cc69f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:11.970340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6ea59a3-ab6d-42f4-bc93-ffc7853cc69f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:11.971051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6ea59a3-ab6d-42f4-bc93-ffc7853cc69f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:11.971499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6ea59a3-ab6d-42f4-bc93-ffc7853cc69f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:11.971942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6ea59a3-ab6d-42f4-bc93-ffc7853cc69f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:12.136335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e6ea59a3-ab6d-42f4-bc93-ffc7853cc69f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:12.144191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e6ea59a3-ab6d-42f4-bc93-ffc7853cc69f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1318 microversion: 2.1 time: 0.186925 Aug 24 04:59:12.144759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 247/512] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:11 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:13.165858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2751dea6-64ef-458d-9164-b9b630a8df6b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:13.166445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2751dea6-64ef-458d-9164-b9b630a8df6b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:13.173424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2751dea6-64ef-458d-9164-b9b630a8df6b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:13.173904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2751dea6-64ef-458d-9164-b9b630a8df6b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:13.174335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2751dea6-64ef-458d-9164-b9b630a8df6b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:13.175049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2751dea6-64ef-458d-9164-b9b630a8df6b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:13.175489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2751dea6-64ef-458d-9164-b9b630a8df6b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:13.175897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2751dea6-64ef-458d-9164-b9b630a8df6b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:13.310725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2751dea6-64ef-458d-9164-b9b630a8df6b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:13.318432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2751dea6-64ef-458d-9164-b9b630a8df6b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1318 microversion: 2.1 time: 0.156970 Aug 24 04:59:13.319037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 266/513] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:13 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:14.339419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-69fe33d4-9ed1-4895-b9a3-1cc287218da3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:14.340015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-69fe33d4-9ed1-4895-b9a3-1cc287218da3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:14.346822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fe33d4-9ed1-4895-b9a3-1cc287218da3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:14.347294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fe33d4-9ed1-4895-b9a3-1cc287218da3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:14.347718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fe33d4-9ed1-4895-b9a3-1cc287218da3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:14.348593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fe33d4-9ed1-4895-b9a3-1cc287218da3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:14.349046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fe33d4-9ed1-4895-b9a3-1cc287218da3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:14.349459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fe33d4-9ed1-4895-b9a3-1cc287218da3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:14.354173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:14.483700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-69fe33d4-9ed1-4895-b9a3-1cc287218da3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:14.491292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-69fe33d4-9ed1-4895-b9a3-1cc287218da3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1318 microversion: 2.1 time: 0.155808 Aug 24 04:59:14.491891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 248/514] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:14 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:15.278918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-db1a270e-7b5b-48d4-9c1e-5273066e8360 req-513bddd7-0d51-4208-bbe7-009c31bf145a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f9cc46-e608-4e87-8a41-cbd6058576a0", "name": "network-vif-plugged", "status": "completed", "tag": "a8ec641b-f5c0-4262-ae7a-a531d6ad11dd"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:15.284124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:15.290051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-db1a270e-7b5b-48d4-9c1e-5273066e8360 req-513bddd7-0d51-4208-bbe7-009c31bf145a service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:15.290524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-db1a270e-7b5b-48d4-9c1e-5273066e8360 req-513bddd7-0d51-4208-bbe7-009c31bf145a service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:15.290974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-db1a270e-7b5b-48d4-9c1e-5273066e8360 req-513bddd7-0d51-4208-bbe7-009c31bf145a service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:15.303062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-db1a270e-7b5b-48d4-9c1e-5273066e8360 req-513bddd7-0d51-4208-bbe7-009c31bf145a service nova] Creating event network-vif-plugged:a8ec641b-f5c0-4262-ae7a-a531d6ad11dd for instance 61f9cc46-e608-4e87-8a41-cbd6058576a0 on hv-cinder-85426 Aug 24 04:59:15.308146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-db1a270e-7b5b-48d4-9c1e-5273066e8360 req-513bddd7-0d51-4208-bbe7-009c31bf145a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033191 Aug 24 04:59:15.308743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 267/515] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 04:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 04:59:15.513264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8623eb92-7248-4292-882f-ee18f0ba0a91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:15.513863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8623eb92-7248-4292-882f-ee18f0ba0a91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:15.515796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:15.516445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=6 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:15.522930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8623eb92-7248-4292-882f-ee18f0ba0a91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:15.524162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8623eb92-7248-4292-882f-ee18f0ba0a91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:15.524677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8623eb92-7248-4292-882f-ee18f0ba0a91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:15.525376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8623eb92-7248-4292-882f-ee18f0ba0a91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:15.525830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8623eb92-7248-4292-882f-ee18f0ba0a91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:15.526250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8623eb92-7248-4292-882f-ee18f0ba0a91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:15.684479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8623eb92-7248-4292-882f-ee18f0ba0a91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:15.693920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8623eb92-7248-4292-882f-ee18f0ba0a91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1318 microversion: 2.1 time: 0.184476 Aug 24 04:59:15.694510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 249/516] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:15 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:16.716845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aa88b24c-3059-45ea-9329-39df759ae9f8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:16.717540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aa88b24c-3059-45ea-9329-39df759ae9f8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:16.723728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa88b24c-3059-45ea-9329-39df759ae9f8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:16.724203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa88b24c-3059-45ea-9329-39df759ae9f8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:16.724633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa88b24c-3059-45ea-9329-39df759ae9f8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:16.725311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa88b24c-3059-45ea-9329-39df759ae9f8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:16.725757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa88b24c-3059-45ea-9329-39df759ae9f8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:16.726176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa88b24c-3059-45ea-9329-39df759ae9f8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:16.861067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aa88b24c-3059-45ea-9329-39df759ae9f8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:16.868906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aa88b24c-3059-45ea-9329-39df759ae9f8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1318 microversion: 2.1 time: 0.156880 Aug 24 04:59:16.869471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 268/517] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:16 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:17.889475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-68b65453-e92e-41ce-a3b5-f57f8b803574 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:17.890079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-68b65453-e92e-41ce-a3b5-f57f8b803574 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:17.896626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b65453-e92e-41ce-a3b5-f57f8b803574 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:17.897135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b65453-e92e-41ce-a3b5-f57f8b803574 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:17.897569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b65453-e92e-41ce-a3b5-f57f8b803574 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:17.898867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b65453-e92e-41ce-a3b5-f57f8b803574 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:17.899441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b65453-e92e-41ce-a3b5-f57f8b803574 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:17.899864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b65453-e92e-41ce-a3b5-f57f8b803574 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:18.028790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-68b65453-e92e-41ce-a3b5-f57f8b803574 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:18.036391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-68b65453-e92e-41ce-a3b5-f57f8b803574 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1318 microversion: 2.1 time: 0.150850 Aug 24 04:59:18.036938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 250/518] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:17 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 04:59:19.057297 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bc62913a-0ca5-45a7-8308-84c0e668a56f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 04:59:19.057887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bc62913a-0ca5-45a7-8308-84c0e668a56f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:19.064300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc62913a-0ca5-45a7-8308-84c0e668a56f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:19.064779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc62913a-0ca5-45a7-8308-84c0e668a56f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:19.065210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc62913a-0ca5-45a7-8308-84c0e668a56f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:19.065893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc62913a-0ca5-45a7-8308-84c0e668a56f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:19.066344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc62913a-0ca5-45a7-8308-84c0e668a56f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:19.066793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc62913a-0ca5-45a7-8308-84c0e668a56f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:19.198379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bc62913a-0ca5-45a7-8308-84c0e668a56f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 04:59:19.205923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bc62913a-0ca5-45a7-8308-84c0e668a56f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1507 microversion: 2.1 time: 0.152698 Aug 24 04:59:19.206480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 269/519] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 04:59:19 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 04:59:19.226311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-215efd6a-fadf-49b9-ba78-9b40e4d2830f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70782f84-5eb0-4648-bf74-8cc7d1972700", "device": "/dev/sdb"}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:19.228745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-215efd6a-fadf-49b9-ba78-9b40e4d2830f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:19.235151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215efd6a-fadf-49b9-ba78-9b40e4d2830f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:19.235621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215efd6a-fadf-49b9-ba78-9b40e4d2830f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:19.236054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215efd6a-fadf-49b9-ba78-9b40e4d2830f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:19.236731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215efd6a-fadf-49b9-ba78-9b40e4d2830f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:19.237172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215efd6a-fadf-49b9-ba78-9b40e4d2830f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:19.237584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215efd6a-fadf-49b9-ba78-9b40e4d2830f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:19.498948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-215efd6a-fadf-49b9-ba78-9b40e4d2830f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "POST /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276300 Aug 24 04:59:19.500016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 251/520] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 04:59:19 2022] POST /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 04:59:20.355961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:59:20.356571 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 04:59:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:59:28.642638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 04:59:28.643123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 04:59:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 04:59:31.866015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=25 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:31.866763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=28 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:31.969354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e79b672d-95e8-4cbc-b577-8a5dd301ff26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff376299-7da9-46be-a490-9646a192e88e"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 04:59:31.971755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e79b672d-95e8-4cbc-b577-8a5dd301ff26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 04:59:31.978394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e79b672d-95e8-4cbc-b577-8a5dd301ff26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:31.978909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e79b672d-95e8-4cbc-b577-8a5dd301ff26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:31.979336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e79b672d-95e8-4cbc-b577-8a5dd301ff26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:31.980013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e79b672d-95e8-4cbc-b577-8a5dd301ff26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 04:59:31.980453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e79b672d-95e8-4cbc-b577-8a5dd301ff26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 04:59:31.980866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e79b672d-95e8-4cbc-b577-8a5dd301ff26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 04:59:32.259598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e79b672d-95e8-4cbc-b577-8a5dd301ff26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.397578 Aug 24 04:59:32.260204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 270/521] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 04:59:31 2022] POST /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 194 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:19.625832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:19.626601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:19.631265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-021bf11f-0d50-4f6a-b761-7063b8ad57c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:19.631937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-021bf11f-0d50-4f6a-b761-7063b8ad57c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:19.640949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-021bf11f-0d50-4f6a-b761-7063b8ad57c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.641517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-021bf11f-0d50-4f6a-b761-7063b8ad57c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.641955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-021bf11f-0d50-4f6a-b761-7063b8ad57c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.642643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-021bf11f-0d50-4f6a-b761-7063b8ad57c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.643125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-021bf11f-0d50-4f6a-b761-7063b8ad57c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.643549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-021bf11f-0d50-4f6a-b761-7063b8ad57c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.669986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-021bf11f-0d50-4f6a-b761-7063b8ad57c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Going to try to terminate instance {{(pid=120557) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:00:19.744172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-021bf11f-0d50-4f6a-b761-7063b8ad57c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "DELETE /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 204 len: 0 microversion: 2.1 time: 0.120039 Aug 24 05:00:19.744737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 252/522] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:00:19 2022] DELETE /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:00:19.750724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:19.751607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:19.755700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e707c43b-fbe6-41e6-b8c1-8860ee19c732 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:19.756380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e707c43b-fbe6-41e6-b8c1-8860ee19c732 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:19.763680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e707c43b-fbe6-41e6-b8c1-8860ee19c732 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.764162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e707c43b-fbe6-41e6-b8c1-8860ee19c732 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.764593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e707c43b-fbe6-41e6-b8c1-8860ee19c732 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.765349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e707c43b-fbe6-41e6-b8c1-8860ee19c732 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:19.765821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e707c43b-fbe6-41e6-b8c1-8860ee19c732 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:19.766101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e707c43b-fbe6-41e6-b8c1-8860ee19c732 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:19.901840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e707c43b-fbe6-41e6-b8c1-8860ee19c732 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:19.909946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e707c43b-fbe6-41e6-b8c1-8860ee19c732 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.160823 Aug 24 05:00:19.910504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 271/523] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:19 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:20.932949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4fc80b84-0426-4753-ad5b-a73f466d403b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:20.933649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4fc80b84-0426-4753-ad5b-a73f466d403b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:20.940112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc80b84-0426-4753-ad5b-a73f466d403b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:20.940594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc80b84-0426-4753-ad5b-a73f466d403b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:20.941028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc80b84-0426-4753-ad5b-a73f466d403b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:20.941710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc80b84-0426-4753-ad5b-a73f466d403b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:20.942162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc80b84-0426-4753-ad5b-a73f466d403b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:20.942595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc80b84-0426-4753-ad5b-a73f466d403b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.075172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4fc80b84-0426-4753-ad5b-a73f466d403b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:21.083002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4fc80b84-0426-4753-ad5b-a73f466d403b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.154773 Aug 24 05:00:21.083566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 253/524] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:20 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:21.657678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dcbd284e-8d17-457b-af4d-327bf8addf45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:21.658300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dcbd284e-8d17-457b-af4d-327bf8addf45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:21.664274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcbd284e-8d17-457b-af4d-327bf8addf45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.664824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcbd284e-8d17-457b-af4d-327bf8addf45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.665310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcbd284e-8d17-457b-af4d-327bf8addf45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.665987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcbd284e-8d17-457b-af4d-327bf8addf45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:21.666432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcbd284e-8d17-457b-af4d-327bf8addf45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:21.666883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcbd284e-8d17-457b-af4d-327bf8addf45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:21.748878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-dcbd284e-8d17-457b-af4d-327bf8addf45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lazy-loading 'services' on Instance uuid 598c5040-751c-4914-906d-031f0abe36aa {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:00:21.822554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dcbd284e-8d17-457b-af4d-327bf8addf45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "DELETE /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments/a41d43cd-8f3b-4903-87e9-f197542e059f" status: 202 len: 0 microversion: 2.1 time: 0.266311 Aug 24 05:00:21.823177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 272/525] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:00:21 2022] DELETE /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments/a41d43cd-8f3b-4903-87e9-f197542e059f => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:00:22.106138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-667f4894-ad7e-448a-be2e-e31c9aa0d2ec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:22.106981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-667f4894-ad7e-448a-be2e-e31c9aa0d2ec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:22.113181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-667f4894-ad7e-448a-be2e-e31c9aa0d2ec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.113652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-667f4894-ad7e-448a-be2e-e31c9aa0d2ec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.114086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-667f4894-ad7e-448a-be2e-e31c9aa0d2ec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.114799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-667f4894-ad7e-448a-be2e-e31c9aa0d2ec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:22.115251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-667f4894-ad7e-448a-be2e-e31c9aa0d2ec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:22.115679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-667f4894-ad7e-448a-be2e-e31c9aa0d2ec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:22.247449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-667f4894-ad7e-448a-be2e-e31c9aa0d2ec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:22.255129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-667f4894-ad7e-448a-be2e-e31c9aa0d2ec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.154557 Aug 24 05:00:22.255693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 254/526] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:22 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:23.276977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4f8bef47-fca8-426a-bb02-a8afa0940078 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:23.277663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4f8bef47-fca8-426a-bb02-a8afa0940078 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:23.283782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f8bef47-fca8-426a-bb02-a8afa0940078 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:23.284263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f8bef47-fca8-426a-bb02-a8afa0940078 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:23.284695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f8bef47-fca8-426a-bb02-a8afa0940078 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:23.285367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f8bef47-fca8-426a-bb02-a8afa0940078 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:23.285816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f8bef47-fca8-426a-bb02-a8afa0940078 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:23.286235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f8bef47-fca8-426a-bb02-a8afa0940078 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:23.418314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4f8bef47-fca8-426a-bb02-a8afa0940078 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:23.426131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4f8bef47-fca8-426a-bb02-a8afa0940078 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.153863 Aug 24 05:00:23.426677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 273/527] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:23 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:24.448090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d2ab3ea7-5aef-4b11-b51e-f244b0cefaeb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:24.448616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d2ab3ea7-5aef-4b11-b51e-f244b0cefaeb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:24.454984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2ab3ea7-5aef-4b11-b51e-f244b0cefaeb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.455454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2ab3ea7-5aef-4b11-b51e-f244b0cefaeb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.455881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2ab3ea7-5aef-4b11-b51e-f244b0cefaeb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.456552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2ab3ea7-5aef-4b11-b51e-f244b0cefaeb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:24.456995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2ab3ea7-5aef-4b11-b51e-f244b0cefaeb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:24.457402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2ab3ea7-5aef-4b11-b51e-f244b0cefaeb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:24.587599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d2ab3ea7-5aef-4b11-b51e-f244b0cefaeb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:24.595324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d2ab3ea7-5aef-4b11-b51e-f244b0cefaeb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.151597 Aug 24 05:00:24.596091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 255/528] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:24 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:25.617404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-19fad604-a06a-496a-b1e4-837a62268c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:25.618003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-19fad604-a06a-496a-b1e4-837a62268c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:25.624353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19fad604-a06a-496a-b1e4-837a62268c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:25.624825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19fad604-a06a-496a-b1e4-837a62268c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.625248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19fad604-a06a-496a-b1e4-837a62268c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.625915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19fad604-a06a-496a-b1e4-837a62268c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:25.626355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19fad604-a06a-496a-b1e4-837a62268c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:25.626787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19fad604-a06a-496a-b1e4-837a62268c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:25.759721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-19fad604-a06a-496a-b1e4-837a62268c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:25.767284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-19fad604-a06a-496a-b1e4-837a62268c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.153846 Aug 24 05:00:25.767832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 274/529] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:25 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:26.788281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-db2bd5e6-2a7e-4e26-8ed2-03c8ef3c0a45 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:26.788886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-db2bd5e6-2a7e-4e26-8ed2-03c8ef3c0a45 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:26.795680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db2bd5e6-2a7e-4e26-8ed2-03c8ef3c0a45 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.796156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db2bd5e6-2a7e-4e26-8ed2-03c8ef3c0a45 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.796588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db2bd5e6-2a7e-4e26-8ed2-03c8ef3c0a45 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.797271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db2bd5e6-2a7e-4e26-8ed2-03c8ef3c0a45 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:26.797723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db2bd5e6-2a7e-4e26-8ed2-03c8ef3c0a45 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:26.798144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db2bd5e6-2a7e-4e26-8ed2-03c8ef3c0a45 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:26.938384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-db2bd5e6-2a7e-4e26-8ed2-03c8ef3c0a45 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:26.946676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-db2bd5e6-2a7e-4e26-8ed2-03c8ef3c0a45 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.162283 Aug 24 05:00:26.947254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 256/530] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:26 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:27.967502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5979ed6c-d6e8-4ba5-a374-26f185ce11b8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:27.968108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5979ed6c-d6e8-4ba5-a374-26f185ce11b8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:27.974547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5979ed6c-d6e8-4ba5-a374-26f185ce11b8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.975068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5979ed6c-d6e8-4ba5-a374-26f185ce11b8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.975503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5979ed6c-d6e8-4ba5-a374-26f185ce11b8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:27.976183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5979ed6c-d6e8-4ba5-a374-26f185ce11b8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:27.977172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5979ed6c-d6e8-4ba5-a374-26f185ce11b8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:27.977586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5979ed6c-d6e8-4ba5-a374-26f185ce11b8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:28.106529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5979ed6c-d6e8-4ba5-a374-26f185ce11b8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:28.114235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5979ed6c-d6e8-4ba5-a374-26f185ce11b8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.150581 Aug 24 05:00:28.114814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 275/531] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:27 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:29.136495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-52ad44bc-c821-48a6-934e-e9b89b0a64e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:29.137099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-52ad44bc-c821-48a6-934e-e9b89b0a64e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:29.143515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52ad44bc-c821-48a6-934e-e9b89b0a64e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.143994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52ad44bc-c821-48a6-934e-e9b89b0a64e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.144428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52ad44bc-c821-48a6-934e-e9b89b0a64e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.145109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52ad44bc-c821-48a6-934e-e9b89b0a64e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:29.145611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52ad44bc-c821-48a6-934e-e9b89b0a64e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:29.146034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52ad44bc-c821-48a6-934e-e9b89b0a64e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:29.276810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-52ad44bc-c821-48a6-934e-e9b89b0a64e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:29.284517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-52ad44bc-c821-48a6-934e-e9b89b0a64e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.152630 Aug 24 05:00:29.285066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 257/532] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:29 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:30.309342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-85af2fd4-0bfb-4898-a182-fe34e971218a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:30.309936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-85af2fd4-0bfb-4898-a182-fe34e971218a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:30.316590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85af2fd4-0bfb-4898-a182-fe34e971218a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:30.317075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85af2fd4-0bfb-4898-a182-fe34e971218a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:30.317500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85af2fd4-0bfb-4898-a182-fe34e971218a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:30.318186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85af2fd4-0bfb-4898-a182-fe34e971218a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:30.318631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85af2fd4-0bfb-4898-a182-fe34e971218a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:30.319076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85af2fd4-0bfb-4898-a182-fe34e971218a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:30.456098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-85af2fd4-0bfb-4898-a182-fe34e971218a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:30.464710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-85af2fd4-0bfb-4898-a182-fe34e971218a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.159734 Aug 24 05:00:30.465274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 276/533] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:30 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:31.485313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1009d006-5092-450b-afc2-b54f849d1a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:31.485921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1009d006-5092-450b-afc2-b54f849d1a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:31.493043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1009d006-5092-450b-afc2-b54f849d1a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.493514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1009d006-5092-450b-afc2-b54f849d1a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.493943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1009d006-5092-450b-afc2-b54f849d1a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.494616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1009d006-5092-450b-afc2-b54f849d1a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:31.495103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1009d006-5092-450b-afc2-b54f849d1a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:31.495526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1009d006-5092-450b-afc2-b54f849d1a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:31.629583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1009d006-5092-450b-afc2-b54f849d1a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:31.638282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1009d006-5092-450b-afc2-b54f849d1a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.156827 Aug 24 05:00:31.638901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 258/534] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:31 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:32.659239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6b55d964-7e32-4a79-b984-3ef29f8d1f05 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:32.659772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6b55d964-7e32-4a79-b984-3ef29f8d1f05 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:32.667113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b55d964-7e32-4a79-b984-3ef29f8d1f05 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.667590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b55d964-7e32-4a79-b984-3ef29f8d1f05 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.668016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b55d964-7e32-4a79-b984-3ef29f8d1f05 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.668690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b55d964-7e32-4a79-b984-3ef29f8d1f05 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:32.669132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b55d964-7e32-4a79-b984-3ef29f8d1f05 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:32.669805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b55d964-7e32-4a79-b984-3ef29f8d1f05 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:32.808211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6b55d964-7e32-4a79-b984-3ef29f8d1f05 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:32.815903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6b55d964-7e32-4a79-b984-3ef29f8d1f05 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.160523 Aug 24 05:00:32.816460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 277/535] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:32 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:33.837583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-447e6502-c8c1-4818-ac08-d68557efdf14 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:33.838780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-447e6502-c8c1-4818-ac08-d68557efdf14 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:33.846811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-447e6502-c8c1-4818-ac08-d68557efdf14 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:33.847600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-447e6502-c8c1-4818-ac08-d68557efdf14 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:33.848213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-447e6502-c8c1-4818-ac08-d68557efdf14 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:33.848980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-447e6502-c8c1-4818-ac08-d68557efdf14 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:33.849464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-447e6502-c8c1-4818-ac08-d68557efdf14 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:33.850016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-447e6502-c8c1-4818-ac08-d68557efdf14 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.081277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-447e6502-c8c1-4818-ac08-d68557efdf14 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:34.089848 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-447e6502-c8c1-4818-ac08-d68557efdf14 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1575 microversion: 2.1 time: 0.256224 Aug 24 05:00:34.090421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 259/536] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:33 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1575 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:34.937629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:34.940415 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:34.949515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.951238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.951742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.952545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:34.953028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:34.953688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:34.985864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-2b1ebe6e-3114-4fe5-9986-aeaefbfba733 req-33981e50-8193-4fae-ac46-ed236b5cc0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bf50e90-6712-4e3e-b813-653bfe69d460", "name": "network-vif-deleted", "tag": "ec1c9364-3199-41cb-89a1-3a76d09fecc6"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:00:34.989878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lazy-loading 'flavor' on Instance uuid 246c7f17-b6b8-470f-aa27-f23cac6e0df5 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:00:35.004931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-2b1ebe6e-3114-4fe5-9986-aeaefbfba733 req-33981e50-8193-4fae-ac46-ed236b5cc0b5 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:35.005407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-2b1ebe6e-3114-4fe5-9986-aeaefbfba733 req-33981e50-8193-4fae-ac46-ed236b5cc0b5 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:35.005831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-2b1ebe6e-3114-4fe5-9986-aeaefbfba733 req-33981e50-8193-4fae-ac46-ed236b5cc0b5 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.031880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-2b1ebe6e-3114-4fe5-9986-aeaefbfba733 req-33981e50-8193-4fae-ac46-ed236b5cc0b5 service nova] Creating event network-vif-deleted:ec1c9364-3199-41cb-89a1-3a76d09fecc6 for instance 5bf50e90-6712-4e3e-b813-653bfe69d460 on hv-cinder-85426 Aug 24 05:00:35.037015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-2b1ebe6e-3114-4fe5-9986-aeaefbfba733 req-33981e50-8193-4fae-ac46-ed236b5cc0b5 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160189 Aug 24 05:00:35.037653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 278/537] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:00:35.112780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d7fc5a13-9aec-45db-91cc-98aa5650eec4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:35.113691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d7fc5a13-9aec-45db-91cc-98aa5650eec4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:35.123211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7fc5a13-9aec-45db-91cc-98aa5650eec4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:35.124156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7fc5a13-9aec-45db-91cc-98aa5650eec4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:35.124954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7fc5a13-9aec-45db-91cc-98aa5650eec4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.125972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7fc5a13-9aec-45db-91cc-98aa5650eec4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:35.126626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7fc5a13-9aec-45db-91cc-98aa5650eec4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:35.127345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7fc5a13-9aec-45db-91cc-98aa5650eec4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:35.202970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d7fc5a13-9aec-45db-91cc-98aa5650eec4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:35.212121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d7fc5a13-9aec-45db-91cc-98aa5650eec4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.104128 Aug 24 05:00:35.213434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 279/538] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:35 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:36.232953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-91fbd52e-63be-4604-abfa-8f4f8355d5c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:36.233677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-91fbd52e-63be-4604-abfa-8f4f8355d5c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:36.240443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91fbd52e-63be-4604-abfa-8f4f8355d5c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.240934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91fbd52e-63be-4604-abfa-8f4f8355d5c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.241364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91fbd52e-63be-4604-abfa-8f4f8355d5c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.242390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91fbd52e-63be-4604-abfa-8f4f8355d5c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:36.243010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91fbd52e-63be-4604-abfa-8f4f8355d5c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:36.243469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91fbd52e-63be-4604-abfa-8f4f8355d5c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:36.312882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-91fbd52e-63be-4604-abfa-8f4f8355d5c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:36.322045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-91fbd52e-63be-4604-abfa-8f4f8355d5c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.092872 Aug 24 05:00:36.322931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 280/539] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:36 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:37.342833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-67e19a9f-4d02-4d24-8d7d-9b35bd1bc94d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:37.343492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-67e19a9f-4d02-4d24-8d7d-9b35bd1bc94d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:37.349730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67e19a9f-4d02-4d24-8d7d-9b35bd1bc94d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:37.350205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67e19a9f-4d02-4d24-8d7d-9b35bd1bc94d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:37.350636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67e19a9f-4d02-4d24-8d7d-9b35bd1bc94d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:37.352107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67e19a9f-4d02-4d24-8d7d-9b35bd1bc94d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:37.352546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67e19a9f-4d02-4d24-8d7d-9b35bd1bc94d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:37.353104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67e19a9f-4d02-4d24-8d7d-9b35bd1bc94d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:37.413089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-67e19a9f-4d02-4d24-8d7d-9b35bd1bc94d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:37.421858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-67e19a9f-4d02-4d24-8d7d-9b35bd1bc94d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082936 Aug 24 05:00:37.422419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 281/540] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:37 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:38.444491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2ee95422-9828-4699-860b-ea7d9b543a00 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:38.445284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2ee95422-9828-4699-860b-ea7d9b543a00 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:38.451623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ee95422-9828-4699-860b-ea7d9b543a00 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.452104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ee95422-9828-4699-860b-ea7d9b543a00 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.452536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ee95422-9828-4699-860b-ea7d9b543a00 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.453216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ee95422-9828-4699-860b-ea7d9b543a00 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:38.453663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ee95422-9828-4699-860b-ea7d9b543a00 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:38.454081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ee95422-9828-4699-860b-ea7d9b543a00 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:38.515250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2ee95422-9828-4699-860b-ea7d9b543a00 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:38.523031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2ee95422-9828-4699-860b-ea7d9b543a00 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082372 Aug 24 05:00:38.523738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 282/541] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:38 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:39.543399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b647100f-4a58-4f8c-93ab-afaf6d2068a2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:39.544063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b647100f-4a58-4f8c-93ab-afaf6d2068a2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:39.550521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b647100f-4a58-4f8c-93ab-afaf6d2068a2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:39.551026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b647100f-4a58-4f8c-93ab-afaf6d2068a2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:39.551449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b647100f-4a58-4f8c-93ab-afaf6d2068a2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.552117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b647100f-4a58-4f8c-93ab-afaf6d2068a2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:39.552558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b647100f-4a58-4f8c-93ab-afaf6d2068a2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:39.552967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b647100f-4a58-4f8c-93ab-afaf6d2068a2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:39.613140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b647100f-4a58-4f8c-93ab-afaf6d2068a2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:39.621363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b647100f-4a58-4f8c-93ab-afaf6d2068a2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081790 Aug 24 05:00:39.621917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 283/542] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:39 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:40.642272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ee578143-4aff-4fe4-8a7b-747abd5c8efe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:40.642889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ee578143-4aff-4fe4-8a7b-747abd5c8efe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:40.650094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee578143-4aff-4fe4-8a7b-747abd5c8efe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.650572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee578143-4aff-4fe4-8a7b-747abd5c8efe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.651031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee578143-4aff-4fe4-8a7b-747abd5c8efe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.651718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee578143-4aff-4fe4-8a7b-747abd5c8efe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:40.652166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee578143-4aff-4fe4-8a7b-747abd5c8efe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:40.652584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee578143-4aff-4fe4-8a7b-747abd5c8efe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:40.717602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ee578143-4aff-4fe4-8a7b-747abd5c8efe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:40.725201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ee578143-4aff-4fe4-8a7b-747abd5c8efe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086821 Aug 24 05:00:40.725756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 284/543] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:40 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:41.745244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a19cc52e-ba0a-4694-8638-1d19d9d53227 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:41.745849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a19cc52e-ba0a-4694-8638-1d19d9d53227 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:41.752250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a19cc52e-ba0a-4694-8638-1d19d9d53227 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.752725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a19cc52e-ba0a-4694-8638-1d19d9d53227 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.753149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a19cc52e-ba0a-4694-8638-1d19d9d53227 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.753822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a19cc52e-ba0a-4694-8638-1d19d9d53227 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:41.754260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a19cc52e-ba0a-4694-8638-1d19d9d53227 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:41.754672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a19cc52e-ba0a-4694-8638-1d19d9d53227 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:41.815803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a19cc52e-ba0a-4694-8638-1d19d9d53227 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:41.823396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a19cc52e-ba0a-4694-8638-1d19d9d53227 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081946 Aug 24 05:00:41.823951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 285/544] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:41 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:42.843641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2603bd6e-44f5-41f5-8e0c-62374bd3148d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:42.844308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2603bd6e-44f5-41f5-8e0c-62374bd3148d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:42.850631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2603bd6e-44f5-41f5-8e0c-62374bd3148d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.851140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2603bd6e-44f5-41f5-8e0c-62374bd3148d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.851597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2603bd6e-44f5-41f5-8e0c-62374bd3148d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.852912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2603bd6e-44f5-41f5-8e0c-62374bd3148d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:42.853365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2603bd6e-44f5-41f5-8e0c-62374bd3148d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:42.853783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2603bd6e-44f5-41f5-8e0c-62374bd3148d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:42.914658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2603bd6e-44f5-41f5-8e0c-62374bd3148d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:42.922824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2603bd6e-44f5-41f5-8e0c-62374bd3148d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083037 Aug 24 05:00:42.923390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 286/545] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:42 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:43.943174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-47461b53-4d45-4f8f-9a66-dbc8c0c27b1a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:43.943848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-47461b53-4d45-4f8f-9a66-dbc8c0c27b1a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:43.950122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47461b53-4d45-4f8f-9a66-dbc8c0c27b1a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.950597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47461b53-4d45-4f8f-9a66-dbc8c0c27b1a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.951080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47461b53-4d45-4f8f-9a66-dbc8c0c27b1a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.951743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47461b53-4d45-4f8f-9a66-dbc8c0c27b1a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:43.952192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47461b53-4d45-4f8f-9a66-dbc8c0c27b1a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:43.952610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47461b53-4d45-4f8f-9a66-dbc8c0c27b1a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:43.970706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:44.015391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-47461b53-4d45-4f8f-9a66-dbc8c0c27b1a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:44.022986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-47461b53-4d45-4f8f-9a66-dbc8c0c27b1a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083592 Aug 24 05:00:44.023544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 287/546] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:43 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:44.949274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:45.015095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:45.043076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-afe86d75-0e90-45d0-b113-e57d3248f226 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:45.043683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-afe86d75-0e90-45d0-b113-e57d3248f226 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:45.050000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afe86d75-0e90-45d0-b113-e57d3248f226 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.050475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afe86d75-0e90-45d0-b113-e57d3248f226 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.050947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afe86d75-0e90-45d0-b113-e57d3248f226 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.051625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afe86d75-0e90-45d0-b113-e57d3248f226 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:45.052076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afe86d75-0e90-45d0-b113-e57d3248f226 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:45.052490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afe86d75-0e90-45d0-b113-e57d3248f226 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:45.116527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-afe86d75-0e90-45d0-b113-e57d3248f226 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:45.124875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-afe86d75-0e90-45d0-b113-e57d3248f226 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085629 Aug 24 05:00:45.125425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 288/547] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:45 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:46.145702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0dcbcae2-eccf-42a3-a3aa-372820e7ea3b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:46.146294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0dcbcae2-eccf-42a3-a3aa-372820e7ea3b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:46.153462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0dcbcae2-eccf-42a3-a3aa-372820e7ea3b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:46.153939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0dcbcae2-eccf-42a3-a3aa-372820e7ea3b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:46.154368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0dcbcae2-eccf-42a3-a3aa-372820e7ea3b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:46.155077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0dcbcae2-eccf-42a3-a3aa-372820e7ea3b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:46.155524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0dcbcae2-eccf-42a3-a3aa-372820e7ea3b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:46.155942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0dcbcae2-eccf-42a3-a3aa-372820e7ea3b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:46.218698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0dcbcae2-eccf-42a3-a3aa-372820e7ea3b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:46.226412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0dcbcae2-eccf-42a3-a3aa-372820e7ea3b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084544 Aug 24 05:00:46.227008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 289/548] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:46 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:47.247572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0a23a3ed-e53f-494a-b962-b4a7064aae74 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:47.248241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0a23a3ed-e53f-494a-b962-b4a7064aae74 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:47.254599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a23a3ed-e53f-494a-b962-b4a7064aae74 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:47.255107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a23a3ed-e53f-494a-b962-b4a7064aae74 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:47.255542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a23a3ed-e53f-494a-b962-b4a7064aae74 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:47.256220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a23a3ed-e53f-494a-b962-b4a7064aae74 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:47.256668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a23a3ed-e53f-494a-b962-b4a7064aae74 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:47.257099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a23a3ed-e53f-494a-b962-b4a7064aae74 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:47.319048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0a23a3ed-e53f-494a-b962-b4a7064aae74 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:47.327310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0a23a3ed-e53f-494a-b962-b4a7064aae74 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084309 Aug 24 05:00:47.327870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 290/549] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:47 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:48.347470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ca93abfe-b6b0-4419-a9a1-78e0bd0b4a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:48.348143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ca93abfe-b6b0-4419-a9a1-78e0bd0b4a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:48.354662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca93abfe-b6b0-4419-a9a1-78e0bd0b4a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.355167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca93abfe-b6b0-4419-a9a1-78e0bd0b4a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.355599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca93abfe-b6b0-4419-a9a1-78e0bd0b4a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.356280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca93abfe-b6b0-4419-a9a1-78e0bd0b4a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:48.356724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca93abfe-b6b0-4419-a9a1-78e0bd0b4a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:48.357145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca93abfe-b6b0-4419-a9a1-78e0bd0b4a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:48.420155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ca93abfe-b6b0-4419-a9a1-78e0bd0b4a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:48.427846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ca93abfe-b6b0-4419-a9a1-78e0bd0b4a37 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084250 Aug 24 05:00:48.428400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 291/550] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:48 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:49.505241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e5927647-4cac-4526-af9c-79ef43de9fa4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:49.505948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e5927647-4cac-4526-af9c-79ef43de9fa4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:49.512298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5927647-4cac-4526-af9c-79ef43de9fa4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:49.512773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5927647-4cac-4526-af9c-79ef43de9fa4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:49.513199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5927647-4cac-4526-af9c-79ef43de9fa4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.513872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5927647-4cac-4526-af9c-79ef43de9fa4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:49.514315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5927647-4cac-4526-af9c-79ef43de9fa4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:49.514752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5927647-4cac-4526-af9c-79ef43de9fa4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:49.579318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e5927647-4cac-4526-af9c-79ef43de9fa4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:49.587053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e5927647-4cac-4526-af9c-79ef43de9fa4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085590 Aug 24 05:00:49.587663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 292/551] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:49 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:50.607457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fe9e8b07-7b6d-4597-8ec7-4ffe42ca980b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:50.608131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fe9e8b07-7b6d-4597-8ec7-4ffe42ca980b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:50.610304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=45 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:50.615627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe9e8b07-7b6d-4597-8ec7-4ffe42ca980b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.616110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe9e8b07-7b6d-4597-8ec7-4ffe42ca980b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.616538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe9e8b07-7b6d-4597-8ec7-4ffe42ca980b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.617278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe9e8b07-7b6d-4597-8ec7-4ffe42ca980b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:50.617645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe9e8b07-7b6d-4597-8ec7-4ffe42ca980b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:50.618054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe9e8b07-7b6d-4597-8ec7-4ffe42ca980b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:50.680792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fe9e8b07-7b6d-4597-8ec7-4ffe42ca980b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:50.689034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fe9e8b07-7b6d-4597-8ec7-4ffe42ca980b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085477 Aug 24 05:00:50.689583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 293/552] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:50 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:51.710506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9fc9657e-8884-4469-9071-65da00770af3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:51.711242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9fc9657e-8884-4469-9071-65da00770af3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:51.718884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fc9657e-8884-4469-9071-65da00770af3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:51.719380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fc9657e-8884-4469-9071-65da00770af3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:51.719963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fc9657e-8884-4469-9071-65da00770af3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:51.720780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fc9657e-8884-4469-9071-65da00770af3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:51.721256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fc9657e-8884-4469-9071-65da00770af3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:51.721714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fc9657e-8884-4469-9071-65da00770af3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:51.783291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9fc9657e-8884-4469-9071-65da00770af3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:51.791569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9fc9657e-8884-4469-9071-65da00770af3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084612 Aug 24 05:00:51.792127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 294/553] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:51 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:00:52.812981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9f6cc309-0b05-4b2f-af19-1c59ee850dee tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:52.813630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9f6cc309-0b05-4b2f-af19-1c59ee850dee tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:52.819895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f6cc309-0b05-4b2f-af19-1c59ee850dee tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:52.820361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f6cc309-0b05-4b2f-af19-1c59ee850dee tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:52.820780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f6cc309-0b05-4b2f-af19-1c59ee850dee tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:52.821451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f6cc309-0b05-4b2f-af19-1c59ee850dee tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:52.821949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f6cc309-0b05-4b2f-af19-1c59ee850dee tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:52.822667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f6cc309-0b05-4b2f-af19-1c59ee850dee tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:52.882801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9f6cc309-0b05-4b2f-af19-1c59ee850dee tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:52.890509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9f6cc309-0b05-4b2f-af19-1c59ee850dee tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081382 Aug 24 05:00:52.891109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 295/554] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:52 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:54.011147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-037f0882-8255-4296-accb-27f9d4386572 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:54.011756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-037f0882-8255-4296-accb-27f9d4386572 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:54.017625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037f0882-8255-4296-accb-27f9d4386572 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:54.018096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037f0882-8255-4296-accb-27f9d4386572 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:54.018525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037f0882-8255-4296-accb-27f9d4386572 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:54.019225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037f0882-8255-4296-accb-27f9d4386572 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:54.019675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037f0882-8255-4296-accb-27f9d4386572 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:54.020166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037f0882-8255-4296-accb-27f9d4386572 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:54.084574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-037f0882-8255-4296-accb-27f9d4386572 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:54.092535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-037f0882-8255-4296-accb-27f9d4386572 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.184407 Aug 24 05:00:54.093098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 296/555] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:53 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:55.113451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-59002181-b003-40ed-ac72-79351537ec8d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:55.114279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-59002181-b003-40ed-ac72-79351537ec8d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:55.120911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59002181-b003-40ed-ac72-79351537ec8d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:55.121394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59002181-b003-40ed-ac72-79351537ec8d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:55.121828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59002181-b003-40ed-ac72-79351537ec8d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:55.122513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59002181-b003-40ed-ac72-79351537ec8d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:55.123039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59002181-b003-40ed-ac72-79351537ec8d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:55.123406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59002181-b003-40ed-ac72-79351537ec8d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:55.189500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-59002181-b003-40ed-ac72-79351537ec8d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:55.197422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-59002181-b003-40ed-ac72-79351537ec8d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087852 Aug 24 05:00:55.198196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 297/556] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:55 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:56.218032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c1ca4ba2-aadf-4246-8d38-d2bea7fd7fb9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:56.218711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c1ca4ba2-aadf-4246-8d38-d2bea7fd7fb9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:56.225080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba2-aadf-4246-8d38-d2bea7fd7fb9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:56.225558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba2-aadf-4246-8d38-d2bea7fd7fb9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:56.225995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba2-aadf-4246-8d38-d2bea7fd7fb9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:56.226673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba2-aadf-4246-8d38-d2bea7fd7fb9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:56.227256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba2-aadf-4246-8d38-d2bea7fd7fb9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:56.227675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ca4ba2-aadf-4246-8d38-d2bea7fd7fb9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:56.290406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c1ca4ba2-aadf-4246-8d38-d2bea7fd7fb9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:56.298385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c1ca4ba2-aadf-4246-8d38-d2bea7fd7fb9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084236 Aug 24 05:00:56.298981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 298/557] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:56 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:57.319890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fcae0ddb-bb73-42a8-9975-b3b233b8dccf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:57.320544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fcae0ddb-bb73-42a8-9975-b3b233b8dccf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:57.327459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcae0ddb-bb73-42a8-9975-b3b233b8dccf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:57.327938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcae0ddb-bb73-42a8-9975-b3b233b8dccf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:57.328370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcae0ddb-bb73-42a8-9975-b3b233b8dccf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:57.329050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcae0ddb-bb73-42a8-9975-b3b233b8dccf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:57.329506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcae0ddb-bb73-42a8-9975-b3b233b8dccf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:57.329926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcae0ddb-bb73-42a8-9975-b3b233b8dccf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:57.390406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fcae0ddb-bb73-42a8-9975-b3b233b8dccf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:57.398018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fcae0ddb-bb73-42a8-9975-b3b233b8dccf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082002 Aug 24 05:00:57.398584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 299/558] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:57 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:58.419872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5847af29-4abd-4e93-a61f-843e84188595 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:58.421247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5847af29-4abd-4e93-a61f-843e84188595 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:58.427544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5847af29-4abd-4e93-a61f-843e84188595 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:58.428016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5847af29-4abd-4e93-a61f-843e84188595 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:58.428442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5847af29-4abd-4e93-a61f-843e84188595 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:58.429107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5847af29-4abd-4e93-a61f-843e84188595 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:58.429547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5847af29-4abd-4e93-a61f-843e84188595 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:58.429958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5847af29-4abd-4e93-a61f-843e84188595 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:58.493305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5847af29-4abd-4e93-a61f-843e84188595 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:58.501382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5847af29-4abd-4e93-a61f-843e84188595 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086213 Aug 24 05:00:58.502087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 300/559] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:58 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:00:59.522086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3c171fb5-0aa0-41c5-ab66-bffce30b045f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:00:59.522796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3c171fb5-0aa0-41c5-ab66-bffce30b045f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:00:59.529089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c171fb5-0aa0-41c5-ab66-bffce30b045f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:59.529569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c171fb5-0aa0-41c5-ab66-bffce30b045f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:59.530003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c171fb5-0aa0-41c5-ab66-bffce30b045f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:59.530680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c171fb5-0aa0-41c5-ab66-bffce30b045f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:00:59.531153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c171fb5-0aa0-41c5-ab66-bffce30b045f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:00:59.531571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c171fb5-0aa0-41c5-ab66-bffce30b045f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:00:59.592642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3c171fb5-0aa0-41c5-ab66-bffce30b045f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:00:59.600328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3c171fb5-0aa0-41c5-ab66-bffce30b045f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082144 Aug 24 05:00:59.600900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 301/560] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:00:59 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:00.622060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c1e16217-3e32-4b78-84be-8dbc2e711ac1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:00.622671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c1e16217-3e32-4b78-84be-8dbc2e711ac1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:00.629188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e16217-3e32-4b78-84be-8dbc2e711ac1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:00.629672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e16217-3e32-4b78-84be-8dbc2e711ac1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:00.630103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e16217-3e32-4b78-84be-8dbc2e711ac1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:00.630813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e16217-3e32-4b78-84be-8dbc2e711ac1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:00.631266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e16217-3e32-4b78-84be-8dbc2e711ac1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:00.631687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e16217-3e32-4b78-84be-8dbc2e711ac1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:00.692671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c1e16217-3e32-4b78-84be-8dbc2e711ac1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:00.701132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c1e16217-3e32-4b78-84be-8dbc2e711ac1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083628 Aug 24 05:01:00.701683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 302/561] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:00 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:01.721630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-598558b2-2110-4994-bed6-e8878aa05e4c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:01.722319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-598558b2-2110-4994-bed6-e8878aa05e4c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:01.728700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-598558b2-2110-4994-bed6-e8878aa05e4c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:01.729189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-598558b2-2110-4994-bed6-e8878aa05e4c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:01.729613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-598558b2-2110-4994-bed6-e8878aa05e4c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:01.730284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-598558b2-2110-4994-bed6-e8878aa05e4c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:01.730745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-598558b2-2110-4994-bed6-e8878aa05e4c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:01.731158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-598558b2-2110-4994-bed6-e8878aa05e4c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:01.792750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-598558b2-2110-4994-bed6-e8878aa05e4c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:01.800672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-598558b2-2110-4994-bed6-e8878aa05e4c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082948 Aug 24 05:01:01.801228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 303/562] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:01 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:02.821021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0a908565-1e58-44d0-a0d4-3e06c8a0d537 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:02.821675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0a908565-1e58-44d0-a0d4-3e06c8a0d537 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:02.828165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a908565-1e58-44d0-a0d4-3e06c8a0d537 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:02.828645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a908565-1e58-44d0-a0d4-3e06c8a0d537 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:02.829076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a908565-1e58-44d0-a0d4-3e06c8a0d537 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:02.829789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a908565-1e58-44d0-a0d4-3e06c8a0d537 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:02.830241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a908565-1e58-44d0-a0d4-3e06c8a0d537 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:02.830719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a908565-1e58-44d0-a0d4-3e06c8a0d537 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:02.834547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:02.896966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0a908565-1e58-44d0-a0d4-3e06c8a0d537 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:02.905813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0a908565-1e58-44d0-a0d4-3e06c8a0d537 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.088735 Aug 24 05:01:02.906366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 304/563] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:02 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:03.926830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-523320c3-16b2-49b4-92c6-adff020fc005 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:03.927486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-523320c3-16b2-49b4-92c6-adff020fc005 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:03.934657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-523320c3-16b2-49b4-92c6-adff020fc005 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:03.935153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-523320c3-16b2-49b4-92c6-adff020fc005 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:03.935587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-523320c3-16b2-49b4-92c6-adff020fc005 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:03.936280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-523320c3-16b2-49b4-92c6-adff020fc005 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:03.936724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-523320c3-16b2-49b4-92c6-adff020fc005 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:03.937139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-523320c3-16b2-49b4-92c6-adff020fc005 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:03.998395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-523320c3-16b2-49b4-92c6-adff020fc005 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:04.007023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-523320c3-16b2-49b4-92c6-adff020fc005 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083946 Aug 24 05:01:04.007587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 305/564] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:03 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:05.027277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9140c4fe-c114-4336-99eb-56dc90ee561f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:05.027941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9140c4fe-c114-4336-99eb-56dc90ee561f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:05.034318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9140c4fe-c114-4336-99eb-56dc90ee561f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:05.034834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9140c4fe-c114-4336-99eb-56dc90ee561f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:05.035266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9140c4fe-c114-4336-99eb-56dc90ee561f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:05.035943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9140c4fe-c114-4336-99eb-56dc90ee561f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:05.036392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9140c4fe-c114-4336-99eb-56dc90ee561f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:05.036811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9140c4fe-c114-4336-99eb-56dc90ee561f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:05.098582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9140c4fe-c114-4336-99eb-56dc90ee561f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:05.106654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9140c4fe-c114-4336-99eb-56dc90ee561f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083348 Aug 24 05:01:05.107246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 306/565] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:05 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:06.127707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-85faa547-7cc5-4d1b-8855-e02f5498be68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:06.128362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-85faa547-7cc5-4d1b-8855-e02f5498be68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:06.134882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85faa547-7cc5-4d1b-8855-e02f5498be68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:06.135375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85faa547-7cc5-4d1b-8855-e02f5498be68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:06.135808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85faa547-7cc5-4d1b-8855-e02f5498be68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:06.136497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85faa547-7cc5-4d1b-8855-e02f5498be68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:06.136949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85faa547-7cc5-4d1b-8855-e02f5498be68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:06.137366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85faa547-7cc5-4d1b-8855-e02f5498be68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:06.199523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-85faa547-7cc5-4d1b-8855-e02f5498be68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:01:06.207135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-85faa547-7cc5-4d1b-8855-e02f5498be68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083268 Aug 24 05:01:06.207699 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 307/566] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:01:06 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:01:06.528983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e6630362-79d1-4a2a-a204-244980c56c3e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:01:06.529470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e6630362-79d1-4a2a-a204-244980c56c3e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:06.535326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6630362-79d1-4a2a-a204-244980c56c3e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:06.535794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6630362-79d1-4a2a-a204-244980c56c3e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:06.536217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6630362-79d1-4a2a-a204-244980c56c3e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:06.536887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6630362-79d1-4a2a-a204-244980c56c3e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:06.537342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6630362-79d1-4a2a-a204-244980c56c3e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:06.537742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6630362-79d1-4a2a-a204-244980c56c3e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:06.561068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e6630362-79d1-4a2a-a204-244980c56c3e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd/ips" status: 200 len: 148 microversion: 2.1 time: 0.085327 Aug 24 05:01:06.561605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 308/567] 10.222.0.97 () {58 vars in 1248 bytes} [Wed Aug 24 05:01:06 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd/ips => generated 148 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:01:06.572566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cda133e-f89a-444c-bfa5-9a4d23378818"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:01:06.574917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:01:06.580618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:06.581090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:06.581514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:06.582186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:01:06.582627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:01:06.583063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:01:16.578904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=33 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:16.600830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=30 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:34.975740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [14204b2e-2799-4c1c-aec5-4108a696bd51] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:02:35.109345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Invalid volume: volume 0cda133e-f89a-444c-bfa5-9a4d23378818 is already attached to instances: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: POST /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd/os-volume_attachments HTTP/1.1 Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 74 Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:02:35.112886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {"volumeAttachment": {"volumeId": "0cda133e-f89a-444c-bfa5-9a4d23378818"}} Aug 24 05:02:35.114296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Invalid volume: volume 0cda133e-f89a-444c-bfa5-9a4d23378818 is already attached to instances: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'server_id': '6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd', 'body': {'volumeAttachment': {'volumeId': '0cda133e-f89a-444c-bfa5-9a4d23378818'}}} Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0cda133e-f89a-444c-bfa5-9a4d23378818 is already attached to instances: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:02:35.115449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0cda133e-f89a-444c-bfa5-9a4d23378818 is already attached to instances: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:02:35.117252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:02:35.118726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:02:35.118726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:02:35.118726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:02:35.118726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0cda133e-f89a-444c-bfa5-9a4d23378818 is already attached to instances: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 Aug 24 05:02:35.118726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:02:35.118726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 400 to user: Invalid volume: volume 0cda133e-f89a-444c-bfa5-9a4d23378818 is already attached to instances: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:02:35.118726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-447e9213-306f-48fc-b182-e50d2854d60b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 88.545588 Aug 24 05:02:35.118726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 309/568] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 05:01:06 2022] POST /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd/os-volume_attachments => generated 174 bytes in 88547 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 05:02:35.121072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ba6ee756-dbb0-4c74-adde-ff25e6521e03 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:35.121709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ba6ee756-dbb0-4c74-adde-ff25e6521e03 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:35.129177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba6ee756-dbb0-4c74-adde-ff25e6521e03 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:35.129659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba6ee756-dbb0-4c74-adde-ff25e6521e03 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:35.130145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba6ee756-dbb0-4c74-adde-ff25e6521e03 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:35.131040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba6ee756-dbb0-4c74-adde-ff25e6521e03 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:35.131490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba6ee756-dbb0-4c74-adde-ff25e6521e03 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:35.132272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba6ee756-dbb0-4c74-adde-ff25e6521e03 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:35.198470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ba6ee756-dbb0-4c74-adde-ff25e6521e03 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:35.207034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ba6ee756-dbb0-4c74-adde-ff25e6521e03 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.090686 Aug 24 05:02:35.207582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 310/569] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:35 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:35.212009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-621d740b-b2bb-4ad2-92ac-8033186a42c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:35.212539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-621d740b-b2bb-4ad2-92ac-8033186a42c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:35.218796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-621d740b-b2bb-4ad2-92ac-8033186a42c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:35.219263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-621d740b-b2bb-4ad2-92ac-8033186a42c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:35.219706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-621d740b-b2bb-4ad2-92ac-8033186a42c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:35.220370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-621d740b-b2bb-4ad2-92ac-8033186a42c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:35.220811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-621d740b-b2bb-4ad2-92ac-8033186a42c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:35.221220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-621d740b-b2bb-4ad2-92ac-8033186a42c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:35.244979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-621d740b-b2bb-4ad2-92ac-8033186a42c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Going to try to terminate instance {{(pid=120558) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:02:35.319745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-621d740b-b2bb-4ad2-92ac-8033186a42c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 204 len: 0 microversion: 2.1 time: 0.110537 Aug 24 05:02:35.321247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 311/570] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:02:35 2022] DELETE /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:02:35.329464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dc2c665f-86b7-4a1c-9435-33dc0459a850 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:35.330164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dc2c665f-86b7-4a1c-9435-33dc0459a850 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:35.336018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc2c665f-86b7-4a1c-9435-33dc0459a850 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:35.336492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc2c665f-86b7-4a1c-9435-33dc0459a850 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:35.336929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc2c665f-86b7-4a1c-9435-33dc0459a850 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:35.337608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc2c665f-86b7-4a1c-9435-33dc0459a850 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:35.338057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc2c665f-86b7-4a1c-9435-33dc0459a850 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:35.338475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc2c665f-86b7-4a1c-9435-33dc0459a850 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:35.400613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dc2c665f-86b7-4a1c-9435-33dc0459a850 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:35.409098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dc2c665f-86b7-4a1c-9435-33dc0459a850 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086111 Aug 24 05:02:35.409657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 312/571] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:35 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:35.414028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c6b627fd-8fc8-4471-bbd0-3e4f8a6be063 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:35.414621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c6b627fd-8fc8-4471-bbd0-3e4f8a6be063 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:35.420504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6b627fd-8fc8-4471-bbd0-3e4f8a6be063 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:35.420936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6b627fd-8fc8-4471-bbd0-3e4f8a6be063 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:35.421351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6b627fd-8fc8-4471-bbd0-3e4f8a6be063 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:35.422312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6b627fd-8fc8-4471-bbd0-3e4f8a6be063 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:35.422788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6b627fd-8fc8-4471-bbd0-3e4f8a6be063 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:35.423268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6b627fd-8fc8-4471-bbd0-3e4f8a6be063 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:35.554981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c6b627fd-8fc8-4471-bbd0-3e4f8a6be063 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:35.563652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c6b627fd-8fc8-4471-bbd0-3e4f8a6be063 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1679 microversion: 2.1 time: 0.153045 Aug 24 05:02:35.564214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 313/572] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:35 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:35.984601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [14204b2e-2799-4c1c-aec5-4108a696bd51] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 42874. Aug 24 05:02:35.987952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e3648e2d-b88f-4633-b0ec-1b0f81cf5b4e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/action" status: 200 len: 32 microversion: 2.1 time: 121.055551 Aug 24 05:02:35.988485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 260/573] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 05:00:34 2022] POST /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/action => generated 32 bytes in 121057 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:02:36.429683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fbbafd3e-ca9b-4713-b4c4-b8d4407292e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:36.430288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fbbafd3e-ca9b-4713-b4c4-b8d4407292e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:36.436766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbbafd3e-ca9b-4713-b4c4-b8d4407292e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:36.437244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbbafd3e-ca9b-4713-b4c4-b8d4407292e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:36.437673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbbafd3e-ca9b-4713-b4c4-b8d4407292e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:36.438353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbbafd3e-ca9b-4713-b4c4-b8d4407292e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:36.438852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbbafd3e-ca9b-4713-b4c4-b8d4407292e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:36.439269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbbafd3e-ca9b-4713-b4c4-b8d4407292e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:36.503231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fbbafd3e-ca9b-4713-b4c4-b8d4407292e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:36.511174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fbbafd3e-ca9b-4713-b4c4-b8d4407292e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085544 Aug 24 05:02:36.512287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 314/574] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:36 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:36.588339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-93073c9b-43f1-4627-b0b4-b932cd67f7eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:36.589181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-93073c9b-43f1-4627-b0b4-b932cd67f7eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:36.597186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93073c9b-43f1-4627-b0b4-b932cd67f7eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:36.597682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93073c9b-43f1-4627-b0b4-b932cd67f7eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:36.598090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93073c9b-43f1-4627-b0b4-b932cd67f7eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:36.598815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93073c9b-43f1-4627-b0b4-b932cd67f7eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:36.599263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93073c9b-43f1-4627-b0b4-b932cd67f7eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:36.599679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93073c9b-43f1-4627-b0b4-b932cd67f7eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:36.736574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-93073c9b-43f1-4627-b0b4-b932cd67f7eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:36.744623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-93073c9b-43f1-4627-b0b4-b932cd67f7eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1679 microversion: 2.1 time: 0.161143 Aug 24 05:02:36.745339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 261/575] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:36 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:37.533611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-07cf2a3f-4f66-4f32-9693-d22ef36f3082 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:37.534307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-07cf2a3f-4f66-4f32-9693-d22ef36f3082 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:37.540797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07cf2a3f-4f66-4f32-9693-d22ef36f3082 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:37.541288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07cf2a3f-4f66-4f32-9693-d22ef36f3082 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:37.543362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07cf2a3f-4f66-4f32-9693-d22ef36f3082 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:37.543881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07cf2a3f-4f66-4f32-9693-d22ef36f3082 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:37.544346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07cf2a3f-4f66-4f32-9693-d22ef36f3082 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:37.544768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07cf2a3f-4f66-4f32-9693-d22ef36f3082 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:37.637722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-07cf2a3f-4f66-4f32-9693-d22ef36f3082 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:37.645413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-07cf2a3f-4f66-4f32-9693-d22ef36f3082 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.115591 Aug 24 05:02:37.645986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 315/576] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:37 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:37.768073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-deeb34a0-6558-4902-ba3e-faea35a42c16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:37.768799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-deeb34a0-6558-4902-ba3e-faea35a42c16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:37.774965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deeb34a0-6558-4902-ba3e-faea35a42c16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:37.775544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deeb34a0-6558-4902-ba3e-faea35a42c16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:37.775983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deeb34a0-6558-4902-ba3e-faea35a42c16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:37.776666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deeb34a0-6558-4902-ba3e-faea35a42c16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:37.777659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deeb34a0-6558-4902-ba3e-faea35a42c16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:37.778177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deeb34a0-6558-4902-ba3e-faea35a42c16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:37.906733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-deeb34a0-6558-4902-ba3e-faea35a42c16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:37.914440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-deeb34a0-6558-4902-ba3e-faea35a42c16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1679 microversion: 2.1 time: 0.150417 Aug 24 05:02:37.915039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 262/577] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:37 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:38.474987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-03bf8706-8064-4bd5-8aae-1d40d0b82609 req-8d13eb4e-d62e-4868-8035-6946c772ae69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd", "name": "network-vif-deleted", "tag": "cc519303-087a-484b-acbf-05093327140d"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:02:38.485778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-03bf8706-8064-4bd5-8aae-1d40d0b82609 req-8d13eb4e-d62e-4868-8035-6946c772ae69 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:38.486636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-03bf8706-8064-4bd5-8aae-1d40d0b82609 req-8d13eb4e-d62e-4868-8035-6946c772ae69 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:38.487341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-03bf8706-8064-4bd5-8aae-1d40d0b82609 req-8d13eb4e-d62e-4868-8035-6946c772ae69 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:38.501269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-03bf8706-8064-4bd5-8aae-1d40d0b82609 req-8d13eb4e-d62e-4868-8035-6946c772ae69 service nova] Creating event network-vif-deleted:cc519303-087a-484b-acbf-05093327140d for instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd on hv-cinder-85426 Aug 24 05:02:38.508587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-03bf8706-8064-4bd5-8aae-1d40d0b82609 req-8d13eb4e-d62e-4868-8035-6946c772ae69 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180887 Aug 24 05:02:38.510283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 316/578] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:02:38.673911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f5d476ae-85c3-4c03-a33b-9b772916e1c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:38.674774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f5d476ae-85c3-4c03-a33b-9b772916e1c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:38.681059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5d476ae-85c3-4c03-a33b-9b772916e1c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:38.681468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5d476ae-85c3-4c03-a33b-9b772916e1c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:38.681989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5d476ae-85c3-4c03-a33b-9b772916e1c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:38.683130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5d476ae-85c3-4c03-a33b-9b772916e1c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:38.692488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5d476ae-85c3-4c03-a33b-9b772916e1c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:38.693159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5d476ae-85c3-4c03-a33b-9b772916e1c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:38.759663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f5d476ae-85c3-4c03-a33b-9b772916e1c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:38.776531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f5d476ae-85c3-4c03-a33b-9b772916e1c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.106863 Aug 24 05:02:38.778661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 263/579] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:38 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:38.938509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:38.939250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:38.945771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:38.946239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:38.946669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:38.947379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:38.947815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:38.948226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:38.980047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:38.980517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:38.981023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:38.981461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'fault' on Instance uuid 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:02:39.023145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:39.031019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b83459ee-5804-4ee8-b0ef-cfec0885ba43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 200 len: 1330 microversion: 2.1 time: 0.099005 Aug 24 05:02:39.031595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 317/580] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:38 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:39.799835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9abb984d-1ae8-41c9-945a-f4d975860d99 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:39.800443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9abb984d-1ae8-41c9-945a-f4d975860d99 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:39.806906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9abb984d-1ae8-41c9-945a-f4d975860d99 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:39.807386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9abb984d-1ae8-41c9-945a-f4d975860d99 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:39.807819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9abb984d-1ae8-41c9-945a-f4d975860d99 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:39.808501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9abb984d-1ae8-41c9-945a-f4d975860d99 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:39.809057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9abb984d-1ae8-41c9-945a-f4d975860d99 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:39.809485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9abb984d-1ae8-41c9-945a-f4d975860d99 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:39.873794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9abb984d-1ae8-41c9-945a-f4d975860d99 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:39.881635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9abb984d-1ae8-41c9-945a-f4d975860d99 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085734 Aug 24 05:02:39.882200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 264/581] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:39 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:40.051859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:40.052472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:40.059020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:40.059497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:40.059933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:40.060615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:40.061068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:40.061488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:40.074996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd HTTP/1.1 Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:02:40.076644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:02:40.078158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd'} Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:02:40.079153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:02:40.080693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:02:40.082123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:02:40.082123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fa882cb7-a2b4-4bf9-8717-a9ef3f5022b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 404 len: 111 microversion: 2.1 time: 0.030063 Aug 24 05:02:40.082123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 318/582] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:40 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:02:40.087586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bae1b2be-59d9-4fef-9a6d-adbf5cb2b709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '.version_select at 0x7f35902b1ee0>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:40.092618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bae1b2be-59d9-4fef-9a6d-adbf5cb2b709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [5a7bb3db-a695-4f6f-bd42-1e268b54f49e] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:02:40.901193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-72ae5b68-aa98-479d-b967-c8798eb9222a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:40.901794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-72ae5b68-aa98-479d-b967-c8798eb9222a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:40.908000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ae5b68-aa98-479d-b967-c8798eb9222a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:40.908477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ae5b68-aa98-479d-b967-c8798eb9222a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:40.908910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ae5b68-aa98-479d-b967-c8798eb9222a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:40.909590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ae5b68-aa98-479d-b967-c8798eb9222a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:40.910038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ae5b68-aa98-479d-b967-c8798eb9222a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:40.910455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ae5b68-aa98-479d-b967-c8798eb9222a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:40.972351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-72ae5b68-aa98-479d-b967-c8798eb9222a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:40.986906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-72ae5b68-aa98-479d-b967-c8798eb9222a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.089100 Aug 24 05:02:40.987532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 319/583] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:40 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:41.099589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [None req-bae1b2be-59d9-4fef-9a6d-adbf5cb2b709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [5a7bb3db-a695-4f6f-bd42-1e268b54f49e] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 42920. Aug 24 05:02:41.118513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bae1b2be-59d9-4fef-9a6d-adbf5cb2b709 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-217694854" status: 202 len: 0 microversion: 2.1 time: 1.034748 Aug 24 05:02:41.119128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 265/584] 10.222.0.97 () {58 vars in 1218 bytes} [Wed Aug 24 05:02:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-217694854 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:02:42.008387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-30e3633a-9845-4258-a3a9-3bc7bb41f593 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:42.008997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-30e3633a-9845-4258-a3a9-3bc7bb41f593 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:42.016460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-30e3633a-9845-4258-a3a9-3bc7bb41f593 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:42.016938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-30e3633a-9845-4258-a3a9-3bc7bb41f593 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:42.017371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-30e3633a-9845-4258-a3a9-3bc7bb41f593 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:42.018057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-30e3633a-9845-4258-a3a9-3bc7bb41f593 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:42.018509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-30e3633a-9845-4258-a3a9-3bc7bb41f593 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:42.018961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-30e3633a-9845-4258-a3a9-3bc7bb41f593 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:42.080795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-30e3633a-9845-4258-a3a9-3bc7bb41f593 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:42.088585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-30e3633a-9845-4258-a3a9-3bc7bb41f593 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084047 Aug 24 05:02:42.089144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 320/585] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:42 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:43.110367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8f1c63bf-7d5c-4064-bad7-7fb1dbead41a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:43.111001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8f1c63bf-7d5c-4064-bad7-7fb1dbead41a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:43.117570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c63bf-7d5c-4064-bad7-7fb1dbead41a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:43.118049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c63bf-7d5c-4064-bad7-7fb1dbead41a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:43.118481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c63bf-7d5c-4064-bad7-7fb1dbead41a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:43.119198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c63bf-7d5c-4064-bad7-7fb1dbead41a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:43.119652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c63bf-7d5c-4064-bad7-7fb1dbead41a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:43.120073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c63bf-7d5c-4064-bad7-7fb1dbead41a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:43.181575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8f1c63bf-7d5c-4064-bad7-7fb1dbead41a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:43.190208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8f1c63bf-7d5c-4064-bad7-7fb1dbead41a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084982 Aug 24 05:02:43.190790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 266/586] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:43 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:02:44.210602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a8fde06f-a765-4b24-b755-17384b1a65e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:44.211238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a8fde06f-a765-4b24-b755-17384b1a65e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:44.218282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8fde06f-a765-4b24-b755-17384b1a65e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:44.218790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8fde06f-a765-4b24-b755-17384b1a65e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:44.219221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8fde06f-a765-4b24-b755-17384b1a65e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:44.219917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8fde06f-a765-4b24-b755-17384b1a65e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:44.220364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8fde06f-a765-4b24-b755-17384b1a65e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:44.220897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8fde06f-a765-4b24-b755-17384b1a65e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:44.283403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a8fde06f-a765-4b24-b755-17384b1a65e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:44.291073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a8fde06f-a765-4b24-b755-17384b1a65e9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084482 Aug 24 05:02:44.291634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 321/587] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:44 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:45.311826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-08278f7b-601c-4d14-b1b5-306a4c440871 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:45.312430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-08278f7b-601c-4d14-b1b5-306a4c440871 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:45.318850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08278f7b-601c-4d14-b1b5-306a4c440871 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:45.319328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08278f7b-601c-4d14-b1b5-306a4c440871 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:45.319763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08278f7b-601c-4d14-b1b5-306a4c440871 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:45.320435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08278f7b-601c-4d14-b1b5-306a4c440871 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:45.320886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08278f7b-601c-4d14-b1b5-306a4c440871 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:45.321304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08278f7b-601c-4d14-b1b5-306a4c440871 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:45.381719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-08278f7b-601c-4d14-b1b5-306a4c440871 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:45.390001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-08278f7b-601c-4d14-b1b5-306a4c440871 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082149 Aug 24 05:02:45.390560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 267/588] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:45 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:46.411106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0cd32414-751d-4d17-bde6-5b351d87e5d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:46.411715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0cd32414-751d-4d17-bde6-5b351d87e5d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:46.418749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cd32414-751d-4d17-bde6-5b351d87e5d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:46.419235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cd32414-751d-4d17-bde6-5b351d87e5d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:46.419678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cd32414-751d-4d17-bde6-5b351d87e5d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:46.420618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cd32414-751d-4d17-bde6-5b351d87e5d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:46.421064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cd32414-751d-4d17-bde6-5b351d87e5d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:46.421481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cd32414-751d-4d17-bde6-5b351d87e5d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:46.483492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0cd32414-751d-4d17-bde6-5b351d87e5d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:46.491326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0cd32414-751d-4d17-bde6-5b351d87e5d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084050 Aug 24 05:02:46.491885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 322/589] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:46 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:47.513699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5a9a3e2f-c27f-49fc-9a73-180944af9db3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:47.514348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5a9a3e2f-c27f-49fc-9a73-180944af9db3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:47.520747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a9a3e2f-c27f-49fc-9a73-180944af9db3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:47.521229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a9a3e2f-c27f-49fc-9a73-180944af9db3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:47.521667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a9a3e2f-c27f-49fc-9a73-180944af9db3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:47.522350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a9a3e2f-c27f-49fc-9a73-180944af9db3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:47.522837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a9a3e2f-c27f-49fc-9a73-180944af9db3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:47.523259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a9a3e2f-c27f-49fc-9a73-180944af9db3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:47.586412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5a9a3e2f-c27f-49fc-9a73-180944af9db3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:47.594361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5a9a3e2f-c27f-49fc-9a73-180944af9db3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085355 Aug 24 05:02:47.594967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 268/590] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:47 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:48.615457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e3bb9e1c-e140-428d-95f9-ccb80d1d0817 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:48.616063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e3bb9e1c-e140-428d-95f9-ccb80d1d0817 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:48.623317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3bb9e1c-e140-428d-95f9-ccb80d1d0817 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:48.623803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3bb9e1c-e140-428d-95f9-ccb80d1d0817 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:48.624237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3bb9e1c-e140-428d-95f9-ccb80d1d0817 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:48.624931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3bb9e1c-e140-428d-95f9-ccb80d1d0817 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:48.625386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3bb9e1c-e140-428d-95f9-ccb80d1d0817 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:48.625806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3bb9e1c-e140-428d-95f9-ccb80d1d0817 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:48.651471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:02:48.654197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:02:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 (ip 10.222.0.97) !!! Aug 24 05:02:48.691246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e3bb9e1c-e140-428d-95f9-ccb80d1d0817 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:48.700038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e3bb9e1c-e140-428d-95f9-ccb80d1d0817 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.088403 Aug 24 05:02:48.700603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 323/591] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:48 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:49.721299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fd0f9988-33d6-43ec-9fff-363df1407d9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:49.721886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fd0f9988-33d6-43ec-9fff-363df1407d9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:49.728304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd0f9988-33d6-43ec-9fff-363df1407d9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:49.728811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd0f9988-33d6-43ec-9fff-363df1407d9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:49.729252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd0f9988-33d6-43ec-9fff-363df1407d9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:49.730811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd0f9988-33d6-43ec-9fff-363df1407d9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:49.731363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd0f9988-33d6-43ec-9fff-363df1407d9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:49.731791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd0f9988-33d6-43ec-9fff-363df1407d9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:50.038715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fd0f9988-33d6-43ec-9fff-363df1407d9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:50.047326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fd0f9988-33d6-43ec-9fff-363df1407d9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.329900 Aug 24 05:02:50.047887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 269/592] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:49 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:51.068342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b06cc223-106e-4995-b7f3-11ebd1f6431c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:51.068921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b06cc223-106e-4995-b7f3-11ebd1f6431c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:51.076157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b06cc223-106e-4995-b7f3-11ebd1f6431c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:51.076628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b06cc223-106e-4995-b7f3-11ebd1f6431c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:51.077054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b06cc223-106e-4995-b7f3-11ebd1f6431c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:51.077728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b06cc223-106e-4995-b7f3-11ebd1f6431c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:51.078168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b06cc223-106e-4995-b7f3-11ebd1f6431c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:51.078581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b06cc223-106e-4995-b7f3-11ebd1f6431c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:51.138860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b06cc223-106e-4995-b7f3-11ebd1f6431c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:51.146430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b06cc223-106e-4995-b7f3-11ebd1f6431c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082002 Aug 24 05:02:51.147017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 324/593] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:51 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:52.166993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f33b84bc-071f-431d-a72d-1f89e1dd74a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:52.167644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f33b84bc-071f-431d-a72d-1f89e1dd74a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:52.174056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f33b84bc-071f-431d-a72d-1f89e1dd74a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:52.174524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f33b84bc-071f-431d-a72d-1f89e1dd74a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:52.174974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f33b84bc-071f-431d-a72d-1f89e1dd74a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:52.175646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f33b84bc-071f-431d-a72d-1f89e1dd74a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:52.176088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f33b84bc-071f-431d-a72d-1f89e1dd74a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:52.176501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f33b84bc-071f-431d-a72d-1f89e1dd74a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:52.236937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f33b84bc-071f-431d-a72d-1f89e1dd74a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:52.244497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f33b84bc-071f-431d-a72d-1f89e1dd74a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081467 Aug 24 05:02:52.245058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 270/594] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:52 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:53.265266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c93c4eed-ca0e-4521-85b4-fe25f984213d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:53.265868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c93c4eed-ca0e-4521-85b4-fe25f984213d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:53.272221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93c4eed-ca0e-4521-85b4-fe25f984213d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:53.272694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93c4eed-ca0e-4521-85b4-fe25f984213d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:53.273124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93c4eed-ca0e-4521-85b4-fe25f984213d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:53.273806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93c4eed-ca0e-4521-85b4-fe25f984213d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:53.274251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93c4eed-ca0e-4521-85b4-fe25f984213d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:53.274666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93c4eed-ca0e-4521-85b4-fe25f984213d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:53.292663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:53.338101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c93c4eed-ca0e-4521-85b4-fe25f984213d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:53.346607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c93c4eed-ca0e-4521-85b4-fe25f984213d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085260 Aug 24 05:02:53.347189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 325/595] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:53 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:54.367320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6980843e-bf67-47c3-80c9-28369ed402f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:54.368070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6980843e-bf67-47c3-80c9-28369ed402f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:54.375260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6980843e-bf67-47c3-80c9-28369ed402f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:54.375743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6980843e-bf67-47c3-80c9-28369ed402f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:54.376180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6980843e-bf67-47c3-80c9-28369ed402f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:54.376868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6980843e-bf67-47c3-80c9-28369ed402f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:54.377321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6980843e-bf67-47c3-80c9-28369ed402f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:54.377743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6980843e-bf67-47c3-80c9-28369ed402f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:54.438099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6980843e-bf67-47c3-80c9-28369ed402f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:54.445832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6980843e-bf67-47c3-80c9-28369ed402f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082432 Aug 24 05:02:54.446392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 271/596] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:54 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:55.466828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d5a2aae4-bcb2-4a5c-be75-39bab695f50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:55.467476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d5a2aae4-bcb2-4a5c-be75-39bab695f50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:55.473904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a2aae4-bcb2-4a5c-be75-39bab695f50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:55.474383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a2aae4-bcb2-4a5c-be75-39bab695f50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:55.474844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a2aae4-bcb2-4a5c-be75-39bab695f50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:55.475526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a2aae4-bcb2-4a5c-be75-39bab695f50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:55.475978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a2aae4-bcb2-4a5c-be75-39bab695f50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:55.476398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a2aae4-bcb2-4a5c-be75-39bab695f50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:55.541459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d5a2aae4-bcb2-4a5c-be75-39bab695f50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:55.549540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d5a2aae4-bcb2-4a5c-be75-39bab695f50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087248 Aug 24 05:02:55.550099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 326/597] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:55 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:56.570546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-67a40d50-92f3-4e2c-9c39-36a27c1f3380 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:56.571116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-67a40d50-92f3-4e2c-9c39-36a27c1f3380 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:56.578257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67a40d50-92f3-4e2c-9c39-36a27c1f3380 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:56.578826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67a40d50-92f3-4e2c-9c39-36a27c1f3380 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:56.579265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67a40d50-92f3-4e2c-9c39-36a27c1f3380 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:56.579944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67a40d50-92f3-4e2c-9c39-36a27c1f3380 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:56.580390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67a40d50-92f3-4e2c-9c39-36a27c1f3380 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:56.580806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67a40d50-92f3-4e2c-9c39-36a27c1f3380 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:56.584774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:56.645445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-67a40d50-92f3-4e2c-9c39-36a27c1f3380 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:56.653790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-67a40d50-92f3-4e2c-9c39-36a27c1f3380 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086522 Aug 24 05:02:56.654344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 272/598] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:56 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:57.674271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5634aae3-a8d6-4377-824f-7effed5e4547 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:57.674976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5634aae3-a8d6-4377-824f-7effed5e4547 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:57.677288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:57.683399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5634aae3-a8d6-4377-824f-7effed5e4547 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:57.683964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5634aae3-a8d6-4377-824f-7effed5e4547 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:57.684981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5634aae3-a8d6-4377-824f-7effed5e4547 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:57.685697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5634aae3-a8d6-4377-824f-7effed5e4547 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:57.686147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5634aae3-a8d6-4377-824f-7effed5e4547 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:57.686566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5634aae3-a8d6-4377-824f-7effed5e4547 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:57.747683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5634aae3-a8d6-4377-824f-7effed5e4547 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:57.755532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5634aae3-a8d6-4377-824f-7effed5e4547 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085372 Aug 24 05:02:57.756091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 327/599] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:57 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:58.776771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3df3f3a1-4b55-4851-84f0-4f97b268b12b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:58.777379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3df3f3a1-4b55-4851-84f0-4f97b268b12b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:58.783829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df3f3a1-4b55-4851-84f0-4f97b268b12b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:58.784313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df3f3a1-4b55-4851-84f0-4f97b268b12b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:58.784750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df3f3a1-4b55-4851-84f0-4f97b268b12b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:58.785429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df3f3a1-4b55-4851-84f0-4f97b268b12b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:58.785883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df3f3a1-4b55-4851-84f0-4f97b268b12b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:58.786309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df3f3a1-4b55-4851-84f0-4f97b268b12b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:58.849498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3df3f3a1-4b55-4851-84f0-4f97b268b12b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:58.859298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3df3f3a1-4b55-4851-84f0-4f97b268b12b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086091 Aug 24 05:02:58.859882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 273/600] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:58 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:02:59.880598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a49456c1-a473-473a-827a-e965d9a33d3c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:02:59.881198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a49456c1-a473-473a-827a-e965d9a33d3c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:02:59.888070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a49456c1-a473-473a-827a-e965d9a33d3c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:59.888680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a49456c1-a473-473a-827a-e965d9a33d3c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:59.889107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a49456c1-a473-473a-827a-e965d9a33d3c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:59.889778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a49456c1-a473-473a-827a-e965d9a33d3c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:02:59.890217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a49456c1-a473-473a-827a-e965d9a33d3c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:02:59.890632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a49456c1-a473-473a-827a-e965d9a33d3c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:02:59.952710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a49456c1-a473-473a-827a-e965d9a33d3c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:02:59.960372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a49456c1-a473-473a-827a-e965d9a33d3c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083637 Aug 24 05:02:59.960928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 328/601] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:02:59 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:00.982452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8208292e-5b88-4a8c-b8d9-6935583ae50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:00.983106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8208292e-5b88-4a8c-b8d9-6935583ae50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:00.989503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8208292e-5b88-4a8c-b8d9-6935583ae50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:00.989981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8208292e-5b88-4a8c-b8d9-6935583ae50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:00.990406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8208292e-5b88-4a8c-b8d9-6935583ae50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:00.991109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8208292e-5b88-4a8c-b8d9-6935583ae50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:00.991558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8208292e-5b88-4a8c-b8d9-6935583ae50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:00.991972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8208292e-5b88-4a8c-b8d9-6935583ae50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:01.052927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8208292e-5b88-4a8c-b8d9-6935583ae50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:01.060650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8208292e-5b88-4a8c-b8d9-6935583ae50e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082691 Aug 24 05:03:01.061201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 274/602] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:00 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:02.081119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a04dec90-42a0-4fff-b680-7747faffd1a4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:02.081659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a04dec90-42a0-4fff-b680-7747faffd1a4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:02.088047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04dec90-42a0-4fff-b680-7747faffd1a4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:02.088519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04dec90-42a0-4fff-b680-7747faffd1a4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:02.088973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04dec90-42a0-4fff-b680-7747faffd1a4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:02.089640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04dec90-42a0-4fff-b680-7747faffd1a4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:02.090109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04dec90-42a0-4fff-b680-7747faffd1a4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:02.090673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04dec90-42a0-4fff-b680-7747faffd1a4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:02.151395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a04dec90-42a0-4fff-b680-7747faffd1a4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:02.159115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a04dec90-42a0-4fff-b680-7747faffd1a4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081897 Aug 24 05:03:02.159661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 329/603] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:02 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:03.180139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c6dada3a-56f4-4fcb-b8a1-ca1c1de647c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:03.180767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c6dada3a-56f4-4fcb-b8a1-ca1c1de647c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:03.187355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6dada3a-56f4-4fcb-b8a1-ca1c1de647c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:03.187842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6dada3a-56f4-4fcb-b8a1-ca1c1de647c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:03.188278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6dada3a-56f4-4fcb-b8a1-ca1c1de647c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:03.188960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6dada3a-56f4-4fcb-b8a1-ca1c1de647c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:03.189414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6dada3a-56f4-4fcb-b8a1-ca1c1de647c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:03.189835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6dada3a-56f4-4fcb-b8a1-ca1c1de647c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:03.249900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c6dada3a-56f4-4fcb-b8a1-ca1c1de647c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:03.257956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c6dada3a-56f4-4fcb-b8a1-ca1c1de647c3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081670 Aug 24 05:03:03.258515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 275/604] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:03 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:04.278585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-167fc47e-8d6d-4dfc-8bed-08f250f2495c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:04.279215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-167fc47e-8d6d-4dfc-8bed-08f250f2495c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:04.285522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-167fc47e-8d6d-4dfc-8bed-08f250f2495c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:04.285995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-167fc47e-8d6d-4dfc-8bed-08f250f2495c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:04.286424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-167fc47e-8d6d-4dfc-8bed-08f250f2495c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:04.287123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-167fc47e-8d6d-4dfc-8bed-08f250f2495c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:04.287567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-167fc47e-8d6d-4dfc-8bed-08f250f2495c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:04.287977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-167fc47e-8d6d-4dfc-8bed-08f250f2495c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:04.576118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-167fc47e-8d6d-4dfc-8bed-08f250f2495c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:04.584092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-167fc47e-8d6d-4dfc-8bed-08f250f2495c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.309518 Aug 24 05:03:04.584687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 330/605] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:04 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:05.605684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5ee5a39b-689b-4f22-9cc5-8de6ee6c0cd0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:05.606291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5ee5a39b-689b-4f22-9cc5-8de6ee6c0cd0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:05.608791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:05.614465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ee5a39b-689b-4f22-9cc5-8de6ee6c0cd0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:05.615010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ee5a39b-689b-4f22-9cc5-8de6ee6c0cd0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:05.615398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ee5a39b-689b-4f22-9cc5-8de6ee6c0cd0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:05.616086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ee5a39b-689b-4f22-9cc5-8de6ee6c0cd0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:05.616540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ee5a39b-689b-4f22-9cc5-8de6ee6c0cd0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:05.616955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ee5a39b-689b-4f22-9cc5-8de6ee6c0cd0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:05.686575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5ee5a39b-689b-4f22-9cc5-8de6ee6c0cd0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:05.695058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5ee5a39b-689b-4f22-9cc5-8de6ee6c0cd0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.094109 Aug 24 05:03:05.695662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 276/606] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:05 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:06.717737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e0611a08-f0c6-4cfc-8527-663d496e6383 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:06.718355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e0611a08-f0c6-4cfc-8527-663d496e6383 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:06.724987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0611a08-f0c6-4cfc-8527-663d496e6383 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:06.725461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0611a08-f0c6-4cfc-8527-663d496e6383 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:06.725892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0611a08-f0c6-4cfc-8527-663d496e6383 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:06.726577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0611a08-f0c6-4cfc-8527-663d496e6383 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:06.727052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0611a08-f0c6-4cfc-8527-663d496e6383 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:06.727471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0611a08-f0c6-4cfc-8527-663d496e6383 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:06.788464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e0611a08-f0c6-4cfc-8527-663d496e6383 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:06.797226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e0611a08-f0c6-4cfc-8527-663d496e6383 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084184 Aug 24 05:03:06.797781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 331/607] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:06 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:07.817357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-448a494c-d656-421a-bf63-5017a10d46f3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:07.817987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-448a494c-d656-421a-bf63-5017a10d46f3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:07.824086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-448a494c-d656-421a-bf63-5017a10d46f3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:07.825213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-448a494c-d656-421a-bf63-5017a10d46f3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:07.825673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-448a494c-d656-421a-bf63-5017a10d46f3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:07.826338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-448a494c-d656-421a-bf63-5017a10d46f3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:07.826810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-448a494c-d656-421a-bf63-5017a10d46f3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:07.827226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-448a494c-d656-421a-bf63-5017a10d46f3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:07.892671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-448a494c-d656-421a-bf63-5017a10d46f3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:07.900485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-448a494c-d656-421a-bf63-5017a10d46f3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087027 Aug 24 05:03:07.901040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 277/608] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:07 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:08.921484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8a6fcfd6-3669-4faf-84e2-59306e48be69 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:08.922219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8a6fcfd6-3669-4faf-84e2-59306e48be69 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:08.928503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a6fcfd6-3669-4faf-84e2-59306e48be69 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:08.928994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a6fcfd6-3669-4faf-84e2-59306e48be69 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:08.929401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a6fcfd6-3669-4faf-84e2-59306e48be69 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:08.930072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a6fcfd6-3669-4faf-84e2-59306e48be69 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:08.930512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a6fcfd6-3669-4faf-84e2-59306e48be69 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:08.930946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a6fcfd6-3669-4faf-84e2-59306e48be69 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:09.005433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8a6fcfd6-3669-4faf-84e2-59306e48be69 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:09.013924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8a6fcfd6-3669-4faf-84e2-59306e48be69 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.096838 Aug 24 05:03:09.014496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 332/609] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:08 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:10.035006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6e6cb51c-da87-4003-92df-c002168d1550 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:10.035532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6e6cb51c-da87-4003-92df-c002168d1550 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:10.041929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e6cb51c-da87-4003-92df-c002168d1550 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:10.042403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e6cb51c-da87-4003-92df-c002168d1550 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:10.042867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e6cb51c-da87-4003-92df-c002168d1550 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:10.043577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e6cb51c-da87-4003-92df-c002168d1550 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:10.045179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e6cb51c-da87-4003-92df-c002168d1550 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:10.045636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e6cb51c-da87-4003-92df-c002168d1550 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:10.106965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6e6cb51c-da87-4003-92df-c002168d1550 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:10.114899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6e6cb51c-da87-4003-92df-c002168d1550 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083927 Aug 24 05:03:10.115457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 278/610] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:10 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:11.135727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-92a9d9ca-6df8-4ac4-8010-a5017c76fec6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:11.136325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-92a9d9ca-6df8-4ac4-8010-a5017c76fec6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:11.143415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92a9d9ca-6df8-4ac4-8010-a5017c76fec6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:11.143892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92a9d9ca-6df8-4ac4-8010-a5017c76fec6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:11.144323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92a9d9ca-6df8-4ac4-8010-a5017c76fec6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:11.145029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92a9d9ca-6df8-4ac4-8010-a5017c76fec6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:11.145477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92a9d9ca-6df8-4ac4-8010-a5017c76fec6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:11.145901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92a9d9ca-6df8-4ac4-8010-a5017c76fec6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:11.207653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-92a9d9ca-6df8-4ac4-8010-a5017c76fec6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:11.215288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-92a9d9ca-6df8-4ac4-8010-a5017c76fec6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083441 Aug 24 05:03:11.215910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 333/611] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:11 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:12.235650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cbb3a44b-1936-4115-a666-b6a12793e16b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:12.236255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cbb3a44b-1936-4115-a666-b6a12793e16b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:12.242627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbb3a44b-1936-4115-a666-b6a12793e16b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:12.243135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbb3a44b-1936-4115-a666-b6a12793e16b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:12.243566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbb3a44b-1936-4115-a666-b6a12793e16b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:12.244246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbb3a44b-1936-4115-a666-b6a12793e16b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:12.244692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbb3a44b-1936-4115-a666-b6a12793e16b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:12.245110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbb3a44b-1936-4115-a666-b6a12793e16b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:12.307741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cbb3a44b-1936-4115-a666-b6a12793e16b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:12.315556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cbb3a44b-1936-4115-a666-b6a12793e16b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084393 Aug 24 05:03:12.316120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 279/612] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:12 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:13.338939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c27c489a-6fbe-4524-8e86-a9300f5a3050 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:13.339617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c27c489a-6fbe-4524-8e86-a9300f5a3050 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:13.347835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c27c489a-6fbe-4524-8e86-a9300f5a3050 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:13.348351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c27c489a-6fbe-4524-8e86-a9300f5a3050 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:13.348784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c27c489a-6fbe-4524-8e86-a9300f5a3050 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:13.349486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c27c489a-6fbe-4524-8e86-a9300f5a3050 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:13.349940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c27c489a-6fbe-4524-8e86-a9300f5a3050 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:13.350360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c27c489a-6fbe-4524-8e86-a9300f5a3050 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:13.416386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c27c489a-6fbe-4524-8e86-a9300f5a3050 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:13.424847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c27c489a-6fbe-4524-8e86-a9300f5a3050 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.089750 Aug 24 05:03:13.425416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 334/613] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:13 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:14.446910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-968a10fa-2496-4784-910e-e35455b1dfb1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:14.447514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-968a10fa-2496-4784-910e-e35455b1dfb1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:14.454129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-968a10fa-2496-4784-910e-e35455b1dfb1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:14.454602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-968a10fa-2496-4784-910e-e35455b1dfb1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:14.455064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-968a10fa-2496-4784-910e-e35455b1dfb1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:14.455741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-968a10fa-2496-4784-910e-e35455b1dfb1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:14.456190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-968a10fa-2496-4784-910e-e35455b1dfb1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:14.456607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-968a10fa-2496-4784-910e-e35455b1dfb1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:14.516457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-968a10fa-2496-4784-910e-e35455b1dfb1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:14.524077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-968a10fa-2496-4784-910e-e35455b1dfb1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081133 Aug 24 05:03:14.524670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 280/614] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:14 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:15.546490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0225c125-fbf2-4b63-9cd9-bc5e00fb7d98 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:15.547124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0225c125-fbf2-4b63-9cd9-bc5e00fb7d98 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:15.552993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225c125-fbf2-4b63-9cd9-bc5e00fb7d98 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:15.553464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225c125-fbf2-4b63-9cd9-bc5e00fb7d98 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:15.553921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225c125-fbf2-4b63-9cd9-bc5e00fb7d98 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:15.554585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225c125-fbf2-4b63-9cd9-bc5e00fb7d98 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:15.555053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225c125-fbf2-4b63-9cd9-bc5e00fb7d98 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:15.555464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0225c125-fbf2-4b63-9cd9-bc5e00fb7d98 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:15.615685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0225c125-fbf2-4b63-9cd9-bc5e00fb7d98 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:15.624158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0225c125-fbf2-4b63-9cd9-bc5e00fb7d98 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082749 Aug 24 05:03:15.624717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 335/615] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:15 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:16.644783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-23293b2c-fd38-426a-b3d2-cd3186becf54 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:16.645372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-23293b2c-fd38-426a-b3d2-cd3186becf54 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:16.652025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23293b2c-fd38-426a-b3d2-cd3186becf54 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:16.652445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23293b2c-fd38-426a-b3d2-cd3186becf54 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:16.652877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23293b2c-fd38-426a-b3d2-cd3186becf54 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:16.653579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23293b2c-fd38-426a-b3d2-cd3186becf54 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:16.654002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23293b2c-fd38-426a-b3d2-cd3186becf54 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:16.654421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23293b2c-fd38-426a-b3d2-cd3186becf54 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:16.717911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-23293b2c-fd38-426a-b3d2-cd3186becf54 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:16.725599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-23293b2c-fd38-426a-b3d2-cd3186becf54 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084671 Aug 24 05:03:16.726156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 281/616] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:16 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:17.745872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-db748424-e34c-45eb-ae3a-d883ba46adb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:17.746472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-db748424-e34c-45eb-ae3a-d883ba46adb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:17.753255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db748424-e34c-45eb-ae3a-d883ba46adb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:17.753725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db748424-e34c-45eb-ae3a-d883ba46adb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:17.754150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db748424-e34c-45eb-ae3a-d883ba46adb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:17.754863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db748424-e34c-45eb-ae3a-d883ba46adb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:17.755305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db748424-e34c-45eb-ae3a-d883ba46adb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:17.755716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db748424-e34c-45eb-ae3a-d883ba46adb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:17.821493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-db748424-e34c-45eb-ae3a-d883ba46adb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:17.829373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-db748424-e34c-45eb-ae3a-d883ba46adb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087327 Aug 24 05:03:17.829939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 336/617] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:17 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:18.849690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e5769018-5fc7-4006-9e8b-6e7c158979e1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:18.850299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e5769018-5fc7-4006-9e8b-6e7c158979e1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:18.856964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5769018-5fc7-4006-9e8b-6e7c158979e1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:18.857446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5769018-5fc7-4006-9e8b-6e7c158979e1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:18.857881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5769018-5fc7-4006-9e8b-6e7c158979e1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:18.858566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5769018-5fc7-4006-9e8b-6e7c158979e1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:18.859049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5769018-5fc7-4006-9e8b-6e7c158979e1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:18.859474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5769018-5fc7-4006-9e8b-6e7c158979e1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:18.923650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e5769018-5fc7-4006-9e8b-6e7c158979e1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:18.931351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e5769018-5fc7-4006-9e8b-6e7c158979e1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085510 Aug 24 05:03:18.931905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 282/618] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:18 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:19.952083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-225e27a5-262c-4886-abed-17ac6539bab9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:19.952708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-225e27a5-262c-4886-abed-17ac6539bab9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:19.959113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-225e27a5-262c-4886-abed-17ac6539bab9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.959585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-225e27a5-262c-4886-abed-17ac6539bab9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.960011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-225e27a5-262c-4886-abed-17ac6539bab9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:19.960683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-225e27a5-262c-4886-abed-17ac6539bab9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:19.961126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-225e27a5-262c-4886-abed-17ac6539bab9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:19.961537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-225e27a5-262c-4886-abed-17ac6539bab9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:20.021356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-225e27a5-262c-4886-abed-17ac6539bab9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:20.029589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-225e27a5-262c-4886-abed-17ac6539bab9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081828 Aug 24 05:03:20.030137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 337/619] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:19 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:21.050811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f959c9c9-561a-4fc7-8d18-4579ebe5b992 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:21.051415 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f959c9c9-561a-4fc7-8d18-4579ebe5b992 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:21.057915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f959c9c9-561a-4fc7-8d18-4579ebe5b992 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.058398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f959c9c9-561a-4fc7-8d18-4579ebe5b992 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.058870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f959c9c9-561a-4fc7-8d18-4579ebe5b992 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.059806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f959c9c9-561a-4fc7-8d18-4579ebe5b992 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:21.060257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f959c9c9-561a-4fc7-8d18-4579ebe5b992 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:21.060679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f959c9c9-561a-4fc7-8d18-4579ebe5b992 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:21.121159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f959c9c9-561a-4fc7-8d18-4579ebe5b992 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:21.129005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f959c9c9-561a-4fc7-8d18-4579ebe5b992 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082052 Aug 24 05:03:21.129560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 283/620] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:21 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:22.149771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-954ad640-f390-471b-ac51-ed8c6b0a62cf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:22.150341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-954ad640-f390-471b-ac51-ed8c6b0a62cf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:22.156923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-954ad640-f390-471b-ac51-ed8c6b0a62cf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:22.157423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-954ad640-f390-471b-ac51-ed8c6b0a62cf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:22.157836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-954ad640-f390-471b-ac51-ed8c6b0a62cf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:22.158511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-954ad640-f390-471b-ac51-ed8c6b0a62cf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:22.158989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-954ad640-f390-471b-ac51-ed8c6b0a62cf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:22.159411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-954ad640-f390-471b-ac51-ed8c6b0a62cf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:22.220243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-954ad640-f390-471b-ac51-ed8c6b0a62cf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:22.227910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-954ad640-f390-471b-ac51-ed8c6b0a62cf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082148 Aug 24 05:03:22.228473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 338/621] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:22 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:23.249008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7026c0d3-af44-4b03-98fd-235ab30d04d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:23.249604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7026c0d3-af44-4b03-98fd-235ab30d04d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:23.256640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7026c0d3-af44-4b03-98fd-235ab30d04d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:23.257116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7026c0d3-af44-4b03-98fd-235ab30d04d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:23.257549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7026c0d3-af44-4b03-98fd-235ab30d04d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:23.258226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7026c0d3-af44-4b03-98fd-235ab30d04d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:23.258678 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7026c0d3-af44-4b03-98fd-235ab30d04d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:23.259122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7026c0d3-af44-4b03-98fd-235ab30d04d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:23.319824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7026c0d3-af44-4b03-98fd-235ab30d04d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:23.327477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7026c0d3-af44-4b03-98fd-235ab30d04d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082342 Aug 24 05:03:23.328035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 284/622] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:23 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:24.348397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-57f88b86-80e9-417d-8bf5-87d0d148cf9f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:24.348997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-57f88b86-80e9-417d-8bf5-87d0d148cf9f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:24.355477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57f88b86-80e9-417d-8bf5-87d0d148cf9f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.355950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57f88b86-80e9-417d-8bf5-87d0d148cf9f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.356373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57f88b86-80e9-417d-8bf5-87d0d148cf9f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.357039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57f88b86-80e9-417d-8bf5-87d0d148cf9f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:24.357509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57f88b86-80e9-417d-8bf5-87d0d148cf9f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:24.357919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57f88b86-80e9-417d-8bf5-87d0d148cf9f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:24.361187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=81 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:24.419672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-57f88b86-80e9-417d-8bf5-87d0d148cf9f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:24.428104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-57f88b86-80e9-417d-8bf5-87d0d148cf9f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083617 Aug 24 05:03:24.428658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 339/623] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:24 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:25.449044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-78053a1d-4e40-40dd-8fad-7636bd781532 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:25.449642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-78053a1d-4e40-40dd-8fad-7636bd781532 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:25.456187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78053a1d-4e40-40dd-8fad-7636bd781532 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:25.456661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78053a1d-4e40-40dd-8fad-7636bd781532 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:25.457091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78053a1d-4e40-40dd-8fad-7636bd781532 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:25.457765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78053a1d-4e40-40dd-8fad-7636bd781532 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:25.458209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78053a1d-4e40-40dd-8fad-7636bd781532 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:25.458621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78053a1d-4e40-40dd-8fad-7636bd781532 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:25.521745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-78053a1d-4e40-40dd-8fad-7636bd781532 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:25.529426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-78053a1d-4e40-40dd-8fad-7636bd781532 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084274 Aug 24 05:03:25.529987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 285/624] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:25 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:26.550668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d0dd5515-c21f-4c4c-add0-d42dae814e51 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:26.551305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d0dd5515-c21f-4c4c-add0-d42dae814e51 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:26.557605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0dd5515-c21f-4c4c-add0-d42dae814e51 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.558079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0dd5515-c21f-4c4c-add0-d42dae814e51 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.558507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0dd5515-c21f-4c4c-add0-d42dae814e51 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.559209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0dd5515-c21f-4c4c-add0-d42dae814e51 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:26.559653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0dd5515-c21f-4c4c-add0-d42dae814e51 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:26.560067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0dd5515-c21f-4c4c-add0-d42dae814e51 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:26.627559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d0dd5515-c21f-4c4c-add0-d42dae814e51 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:26.635222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d0dd5515-c21f-4c4c-add0-d42dae814e51 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.089219 Aug 24 05:03:26.635783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 340/625] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:26 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:27.654547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1401ea26-183f-4e62-88bf-3f20b7d390fd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:27.655184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1401ea26-183f-4e62-88bf-3f20b7d390fd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:27.661728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1401ea26-183f-4e62-88bf-3f20b7d390fd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:27.662201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1401ea26-183f-4e62-88bf-3f20b7d390fd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:27.662626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1401ea26-183f-4e62-88bf-3f20b7d390fd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:27.663318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1401ea26-183f-4e62-88bf-3f20b7d390fd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:27.663763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1401ea26-183f-4e62-88bf-3f20b7d390fd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:27.664173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1401ea26-183f-4e62-88bf-3f20b7d390fd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:27.667989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=84 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:27.726335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1401ea26-183f-4e62-88bf-3f20b7d390fd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:27.734223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1401ea26-183f-4e62-88bf-3f20b7d390fd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083421 Aug 24 05:03:27.734819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 286/626] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:27 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:28.754675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-46ab42a3-6dfb-4412-b5c3-cde62cc0aa2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:28.755320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-46ab42a3-6dfb-4412-b5c3-cde62cc0aa2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:28.757600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=28 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:28.762955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46ab42a3-6dfb-4412-b5c3-cde62cc0aa2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:28.763442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46ab42a3-6dfb-4412-b5c3-cde62cc0aa2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:28.763876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46ab42a3-6dfb-4412-b5c3-cde62cc0aa2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:28.764562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46ab42a3-6dfb-4412-b5c3-cde62cc0aa2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:28.765013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46ab42a3-6dfb-4412-b5c3-cde62cc0aa2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:28.765432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46ab42a3-6dfb-4412-b5c3-cde62cc0aa2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:28.831043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-46ab42a3-6dfb-4412-b5c3-cde62cc0aa2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:28.838812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-46ab42a3-6dfb-4412-b5c3-cde62cc0aa2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.088057 Aug 24 05:03:28.839370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 341/627] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:28 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:29.860842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-61609d1d-de4e-4b18-91b4-5f5ff913e5d4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:29.861579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-61609d1d-de4e-4b18-91b4-5f5ff913e5d4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:29.868663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61609d1d-de4e-4b18-91b4-5f5ff913e5d4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:29.869140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61609d1d-de4e-4b18-91b4-5f5ff913e5d4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:29.869572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61609d1d-de4e-4b18-91b4-5f5ff913e5d4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:29.870254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61609d1d-de4e-4b18-91b4-5f5ff913e5d4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:29.870723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61609d1d-de4e-4b18-91b4-5f5ff913e5d4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:29.871146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61609d1d-de4e-4b18-91b4-5f5ff913e5d4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:29.933198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-61609d1d-de4e-4b18-91b4-5f5ff913e5d4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:29.941155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-61609d1d-de4e-4b18-91b4-5f5ff913e5d4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085107 Aug 24 05:03:29.941719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 287/628] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:29 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:30.961296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6fac2c84-d0fe-438e-aca8-86d56568723b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:30.961888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6fac2c84-d0fe-438e-aca8-86d56568723b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:30.968905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fac2c84-d0fe-438e-aca8-86d56568723b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:30.969637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fac2c84-d0fe-438e-aca8-86d56568723b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:30.970077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fac2c84-d0fe-438e-aca8-86d56568723b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:30.970825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fac2c84-d0fe-438e-aca8-86d56568723b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:30.971283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fac2c84-d0fe-438e-aca8-86d56568723b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:30.971703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fac2c84-d0fe-438e-aca8-86d56568723b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:31.032444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6fac2c84-d0fe-438e-aca8-86d56568723b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:31.040124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6fac2c84-d0fe-438e-aca8-86d56568723b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082660 Aug 24 05:03:31.040679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 342/629] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:30 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:32.061777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d5c0343e-ddb8-4598-9085-bca6f8d68919 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:32.062577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d5c0343e-ddb8-4598-9085-bca6f8d68919 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:32.069112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5c0343e-ddb8-4598-9085-bca6f8d68919 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:32.069593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5c0343e-ddb8-4598-9085-bca6f8d68919 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:32.070024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5c0343e-ddb8-4598-9085-bca6f8d68919 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:32.070719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5c0343e-ddb8-4598-9085-bca6f8d68919 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:32.071175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5c0343e-ddb8-4598-9085-bca6f8d68919 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:32.071595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5c0343e-ddb8-4598-9085-bca6f8d68919 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:32.132489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d5c0343e-ddb8-4598-9085-bca6f8d68919 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:32.140117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d5c0343e-ddb8-4598-9085-bca6f8d68919 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082211 Aug 24 05:03:32.141275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 288/630] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:32 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:33.161723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-13de6e6d-e959-422f-b83f-29a9e0e59bcc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:33.162339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-13de6e6d-e959-422f-b83f-29a9e0e59bcc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:33.168752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13de6e6d-e959-422f-b83f-29a9e0e59bcc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:33.169250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13de6e6d-e959-422f-b83f-29a9e0e59bcc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:33.169741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13de6e6d-e959-422f-b83f-29a9e0e59bcc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:33.170693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13de6e6d-e959-422f-b83f-29a9e0e59bcc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:33.171159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13de6e6d-e959-422f-b83f-29a9e0e59bcc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:33.171662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13de6e6d-e959-422f-b83f-29a9e0e59bcc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:33.232176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-13de6e6d-e959-422f-b83f-29a9e0e59bcc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:33.240403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-13de6e6d-e959-422f-b83f-29a9e0e59bcc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082546 Aug 24 05:03:33.240962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 343/631] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:33 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:34.260733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-42addb0d-25bc-4f59-8a6e-4796eed59656 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:34.261333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-42addb0d-25bc-4f59-8a6e-4796eed59656 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:34.267759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42addb0d-25bc-4f59-8a6e-4796eed59656 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:34.268228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42addb0d-25bc-4f59-8a6e-4796eed59656 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:34.268652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42addb0d-25bc-4f59-8a6e-4796eed59656 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:34.269325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42addb0d-25bc-4f59-8a6e-4796eed59656 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:34.269768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42addb0d-25bc-4f59-8a6e-4796eed59656 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:34.270188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42addb0d-25bc-4f59-8a6e-4796eed59656 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:34.334045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-42addb0d-25bc-4f59-8a6e-4796eed59656 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:34.341749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-42addb0d-25bc-4f59-8a6e-4796eed59656 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084862 Aug 24 05:03:34.342315 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 289/632] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:34 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:35.362481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-504177c8-4c5d-4208-b141-29586f0de900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:35.363113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-504177c8-4c5d-4208-b141-29586f0de900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:35.369588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504177c8-4c5d-4208-b141-29586f0de900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:35.370059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504177c8-4c5d-4208-b141-29586f0de900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:35.370488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504177c8-4c5d-4208-b141-29586f0de900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:35.371194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504177c8-4c5d-4208-b141-29586f0de900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:35.371642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504177c8-4c5d-4208-b141-29586f0de900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:35.372060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504177c8-4c5d-4208-b141-29586f0de900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:35.436040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-504177c8-4c5d-4208-b141-29586f0de900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:35.444192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-504177c8-4c5d-4208-b141-29586f0de900 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085634 Aug 24 05:03:35.444747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 344/633] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:35 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:36.465373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d44e986b-4c97-4f9b-8f72-fb1dd1b2555e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:36.465981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d44e986b-4c97-4f9b-8f72-fb1dd1b2555e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:36.468307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=28 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:36.474296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d44e986b-4c97-4f9b-8f72-fb1dd1b2555e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:36.474809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d44e986b-4c97-4f9b-8f72-fb1dd1b2555e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:36.475238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d44e986b-4c97-4f9b-8f72-fb1dd1b2555e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:36.475917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d44e986b-4c97-4f9b-8f72-fb1dd1b2555e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:36.476372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d44e986b-4c97-4f9b-8f72-fb1dd1b2555e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:36.476790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d44e986b-4c97-4f9b-8f72-fb1dd1b2555e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:36.539482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d44e986b-4c97-4f9b-8f72-fb1dd1b2555e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:36.547566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d44e986b-4c97-4f9b-8f72-fb1dd1b2555e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086085 Aug 24 05:03:36.548128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 290/634] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:36 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:37.568067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5a4b3832-b454-4cf2-b3ab-3ad884f033d0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:37.568725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5a4b3832-b454-4cf2-b3ab-3ad884f033d0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:37.575249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a4b3832-b454-4cf2-b3ab-3ad884f033d0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:37.575726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a4b3832-b454-4cf2-b3ab-3ad884f033d0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:37.576154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a4b3832-b454-4cf2-b3ab-3ad884f033d0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:37.576839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a4b3832-b454-4cf2-b3ab-3ad884f033d0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:37.577288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a4b3832-b454-4cf2-b3ab-3ad884f033d0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:37.577707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a4b3832-b454-4cf2-b3ab-3ad884f033d0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:37.649673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5a4b3832-b454-4cf2-b3ab-3ad884f033d0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:37.658273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5a4b3832-b454-4cf2-b3ab-3ad884f033d0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.094163 Aug 24 05:03:37.658858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 345/635] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:37 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:38.679116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-152f723a-376f-4f88-8fdc-95163b1e5346 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:38.679708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-152f723a-376f-4f88-8fdc-95163b1e5346 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:38.685803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-152f723a-376f-4f88-8fdc-95163b1e5346 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:38.686279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-152f723a-376f-4f88-8fdc-95163b1e5346 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:38.686731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-152f723a-376f-4f88-8fdc-95163b1e5346 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:38.688043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-152f723a-376f-4f88-8fdc-95163b1e5346 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:38.688592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-152f723a-376f-4f88-8fdc-95163b1e5346 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:38.689017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-152f723a-376f-4f88-8fdc-95163b1e5346 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:38.750865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-152f723a-376f-4f88-8fdc-95163b1e5346 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:38.758576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-152f723a-376f-4f88-8fdc-95163b1e5346 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083611 Aug 24 05:03:38.759156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 291/636] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:38 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:39.779300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a88e9398-949d-4502-b648-bf31b2ae04b1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:39.780546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a88e9398-949d-4502-b648-bf31b2ae04b1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:39.787697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a88e9398-949d-4502-b648-bf31b2ae04b1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:39.788178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a88e9398-949d-4502-b648-bf31b2ae04b1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:39.788643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a88e9398-949d-4502-b648-bf31b2ae04b1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:39.789353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a88e9398-949d-4502-b648-bf31b2ae04b1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:39.790004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a88e9398-949d-4502-b648-bf31b2ae04b1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:39.790514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a88e9398-949d-4502-b648-bf31b2ae04b1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:39.852457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a88e9398-949d-4502-b648-bf31b2ae04b1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:39.861413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a88e9398-949d-4502-b648-bf31b2ae04b1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085976 Aug 24 05:03:39.861994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 346/637] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:39 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:40.882479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-932e3e02-f486-4ffe-a7eb-6305e02887b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:40.883107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-932e3e02-f486-4ffe-a7eb-6305e02887b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:40.889575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-932e3e02-f486-4ffe-a7eb-6305e02887b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:40.890053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-932e3e02-f486-4ffe-a7eb-6305e02887b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:40.891122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-932e3e02-f486-4ffe-a7eb-6305e02887b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:40.891817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-932e3e02-f486-4ffe-a7eb-6305e02887b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:40.892267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-932e3e02-f486-4ffe-a7eb-6305e02887b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:40.892716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-932e3e02-f486-4ffe-a7eb-6305e02887b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:40.954653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-932e3e02-f486-4ffe-a7eb-6305e02887b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:40.962360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-932e3e02-f486-4ffe-a7eb-6305e02887b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083781 Aug 24 05:03:40.962944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 292/638] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:40 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:41.982457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-935f9c04-eccc-4cdc-acf4-4a9b59135daf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:41.983012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-935f9c04-eccc-4cdc-acf4-4a9b59135daf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:41.993164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935f9c04-eccc-4cdc-acf4-4a9b59135daf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:41.993650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935f9c04-eccc-4cdc-acf4-4a9b59135daf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:41.995695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935f9c04-eccc-4cdc-acf4-4a9b59135daf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:41.997596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935f9c04-eccc-4cdc-acf4-4a9b59135daf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:41.998072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935f9c04-eccc-4cdc-acf4-4a9b59135daf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:41.998515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-935f9c04-eccc-4cdc-acf4-4a9b59135daf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:42.063281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-935f9c04-eccc-4cdc-acf4-4a9b59135daf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:42.070968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-935f9c04-eccc-4cdc-acf4-4a9b59135daf tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.092436 Aug 24 05:03:42.071538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 347/639] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:41 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:43.092389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e021b264-459c-442d-992f-a87e8a7c2b6f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:43.092987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e021b264-459c-442d-992f-a87e8a7c2b6f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:43.100359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e021b264-459c-442d-992f-a87e8a7c2b6f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:43.100839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e021b264-459c-442d-992f-a87e8a7c2b6f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:43.101270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e021b264-459c-442d-992f-a87e8a7c2b6f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:43.101960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e021b264-459c-442d-992f-a87e8a7c2b6f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:43.102416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e021b264-459c-442d-992f-a87e8a7c2b6f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:43.102880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e021b264-459c-442d-992f-a87e8a7c2b6f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:43.168305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e021b264-459c-442d-992f-a87e8a7c2b6f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:43.176492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e021b264-459c-442d-992f-a87e8a7c2b6f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087967 Aug 24 05:03:43.177092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 293/640] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:43 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:44.197602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f262ce66-8338-4a5e-815f-85932a8dddcb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:44.198213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f262ce66-8338-4a5e-815f-85932a8dddcb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:44.204667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f262ce66-8338-4a5e-815f-85932a8dddcb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:44.205153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f262ce66-8338-4a5e-815f-85932a8dddcb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:44.205589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f262ce66-8338-4a5e-815f-85932a8dddcb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:44.206287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f262ce66-8338-4a5e-815f-85932a8dddcb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:44.207044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f262ce66-8338-4a5e-815f-85932a8dddcb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:44.207468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f262ce66-8338-4a5e-815f-85932a8dddcb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:44.270848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f262ce66-8338-4a5e-815f-85932a8dddcb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:44.278484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f262ce66-8338-4a5e-815f-85932a8dddcb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084793 Aug 24 05:03:44.279074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 348/641] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:44 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:45.299903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4a696a2c-aad5-4ba8-a25d-94bd93b1f174 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:45.300511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4a696a2c-aad5-4ba8-a25d-94bd93b1f174 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:45.306965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a696a2c-aad5-4ba8-a25d-94bd93b1f174 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:45.307445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a696a2c-aad5-4ba8-a25d-94bd93b1f174 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:45.307879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a696a2c-aad5-4ba8-a25d-94bd93b1f174 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:45.308558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a696a2c-aad5-4ba8-a25d-94bd93b1f174 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:45.309011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a696a2c-aad5-4ba8-a25d-94bd93b1f174 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:45.309438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a696a2c-aad5-4ba8-a25d-94bd93b1f174 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:45.370155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4a696a2c-aad5-4ba8-a25d-94bd93b1f174 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:45.378341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4a696a2c-aad5-4ba8-a25d-94bd93b1f174 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083089 Aug 24 05:03:45.378942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 294/642] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:45 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:46.398995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f5a3ece1-1f05-476d-8efa-b0c8d5197cc0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:46.399608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f5a3ece1-1f05-476d-8efa-b0c8d5197cc0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:46.405836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5a3ece1-1f05-476d-8efa-b0c8d5197cc0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:46.406142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5a3ece1-1f05-476d-8efa-b0c8d5197cc0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:46.406578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5a3ece1-1f05-476d-8efa-b0c8d5197cc0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:46.407280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5a3ece1-1f05-476d-8efa-b0c8d5197cc0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:46.408045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5a3ece1-1f05-476d-8efa-b0c8d5197cc0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:46.408147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5a3ece1-1f05-476d-8efa-b0c8d5197cc0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:46.470171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f5a3ece1-1f05-476d-8efa-b0c8d5197cc0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:46.477932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f5a3ece1-1f05-476d-8efa-b0c8d5197cc0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082963 Aug 24 05:03:46.478491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 349/643] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:46 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:47.498307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6e5cedd2-eb58-4f6e-ab9c-e951847a4c1f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:47.498942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6e5cedd2-eb58-4f6e-ab9c-e951847a4c1f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:47.505930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e5cedd2-eb58-4f6e-ab9c-e951847a4c1f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:47.506409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e5cedd2-eb58-4f6e-ab9c-e951847a4c1f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:47.506891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e5cedd2-eb58-4f6e-ab9c-e951847a4c1f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:47.507576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e5cedd2-eb58-4f6e-ab9c-e951847a4c1f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:47.508028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e5cedd2-eb58-4f6e-ab9c-e951847a4c1f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:47.508451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6e5cedd2-eb58-4f6e-ab9c-e951847a4c1f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:47.570059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6e5cedd2-eb58-4f6e-ab9c-e951847a4c1f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:47.577949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6e5cedd2-eb58-4f6e-ab9c-e951847a4c1f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083357 Aug 24 05:03:47.578659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 295/644] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:47 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:48.599046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f3b97efc-65f4-4fd5-bf30-08935c3101a5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:48.599691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f3b97efc-65f4-4fd5-bf30-08935c3101a5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:48.606071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b97efc-65f4-4fd5-bf30-08935c3101a5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:48.606547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b97efc-65f4-4fd5-bf30-08935c3101a5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:48.607014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b97efc-65f4-4fd5-bf30-08935c3101a5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:48.607690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b97efc-65f4-4fd5-bf30-08935c3101a5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:48.608140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b97efc-65f4-4fd5-bf30-08935c3101a5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:48.608556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3b97efc-65f4-4fd5-bf30-08935c3101a5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:48.669442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f3b97efc-65f4-4fd5-bf30-08935c3101a5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:48.677418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f3b97efc-65f4-4fd5-bf30-08935c3101a5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082317 Aug 24 05:03:48.677980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 350/645] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:48 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:49.697344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5c97e385-5ba7-4776-8342-f77fe5764b9d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:49.698022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5c97e385-5ba7-4776-8342-f77fe5764b9d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:49.705016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c97e385-5ba7-4776-8342-f77fe5764b9d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:49.705491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c97e385-5ba7-4776-8342-f77fe5764b9d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:49.705921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c97e385-5ba7-4776-8342-f77fe5764b9d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:49.706598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c97e385-5ba7-4776-8342-f77fe5764b9d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:49.707077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c97e385-5ba7-4776-8342-f77fe5764b9d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:49.707503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c97e385-5ba7-4776-8342-f77fe5764b9d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:49.768972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5c97e385-5ba7-4776-8342-f77fe5764b9d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:49.776706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5c97e385-5ba7-4776-8342-f77fe5764b9d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083262 Aug 24 05:03:49.777265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 296/646] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:49 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:50.798533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-36dece4c-8683-4006-a4b5-4a28b0da22a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:50.799173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-36dece4c-8683-4006-a4b5-4a28b0da22a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:50.805616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36dece4c-8683-4006-a4b5-4a28b0da22a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:50.806091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36dece4c-8683-4006-a4b5-4a28b0da22a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:50.806517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36dece4c-8683-4006-a4b5-4a28b0da22a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:50.807233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36dece4c-8683-4006-a4b5-4a28b0da22a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:50.807684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36dece4c-8683-4006-a4b5-4a28b0da22a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:50.808099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36dece4c-8683-4006-a4b5-4a28b0da22a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:50.869425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-36dece4c-8683-4006-a4b5-4a28b0da22a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:50.877099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-36dece4c-8683-4006-a4b5-4a28b0da22a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083312 Aug 24 05:03:50.877660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 351/647] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:50 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:51.897958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3aee6422-0185-4171-9eb1-7a2453489374 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:51.898598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3aee6422-0185-4171-9eb1-7a2453489374 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:51.905071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3aee6422-0185-4171-9eb1-7a2453489374 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:51.905554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3aee6422-0185-4171-9eb1-7a2453489374 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:51.905991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3aee6422-0185-4171-9eb1-7a2453489374 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:51.906844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3aee6422-0185-4171-9eb1-7a2453489374 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:51.907300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3aee6422-0185-4171-9eb1-7a2453489374 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:51.907725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3aee6422-0185-4171-9eb1-7a2453489374 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:51.971786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3aee6422-0185-4171-9eb1-7a2453489374 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:51.979511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3aee6422-0185-4171-9eb1-7a2453489374 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085467 Aug 24 05:03:51.980080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 297/648] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:51 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:53.000818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1b144532-8517-4c41-80b7-2ef255691966 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:53.001581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1b144532-8517-4c41-80b7-2ef255691966 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:53.008226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b144532-8517-4c41-80b7-2ef255691966 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:53.008697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b144532-8517-4c41-80b7-2ef255691966 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:53.009124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b144532-8517-4c41-80b7-2ef255691966 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:53.010013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b144532-8517-4c41-80b7-2ef255691966 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:53.010458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b144532-8517-4c41-80b7-2ef255691966 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:53.010906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b144532-8517-4c41-80b7-2ef255691966 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:53.078305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1b144532-8517-4c41-80b7-2ef255691966 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:53.086723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1b144532-8517-4c41-80b7-2ef255691966 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.089844 Aug 24 05:03:53.087276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 352/649] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:52 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:54.107889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fb9b94ba-a011-4781-8fbd-f29a0c261694 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:54.108427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fb9b94ba-a011-4781-8fbd-f29a0c261694 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:54.115460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb9b94ba-a011-4781-8fbd-f29a0c261694 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:54.116210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb9b94ba-a011-4781-8fbd-f29a0c261694 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:54.116668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb9b94ba-a011-4781-8fbd-f29a0c261694 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:54.117344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb9b94ba-a011-4781-8fbd-f29a0c261694 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:54.117785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb9b94ba-a011-4781-8fbd-f29a0c261694 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:54.118196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb9b94ba-a011-4781-8fbd-f29a0c261694 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:54.179917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fb9b94ba-a011-4781-8fbd-f29a0c261694 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:54.187537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fb9b94ba-a011-4781-8fbd-f29a0c261694 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083627 Aug 24 05:03:54.188135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 298/650] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:54 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:55.208098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f097f81b-3e1c-4f8e-9c06-0f6a00027c31 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:55.208765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f097f81b-3e1c-4f8e-9c06-0f6a00027c31 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:55.215104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f097f81b-3e1c-4f8e-9c06-0f6a00027c31 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:55.215576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f097f81b-3e1c-4f8e-9c06-0f6a00027c31 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:55.215999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f097f81b-3e1c-4f8e-9c06-0f6a00027c31 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:55.216670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f097f81b-3e1c-4f8e-9c06-0f6a00027c31 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:55.217111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f097f81b-3e1c-4f8e-9c06-0f6a00027c31 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:55.217521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f097f81b-3e1c-4f8e-9c06-0f6a00027c31 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:55.220060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=84 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:55.338093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f097f81b-3e1c-4f8e-9c06-0f6a00027c31 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:55.346358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f097f81b-3e1c-4f8e-9c06-0f6a00027c31 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.142198 Aug 24 05:03:55.346936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 353/651] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:55 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:56.370841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ad1519d1-9f9c-44c3-9199-fd09f9eca718 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:56.371462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ad1519d1-9f9c-44c3-9199-fd09f9eca718 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:56.378488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad1519d1-9f9c-44c3-9199-fd09f9eca718 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:56.379027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad1519d1-9f9c-44c3-9199-fd09f9eca718 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:56.379463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad1519d1-9f9c-44c3-9199-fd09f9eca718 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:56.380150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad1519d1-9f9c-44c3-9199-fd09f9eca718 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:56.380605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad1519d1-9f9c-44c3-9199-fd09f9eca718 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:56.381022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad1519d1-9f9c-44c3-9199-fd09f9eca718 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:56.488262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ad1519d1-9f9c-44c3-9199-fd09f9eca718 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:56.495989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ad1519d1-9f9c-44c3-9199-fd09f9eca718 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.132627 Aug 24 05:03:56.496573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 299/652] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:56 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:57.516975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d57b811a-4538-484d-8a15-6b4155607e70 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:57.517590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d57b811a-4538-484d-8a15-6b4155607e70 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:57.524237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d57b811a-4538-484d-8a15-6b4155607e70 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:57.524718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d57b811a-4538-484d-8a15-6b4155607e70 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:57.525154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d57b811a-4538-484d-8a15-6b4155607e70 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:57.525840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d57b811a-4538-484d-8a15-6b4155607e70 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:57.526294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d57b811a-4538-484d-8a15-6b4155607e70 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:57.526739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d57b811a-4538-484d-8a15-6b4155607e70 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:57.590293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d57b811a-4538-484d-8a15-6b4155607e70 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:57.598528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d57b811a-4538-484d-8a15-6b4155607e70 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085562 Aug 24 05:03:57.599119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 354/653] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:57 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:58.619067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3c59a9d1-e4d6-45e7-b89b-b484beb0a527 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:58.619687 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3c59a9d1-e4d6-45e7-b89b-b484beb0a527 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:58.626238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c59a9d1-e4d6-45e7-b89b-b484beb0a527 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:58.626744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c59a9d1-e4d6-45e7-b89b-b484beb0a527 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:58.627175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c59a9d1-e4d6-45e7-b89b-b484beb0a527 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:58.627861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c59a9d1-e4d6-45e7-b89b-b484beb0a527 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:58.628309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c59a9d1-e4d6-45e7-b89b-b484beb0a527 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:58.628730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c59a9d1-e4d6-45e7-b89b-b484beb0a527 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:58.631260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=84 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:58.689866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c59a9d1-e4d6-45e7-b89b-b484beb0a527 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:58.697630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3c59a9d1-e4d6-45e7-b89b-b484beb0a527 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082619 Aug 24 05:03:58.698202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 300/654] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:58 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:03:59.719138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c2a29a6c-7132-402d-83b1-4563f60c0254 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:03:59.720420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c2a29a6c-7132-402d-83b1-4563f60c0254 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:03:59.722778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=28 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:59.728053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a29a6c-7132-402d-83b1-4563f60c0254 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:59.728533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a29a6c-7132-402d-83b1-4563f60c0254 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:59.728992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a29a6c-7132-402d-83b1-4563f60c0254 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:59.729665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a29a6c-7132-402d-83b1-4563f60c0254 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:03:59.730112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a29a6c-7132-402d-83b1-4563f60c0254 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:03:59.730531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a29a6c-7132-402d-83b1-4563f60c0254 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:03:59.791710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c2a29a6c-7132-402d-83b1-4563f60c0254 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:03:59.799598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c2a29a6c-7132-402d-83b1-4563f60c0254 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084346 Aug 24 05:03:59.800160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 355/655] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:03:59 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:00.820395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ec3ee097-e05b-4840-bbbe-980b8cc2961c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:00.821025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ec3ee097-e05b-4840-bbbe-980b8cc2961c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:00.827742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec3ee097-e05b-4840-bbbe-980b8cc2961c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:00.828227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec3ee097-e05b-4840-bbbe-980b8cc2961c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:00.828714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec3ee097-e05b-4840-bbbe-980b8cc2961c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:00.829517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec3ee097-e05b-4840-bbbe-980b8cc2961c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:00.829972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec3ee097-e05b-4840-bbbe-980b8cc2961c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:00.830396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec3ee097-e05b-4840-bbbe-980b8cc2961c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:00.894234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ec3ee097-e05b-4840-bbbe-980b8cc2961c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:00.902083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ec3ee097-e05b-4840-bbbe-980b8cc2961c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085628 Aug 24 05:04:00.902679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 301/656] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:00 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:01.928720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-68708490-8d4f-45a8-ac6b-2669dd735ac5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:01.929328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-68708490-8d4f-45a8-ac6b-2669dd735ac5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:01.935774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68708490-8d4f-45a8-ac6b-2669dd735ac5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:01.936253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68708490-8d4f-45a8-ac6b-2669dd735ac5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:01.936687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68708490-8d4f-45a8-ac6b-2669dd735ac5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:01.937366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68708490-8d4f-45a8-ac6b-2669dd735ac5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:01.937815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68708490-8d4f-45a8-ac6b-2669dd735ac5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:01.938267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68708490-8d4f-45a8-ac6b-2669dd735ac5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:02.003383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-68708490-8d4f-45a8-ac6b-2669dd735ac5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:02.011000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-68708490-8d4f-45a8-ac6b-2669dd735ac5 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086184 Aug 24 05:04:02.011550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 356/657] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:01 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:03.031900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3cb776c2-4d51-42d1-ad6a-2fd8d45888bb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:03.032419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3cb776c2-4d51-42d1-ad6a-2fd8d45888bb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:03.038850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3cb776c2-4d51-42d1-ad6a-2fd8d45888bb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:03.039331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3cb776c2-4d51-42d1-ad6a-2fd8d45888bb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:03.039761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3cb776c2-4d51-42d1-ad6a-2fd8d45888bb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:03.040443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3cb776c2-4d51-42d1-ad6a-2fd8d45888bb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:03.040889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3cb776c2-4d51-42d1-ad6a-2fd8d45888bb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:03.041309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3cb776c2-4d51-42d1-ad6a-2fd8d45888bb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:03.102298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3cb776c2-4d51-42d1-ad6a-2fd8d45888bb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:03.110030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3cb776c2-4d51-42d1-ad6a-2fd8d45888bb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082089 Aug 24 05:04:03.110591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 302/658] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:03 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:04.130467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-64139915-8675-458a-824d-f21201129d56 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:04.131058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-64139915-8675-458a-824d-f21201129d56 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:04.137397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64139915-8675-458a-824d-f21201129d56 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:04.137884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64139915-8675-458a-824d-f21201129d56 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:04.138320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64139915-8675-458a-824d-f21201129d56 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:04.139044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64139915-8675-458a-824d-f21201129d56 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:04.139498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64139915-8675-458a-824d-f21201129d56 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:04.139921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64139915-8675-458a-824d-f21201129d56 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:04.202169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-64139915-8675-458a-824d-f21201129d56 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:04.210442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-64139915-8675-458a-824d-f21201129d56 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084105 Aug 24 05:04:04.211042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 357/659] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:04 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:05.232265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-42a72e11-4709-4dea-a923-1c8b8bd6174c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:05.232997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-42a72e11-4709-4dea-a923-1c8b8bd6174c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:05.239398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42a72e11-4709-4dea-a923-1c8b8bd6174c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:05.239875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42a72e11-4709-4dea-a923-1c8b8bd6174c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:05.240305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42a72e11-4709-4dea-a923-1c8b8bd6174c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:05.240981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42a72e11-4709-4dea-a923-1c8b8bd6174c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:05.241427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42a72e11-4709-4dea-a923-1c8b8bd6174c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:05.242004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42a72e11-4709-4dea-a923-1c8b8bd6174c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:05.303534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-42a72e11-4709-4dea-a923-1c8b8bd6174c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:05.311211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-42a72e11-4709-4dea-a923-1c8b8bd6174c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082816 Aug 24 05:04:05.311782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 303/660] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:05 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:06.332194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c7b6a095-1965-4e90-b33b-540a031342d2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:06.332805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c7b6a095-1965-4e90-b33b-540a031342d2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:06.339254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b6a095-1965-4e90-b33b-540a031342d2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:06.339730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b6a095-1965-4e90-b33b-540a031342d2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:06.340161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b6a095-1965-4e90-b33b-540a031342d2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:06.340837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b6a095-1965-4e90-b33b-540a031342d2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:06.341285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b6a095-1965-4e90-b33b-540a031342d2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:06.341703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b6a095-1965-4e90-b33b-540a031342d2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:06.402717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c7b6a095-1965-4e90-b33b-540a031342d2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:06.411221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c7b6a095-1965-4e90-b33b-540a031342d2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082890 Aug 24 05:04:06.411793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 358/661] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:06 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:06.699252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:04:06.699806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:04:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:04:07.432866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fa6c7cfc-91bc-4f2f-96eb-a35210006c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:07.433554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fa6c7cfc-91bc-4f2f-96eb-a35210006c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:07.435501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=28 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:07.441620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa6c7cfc-91bc-4f2f-96eb-a35210006c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:07.442113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa6c7cfc-91bc-4f2f-96eb-a35210006c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:07.442546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa6c7cfc-91bc-4f2f-96eb-a35210006c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:07.443271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa6c7cfc-91bc-4f2f-96eb-a35210006c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:07.443725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa6c7cfc-91bc-4f2f-96eb-a35210006c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:07.444151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa6c7cfc-91bc-4f2f-96eb-a35210006c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:07.505804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fa6c7cfc-91bc-4f2f-96eb-a35210006c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:07.513604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fa6c7cfc-91bc-4f2f-96eb-a35210006c29 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084864 Aug 24 05:04:07.514168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 304/662] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:07 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:08.535093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4d1a08c2-57c3-465f-a954-15c98beccceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:08.535707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4d1a08c2-57c3-465f-a954-15c98beccceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:08.542191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d1a08c2-57c3-465f-a954-15c98beccceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:08.542669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d1a08c2-57c3-465f-a954-15c98beccceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:08.543135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d1a08c2-57c3-465f-a954-15c98beccceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:08.543822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d1a08c2-57c3-465f-a954-15c98beccceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:08.544273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d1a08c2-57c3-465f-a954-15c98beccceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:08.544694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d1a08c2-57c3-465f-a954-15c98beccceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:08.620431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4d1a08c2-57c3-465f-a954-15c98beccceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:08.628850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4d1a08c2-57c3-465f-a954-15c98beccceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.097837 Aug 24 05:04:08.629422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 359/663] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:08 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:09.649478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4d04d175-51b0-4781-b712-a52bce6173be tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:09.650631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4d04d175-51b0-4781-b712-a52bce6173be tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:09.657327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d04d175-51b0-4781-b712-a52bce6173be tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:09.657812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d04d175-51b0-4781-b712-a52bce6173be tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:09.658697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d04d175-51b0-4781-b712-a52bce6173be tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:09.659403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d04d175-51b0-4781-b712-a52bce6173be tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:09.660025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d04d175-51b0-4781-b712-a52bce6173be tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:09.660451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d04d175-51b0-4781-b712-a52bce6173be tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:09.724169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4d04d175-51b0-4781-b712-a52bce6173be tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:09.732043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4d04d175-51b0-4781-b712-a52bce6173be tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086504 Aug 24 05:04:09.732601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 305/664] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:09 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:10.752621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-929feedd-a718-4c66-a0ce-6b39399a4554 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:10.753320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-929feedd-a718-4c66-a0ce-6b39399a4554 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:10.759794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-929feedd-a718-4c66-a0ce-6b39399a4554 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:10.760279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-929feedd-a718-4c66-a0ce-6b39399a4554 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:10.760715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-929feedd-a718-4c66-a0ce-6b39399a4554 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:10.761406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-929feedd-a718-4c66-a0ce-6b39399a4554 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:10.761860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-929feedd-a718-4c66-a0ce-6b39399a4554 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:10.762282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-929feedd-a718-4c66-a0ce-6b39399a4554 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:10.824840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-929feedd-a718-4c66-a0ce-6b39399a4554 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:10.833030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-929feedd-a718-4c66-a0ce-6b39399a4554 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084553 Aug 24 05:04:10.833588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 360/665] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:10 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:11.853993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fcf52a46-ceb6-467d-af65-96ef4bfe6fac tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:11.854594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fcf52a46-ceb6-467d-af65-96ef4bfe6fac tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:11.861770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcf52a46-ceb6-467d-af65-96ef4bfe6fac tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:11.862238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcf52a46-ceb6-467d-af65-96ef4bfe6fac tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:11.862666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcf52a46-ceb6-467d-af65-96ef4bfe6fac tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:11.863363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcf52a46-ceb6-467d-af65-96ef4bfe6fac tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:11.863811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcf52a46-ceb6-467d-af65-96ef4bfe6fac tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:11.864225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcf52a46-ceb6-467d-af65-96ef4bfe6fac tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:11.927236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fcf52a46-ceb6-467d-af65-96ef4bfe6fac tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:11.935001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fcf52a46-ceb6-467d-af65-96ef4bfe6fac tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085031 Aug 24 05:04:11.935555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 306/666] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:11 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:12.955653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2c484d07-e23b-42ca-8392-6738c93e5da7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:12.956258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2c484d07-e23b-42ca-8392-6738c93e5da7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:12.962672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c484d07-e23b-42ca-8392-6738c93e5da7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:12.963186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c484d07-e23b-42ca-8392-6738c93e5da7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:12.963823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c484d07-e23b-42ca-8392-6738c93e5da7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:12.964511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c484d07-e23b-42ca-8392-6738c93e5da7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:12.964964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c484d07-e23b-42ca-8392-6738c93e5da7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:12.965387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c484d07-e23b-42ca-8392-6738c93e5da7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:13.027606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2c484d07-e23b-42ca-8392-6738c93e5da7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:13.035574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2c484d07-e23b-42ca-8392-6738c93e5da7 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083796 Aug 24 05:04:13.036134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 361/667] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:12 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:14.056725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-705afa81-67fb-440b-aa50-1ed51da239eb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:14.057260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-705afa81-67fb-440b-aa50-1ed51da239eb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:14.063606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-705afa81-67fb-440b-aa50-1ed51da239eb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:14.064613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-705afa81-67fb-440b-aa50-1ed51da239eb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:14.065131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-705afa81-67fb-440b-aa50-1ed51da239eb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:14.065810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-705afa81-67fb-440b-aa50-1ed51da239eb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:14.066261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-705afa81-67fb-440b-aa50-1ed51da239eb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:14.066750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-705afa81-67fb-440b-aa50-1ed51da239eb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:14.128374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-705afa81-67fb-440b-aa50-1ed51da239eb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:14.136119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-705afa81-67fb-440b-aa50-1ed51da239eb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083365 Aug 24 05:04:14.136684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 307/668] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:14 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:15.157238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fcec587a-be02-46fa-abae-1c2ef25b5623 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:15.159652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fcec587a-be02-46fa-abae-1c2ef25b5623 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:15.165648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcec587a-be02-46fa-abae-1c2ef25b5623 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:15.166124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcec587a-be02-46fa-abae-1c2ef25b5623 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:15.166556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcec587a-be02-46fa-abae-1c2ef25b5623 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:15.167274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcec587a-be02-46fa-abae-1c2ef25b5623 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:15.167724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcec587a-be02-46fa-abae-1c2ef25b5623 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:15.168141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcec587a-be02-46fa-abae-1c2ef25b5623 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:15.230356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fcec587a-be02-46fa-abae-1c2ef25b5623 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:15.238213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fcec587a-be02-46fa-abae-1c2ef25b5623 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085143 Aug 24 05:04:15.238796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 362/669] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:15 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:16.259164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e04a8afd-48d4-411b-a6d7-be6a14db7552 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:16.259774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e04a8afd-48d4-411b-a6d7-be6a14db7552 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:16.266153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e04a8afd-48d4-411b-a6d7-be6a14db7552 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:16.266629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e04a8afd-48d4-411b-a6d7-be6a14db7552 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:16.267664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e04a8afd-48d4-411b-a6d7-be6a14db7552 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:16.268343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e04a8afd-48d4-411b-a6d7-be6a14db7552 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:16.268788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e04a8afd-48d4-411b-a6d7-be6a14db7552 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:16.269206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e04a8afd-48d4-411b-a6d7-be6a14db7552 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:16.330922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e04a8afd-48d4-411b-a6d7-be6a14db7552 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:16.338545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e04a8afd-48d4-411b-a6d7-be6a14db7552 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083328 Aug 24 05:04:16.339127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 308/670] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:16 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:17.358882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-961b119f-3ab0-4770-a4cf-ae19a53c64ff tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:17.359407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-961b119f-3ab0-4770-a4cf-ae19a53c64ff tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:17.366137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-961b119f-3ab0-4770-a4cf-ae19a53c64ff tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:17.366617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-961b119f-3ab0-4770-a4cf-ae19a53c64ff tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:17.367084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-961b119f-3ab0-4770-a4cf-ae19a53c64ff tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:17.367772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-961b119f-3ab0-4770-a4cf-ae19a53c64ff tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:17.368223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-961b119f-3ab0-4770-a4cf-ae19a53c64ff tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:17.368645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-961b119f-3ab0-4770-a4cf-ae19a53c64ff tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:17.432839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-961b119f-3ab0-4770-a4cf-ae19a53c64ff tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:17.441240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-961b119f-3ab0-4770-a4cf-ae19a53c64ff tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086346 Aug 24 05:04:17.441799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 363/671] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:17 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:18.461392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-59e286a2-ad82-4a20-9df6-781d2b30c0d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:18.461996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-59e286a2-ad82-4a20-9df6-781d2b30c0d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:18.468464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59e286a2-ad82-4a20-9df6-781d2b30c0d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:18.468943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59e286a2-ad82-4a20-9df6-781d2b30c0d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:18.469380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59e286a2-ad82-4a20-9df6-781d2b30c0d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:18.470770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59e286a2-ad82-4a20-9df6-781d2b30c0d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:18.471240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59e286a2-ad82-4a20-9df6-781d2b30c0d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:18.471663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59e286a2-ad82-4a20-9df6-781d2b30c0d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:18.536487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-59e286a2-ad82-4a20-9df6-781d2b30c0d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:18.544290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-59e286a2-ad82-4a20-9df6-781d2b30c0d8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086853 Aug 24 05:04:18.544849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 309/672] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:18 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:19.565004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0105e976-ff08-49f3-9a41-d502528bee97 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:19.565625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0105e976-ff08-49f3-9a41-d502528bee97 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:19.572147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0105e976-ff08-49f3-9a41-d502528bee97 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:19.572624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0105e976-ff08-49f3-9a41-d502528bee97 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:19.573054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0105e976-ff08-49f3-9a41-d502528bee97 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:19.573730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0105e976-ff08-49f3-9a41-d502528bee97 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:19.574178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0105e976-ff08-49f3-9a41-d502528bee97 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:19.574594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0105e976-ff08-49f3-9a41-d502528bee97 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:19.634823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0105e976-ff08-49f3-9a41-d502528bee97 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:19.642768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0105e976-ff08-49f3-9a41-d502528bee97 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081586 Aug 24 05:04:19.643326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 364/673] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:19 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:20.570495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:04:20.571190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:04:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:04:20.663495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e6c24ca2-207f-41aa-9bd7-e3968c6a367b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:20.664016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e6c24ca2-207f-41aa-9bd7-e3968c6a367b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:20.670710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca2-207f-41aa-9bd7-e3968c6a367b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:20.671189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca2-207f-41aa-9bd7-e3968c6a367b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:20.671615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca2-207f-41aa-9bd7-e3968c6a367b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:20.672291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca2-207f-41aa-9bd7-e3968c6a367b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:20.672741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca2-207f-41aa-9bd7-e3968c6a367b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:20.673652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6c24ca2-207f-41aa-9bd7-e3968c6a367b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:20.734001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e6c24ca2-207f-41aa-9bd7-e3968c6a367b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:20.742511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e6c24ca2-207f-41aa-9bd7-e3968c6a367b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082953 Aug 24 05:04:20.743098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 310/674] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:20 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:21.763732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b7554374-e317-4f8b-a8e9-fc7a3ef9e0c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:21.764335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b7554374-e317-4f8b-a8e9-fc7a3ef9e0c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:21.771459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7554374-e317-4f8b-a8e9-fc7a3ef9e0c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:21.771938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7554374-e317-4f8b-a8e9-fc7a3ef9e0c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:21.772370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7554374-e317-4f8b-a8e9-fc7a3ef9e0c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:21.773051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7554374-e317-4f8b-a8e9-fc7a3ef9e0c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:21.773500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7554374-e317-4f8b-a8e9-fc7a3ef9e0c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:21.773921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b7554374-e317-4f8b-a8e9-fc7a3ef9e0c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:21.834706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b7554374-e317-4f8b-a8e9-fc7a3ef9e0c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:21.842401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b7554374-e317-4f8b-a8e9-fc7a3ef9e0c8 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082555 Aug 24 05:04:21.843003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 365/675] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:21 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:22.862399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fd193d22-3e6d-4487-93e9-c99f69c845b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:22.863028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fd193d22-3e6d-4487-93e9-c99f69c845b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:22.869508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd193d22-3e6d-4487-93e9-c99f69c845b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:22.869991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd193d22-3e6d-4487-93e9-c99f69c845b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:22.870424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd193d22-3e6d-4487-93e9-c99f69c845b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:22.871142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd193d22-3e6d-4487-93e9-c99f69c845b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:22.871597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd193d22-3e6d-4487-93e9-c99f69c845b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:22.872026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd193d22-3e6d-4487-93e9-c99f69c845b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:22.933438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fd193d22-3e6d-4487-93e9-c99f69c845b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:22.941135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fd193d22-3e6d-4487-93e9-c99f69c845b6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082665 Aug 24 05:04:22.941693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 311/676] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:22 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:23.961890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8e8c9fd2-5174-40b5-bf25-a949caa76dc3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:23.962493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8e8c9fd2-5174-40b5-bf25-a949caa76dc3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:23.968872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e8c9fd2-5174-40b5-bf25-a949caa76dc3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:23.969345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e8c9fd2-5174-40b5-bf25-a949caa76dc3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:23.969774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e8c9fd2-5174-40b5-bf25-a949caa76dc3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:23.970481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e8c9fd2-5174-40b5-bf25-a949caa76dc3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:23.971023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e8c9fd2-5174-40b5-bf25-a949caa76dc3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:23.971440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e8c9fd2-5174-40b5-bf25-a949caa76dc3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:24.032078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8e8c9fd2-5174-40b5-bf25-a949caa76dc3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:24.039916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8e8c9fd2-5174-40b5-bf25-a949caa76dc3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081964 Aug 24 05:04:24.040468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 366/677] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:23 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:25.060711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-206e5dd9-b7c5-4289-bf19-7457f92165ba tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:25.061231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-206e5dd9-b7c5-4289-bf19-7457f92165ba tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:25.068881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-206e5dd9-b7c5-4289-bf19-7457f92165ba tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:25.069667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-206e5dd9-b7c5-4289-bf19-7457f92165ba tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:25.070364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-206e5dd9-b7c5-4289-bf19-7457f92165ba tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:25.071501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-206e5dd9-b7c5-4289-bf19-7457f92165ba tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:25.072307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-206e5dd9-b7c5-4289-bf19-7457f92165ba tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:25.073052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-206e5dd9-b7c5-4289-bf19-7457f92165ba tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:25.136557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-206e5dd9-b7c5-4289-bf19-7457f92165ba tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:25.144456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-206e5dd9-b7c5-4289-bf19-7457f92165ba tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087692 Aug 24 05:04:25.145009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 312/678] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:25 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:26.165394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1787b64c-ecaa-429c-8047-7399b4a811e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:26.166047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1787b64c-ecaa-429c-8047-7399b4a811e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:26.172919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1787b64c-ecaa-429c-8047-7399b4a811e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:26.174079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1787b64c-ecaa-429c-8047-7399b4a811e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:26.174521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1787b64c-ecaa-429c-8047-7399b4a811e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:26.175241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1787b64c-ecaa-429c-8047-7399b4a811e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:26.175691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1787b64c-ecaa-429c-8047-7399b4a811e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:26.176107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1787b64c-ecaa-429c-8047-7399b4a811e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:26.178710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=84 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:26.240602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1787b64c-ecaa-429c-8047-7399b4a811e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:26.248233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1787b64c-ecaa-429c-8047-7399b4a811e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087012 Aug 24 05:04:26.248779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 367/679] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:26 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:27.269861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9cad33eb-d7ad-4d92-b88f-756ed5089f2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:27.270438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9cad33eb-d7ad-4d92-b88f-756ed5089f2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:27.276928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cad33eb-d7ad-4d92-b88f-756ed5089f2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:27.277400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cad33eb-d7ad-4d92-b88f-756ed5089f2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:27.277827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cad33eb-d7ad-4d92-b88f-756ed5089f2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:27.278493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cad33eb-d7ad-4d92-b88f-756ed5089f2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:27.278973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cad33eb-d7ad-4d92-b88f-756ed5089f2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:27.279384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cad33eb-d7ad-4d92-b88f-756ed5089f2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:27.342928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9cad33eb-d7ad-4d92-b88f-756ed5089f2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:27.350581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9cad33eb-d7ad-4d92-b88f-756ed5089f2b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084803 Aug 24 05:04:27.351162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 313/680] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:27 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:28.372353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2b547a5b-4cc3-4340-aff1-a600c3b51a9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:28.372961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2b547a5b-4cc3-4340-aff1-a600c3b51a9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:28.380253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b547a5b-4cc3-4340-aff1-a600c3b51a9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:28.380740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b547a5b-4cc3-4340-aff1-a600c3b51a9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:28.381174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b547a5b-4cc3-4340-aff1-a600c3b51a9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:28.381858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b547a5b-4cc3-4340-aff1-a600c3b51a9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:28.382312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b547a5b-4cc3-4340-aff1-a600c3b51a9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:28.382751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b547a5b-4cc3-4340-aff1-a600c3b51a9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:28.446257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2b547a5b-4cc3-4340-aff1-a600c3b51a9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:28.457320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2b547a5b-4cc3-4340-aff1-a600c3b51a9b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.088787 Aug 24 05:04:28.458308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 368/681] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:28 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:29.478316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-56412e1a-e2a0-45a8-83ba-3fa3ef6bbf49 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:29.478975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-56412e1a-e2a0-45a8-83ba-3fa3ef6bbf49 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:29.485394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56412e1a-e2a0-45a8-83ba-3fa3ef6bbf49 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:29.485874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56412e1a-e2a0-45a8-83ba-3fa3ef6bbf49 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:29.486827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56412e1a-e2a0-45a8-83ba-3fa3ef6bbf49 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:29.487510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56412e1a-e2a0-45a8-83ba-3fa3ef6bbf49 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:29.487960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56412e1a-e2a0-45a8-83ba-3fa3ef6bbf49 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:29.488377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56412e1a-e2a0-45a8-83ba-3fa3ef6bbf49 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:29.490902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=84 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:29.550917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-56412e1a-e2a0-45a8-83ba-3fa3ef6bbf49 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:29.558636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-56412e1a-e2a0-45a8-83ba-3fa3ef6bbf49 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084234 Aug 24 05:04:29.559226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 314/682] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:29 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:30.579678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6f002f7e-fa8a-4b75-ae51-3690381a7542 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:30.580907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6f002f7e-fa8a-4b75-ae51-3690381a7542 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:30.583396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=28 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:30.588890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f002f7e-fa8a-4b75-ae51-3690381a7542 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:30.589370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f002f7e-fa8a-4b75-ae51-3690381a7542 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:30.589797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f002f7e-fa8a-4b75-ae51-3690381a7542 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:30.590475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f002f7e-fa8a-4b75-ae51-3690381a7542 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:30.590954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f002f7e-fa8a-4b75-ae51-3690381a7542 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:30.591373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f002f7e-fa8a-4b75-ae51-3690381a7542 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:30.652418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6f002f7e-fa8a-4b75-ae51-3690381a7542 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:30.660774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6f002f7e-fa8a-4b75-ae51-3690381a7542 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085023 Aug 24 05:04:30.661324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 369/683] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:30 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:31.681370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-73ca8520-fbce-40fe-a77f-6280b35e0182 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:31.681972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-73ca8520-fbce-40fe-a77f-6280b35e0182 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:31.688397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73ca8520-fbce-40fe-a77f-6280b35e0182 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:31.688882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73ca8520-fbce-40fe-a77f-6280b35e0182 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:31.689319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73ca8520-fbce-40fe-a77f-6280b35e0182 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:31.690156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73ca8520-fbce-40fe-a77f-6280b35e0182 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:31.690612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73ca8520-fbce-40fe-a77f-6280b35e0182 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:31.691061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73ca8520-fbce-40fe-a77f-6280b35e0182 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:31.754513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-73ca8520-fbce-40fe-a77f-6280b35e0182 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:31.762311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-73ca8520-fbce-40fe-a77f-6280b35e0182 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084851 Aug 24 05:04:31.762896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 315/684] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:31 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:32.784156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fd7f1a76-91e8-4538-a651-4d3ba8041b53 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:32.784773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fd7f1a76-91e8-4538-a651-4d3ba8041b53 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:32.791225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7f1a76-91e8-4538-a651-4d3ba8041b53 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:32.791705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7f1a76-91e8-4538-a651-4d3ba8041b53 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:32.792137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7f1a76-91e8-4538-a651-4d3ba8041b53 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:32.792873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7f1a76-91e8-4538-a651-4d3ba8041b53 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:32.793327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7f1a76-91e8-4538-a651-4d3ba8041b53 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:32.793748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7f1a76-91e8-4538-a651-4d3ba8041b53 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:32.856064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fd7f1a76-91e8-4538-a651-4d3ba8041b53 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:32.864517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fd7f1a76-91e8-4538-a651-4d3ba8041b53 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084955 Aug 24 05:04:32.865069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 370/685] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:32 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:33.886793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-68d03270-63ca-4c6f-80e3-2c5e04843cd6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:33.887905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-68d03270-63ca-4c6f-80e3-2c5e04843cd6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:33.896186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68d03270-63ca-4c6f-80e3-2c5e04843cd6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:33.896673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68d03270-63ca-4c6f-80e3-2c5e04843cd6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:33.897106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68d03270-63ca-4c6f-80e3-2c5e04843cd6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:33.897795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68d03270-63ca-4c6f-80e3-2c5e04843cd6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:33.898246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68d03270-63ca-4c6f-80e3-2c5e04843cd6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:33.898668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68d03270-63ca-4c6f-80e3-2c5e04843cd6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:33.960436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-68d03270-63ca-4c6f-80e3-2c5e04843cd6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:33.968260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-68d03270-63ca-4c6f-80e3-2c5e04843cd6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087212 Aug 24 05:04:33.968821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 316/686] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:33 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:34.988168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ab21866b-c638-452b-ba00-b642c992ee68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:34.988712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ab21866b-c638-452b-ba00-b642c992ee68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:34.995137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab21866b-c638-452b-ba00-b642c992ee68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:34.995614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab21866b-c638-452b-ba00-b642c992ee68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:34.996046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab21866b-c638-452b-ba00-b642c992ee68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:34.996761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab21866b-c638-452b-ba00-b642c992ee68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:34.997211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab21866b-c638-452b-ba00-b642c992ee68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:34.997636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab21866b-c638-452b-ba00-b642c992ee68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:35.060982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ab21866b-c638-452b-ba00-b642c992ee68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:35.069569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ab21866b-c638-452b-ba00-b642c992ee68 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085523 Aug 24 05:04:35.070129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 371/687] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:34 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:04:35.392812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4d372b03-bf8e-4189-b56f-f16f14802181 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:35.393425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4d372b03-bf8e-4189-b56f-f16f14802181 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:35.400537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d372b03-bf8e-4189-b56f-f16f14802181 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:35.401038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d372b03-bf8e-4189-b56f-f16f14802181 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:35.401469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d372b03-bf8e-4189-b56f-f16f14802181 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:35.402161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d372b03-bf8e-4189-b56f-f16f14802181 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:35.402612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d372b03-bf8e-4189-b56f-f16f14802181 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:35.403077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d372b03-bf8e-4189-b56f-f16f14802181 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:36.090543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c43ec913-fa10-4331-8878-294da0b65170 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:36.091191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c43ec913-fa10-4331-8878-294da0b65170 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:36.098351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c43ec913-fa10-4331-8878-294da0b65170 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:36.098864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c43ec913-fa10-4331-8878-294da0b65170 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:36.099299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c43ec913-fa10-4331-8878-294da0b65170 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:36.099978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c43ec913-fa10-4331-8878-294da0b65170 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:36.100433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c43ec913-fa10-4331-8878-294da0b65170 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:36.100853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c43ec913-fa10-4331-8878-294da0b65170 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:36.162500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c43ec913-fa10-4331-8878-294da0b65170 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:36.170403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c43ec913-fa10-4331-8878-294da0b65170 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083471 Aug 24 05:04:36.171011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 372/688] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:36 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:37.191603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d8e3b4ba-b621-489f-979e-8b1678ae231c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:37.192262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d8e3b4ba-b621-489f-979e-8b1678ae231c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:37.198593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e3b4ba-b621-489f-979e-8b1678ae231c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:37.199107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e3b4ba-b621-489f-979e-8b1678ae231c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:37.199542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e3b4ba-b621-489f-979e-8b1678ae231c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:37.200223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e3b4ba-b621-489f-979e-8b1678ae231c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:37.200675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e3b4ba-b621-489f-979e-8b1678ae231c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:37.201094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e3b4ba-b621-489f-979e-8b1678ae231c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:37.264303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d8e3b4ba-b621-489f-979e-8b1678ae231c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:37.272143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d8e3b4ba-b621-489f-979e-8b1678ae231c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085117 Aug 24 05:04:37.272705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 373/689] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:37 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:38.292628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f316bc35-8cf6-4981-9b2d-b64cc9178b0c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:38.293296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f316bc35-8cf6-4981-9b2d-b64cc9178b0c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:38.299919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f316bc35-8cf6-4981-9b2d-b64cc9178b0c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:38.300389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f316bc35-8cf6-4981-9b2d-b64cc9178b0c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:38.300817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f316bc35-8cf6-4981-9b2d-b64cc9178b0c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:38.301488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f316bc35-8cf6-4981-9b2d-b64cc9178b0c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:38.301934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f316bc35-8cf6-4981-9b2d-b64cc9178b0c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:38.302348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f316bc35-8cf6-4981-9b2d-b64cc9178b0c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:38.365611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f316bc35-8cf6-4981-9b2d-b64cc9178b0c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:38.373230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f316bc35-8cf6-4981-9b2d-b64cc9178b0c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084424 Aug 24 05:04:38.373778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 374/690] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:38 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:39.394511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-21b77685-770f-40d4-95fd-22559aad3eb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:39.395226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-21b77685-770f-40d4-95fd-22559aad3eb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:39.401510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21b77685-770f-40d4-95fd-22559aad3eb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:39.401997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21b77685-770f-40d4-95fd-22559aad3eb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:39.402430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21b77685-770f-40d4-95fd-22559aad3eb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:39.403138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21b77685-770f-40d4-95fd-22559aad3eb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:39.403591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21b77685-770f-40d4-95fd-22559aad3eb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:39.404011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21b77685-770f-40d4-95fd-22559aad3eb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:39.467286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-21b77685-770f-40d4-95fd-22559aad3eb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:39.475855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-21b77685-770f-40d4-95fd-22559aad3eb4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085686 Aug 24 05:04:39.476413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 375/691] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:39 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:40.496414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9be638fd-675f-4799-b1db-5c8b3b24c81e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:40.497087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9be638fd-675f-4799-b1db-5c8b3b24c81e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:40.504299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9be638fd-675f-4799-b1db-5c8b3b24c81e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:40.504776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9be638fd-675f-4799-b1db-5c8b3b24c81e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:40.505203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9be638fd-675f-4799-b1db-5c8b3b24c81e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:40.505881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9be638fd-675f-4799-b1db-5c8b3b24c81e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:40.506323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9be638fd-675f-4799-b1db-5c8b3b24c81e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:40.506758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9be638fd-675f-4799-b1db-5c8b3b24c81e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:40.567736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9be638fd-675f-4799-b1db-5c8b3b24c81e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:40.575508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9be638fd-675f-4799-b1db-5c8b3b24c81e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082995 Aug 24 05:04:40.576060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 376/692] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:40 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:41.597505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-227ee7c1-d71f-4164-a540-3b4696bb3828 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:41.598177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-227ee7c1-d71f-4164-a540-3b4696bb3828 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:41.604726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-227ee7c1-d71f-4164-a540-3b4696bb3828 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:41.605201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-227ee7c1-d71f-4164-a540-3b4696bb3828 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:41.605627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-227ee7c1-d71f-4164-a540-3b4696bb3828 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:41.606300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-227ee7c1-d71f-4164-a540-3b4696bb3828 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:41.606788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-227ee7c1-d71f-4164-a540-3b4696bb3828 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:41.607203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-227ee7c1-d71f-4164-a540-3b4696bb3828 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:41.669975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-227ee7c1-d71f-4164-a540-3b4696bb3828 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:41.678249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-227ee7c1-d71f-4164-a540-3b4696bb3828 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085547 Aug 24 05:04:41.678845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 377/693] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:41 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:42.698800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-39fa98d9-2b65-4380-9acb-cdea58845be2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:42.699482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-39fa98d9-2b65-4380-9acb-cdea58845be2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:42.705768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39fa98d9-2b65-4380-9acb-cdea58845be2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:42.706245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39fa98d9-2b65-4380-9acb-cdea58845be2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:42.706679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39fa98d9-2b65-4380-9acb-cdea58845be2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:42.707388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39fa98d9-2b65-4380-9acb-cdea58845be2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:42.707835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39fa98d9-2b65-4380-9acb-cdea58845be2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:42.708256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39fa98d9-2b65-4380-9acb-cdea58845be2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:42.770333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-39fa98d9-2b65-4380-9acb-cdea58845be2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:42.778274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-39fa98d9-2b65-4380-9acb-cdea58845be2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083384 Aug 24 05:04:42.778864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 378/694] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:42 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:43.799683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-23e86ea0-156e-472b-8410-b5342bdd4afb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:43.800320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-23e86ea0-156e-472b-8410-b5342bdd4afb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:43.807081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e86ea0-156e-472b-8410-b5342bdd4afb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:43.807576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e86ea0-156e-472b-8410-b5342bdd4afb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:43.807983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e86ea0-156e-472b-8410-b5342bdd4afb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:43.808659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e86ea0-156e-472b-8410-b5342bdd4afb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:43.809102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e86ea0-156e-472b-8410-b5342bdd4afb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:43.809531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23e86ea0-156e-472b-8410-b5342bdd4afb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:43.877294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-23e86ea0-156e-472b-8410-b5342bdd4afb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:43.886165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-23e86ea0-156e-472b-8410-b5342bdd4afb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.091230 Aug 24 05:04:43.886742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 379/695] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:43 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:44.906410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bb2730a6-3e41-49a7-b56f-03e54a419f8c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:44.907059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bb2730a6-3e41-49a7-b56f-03e54a419f8c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:44.913532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2730a6-3e41-49a7-b56f-03e54a419f8c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:44.914012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2730a6-3e41-49a7-b56f-03e54a419f8c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:44.914443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2730a6-3e41-49a7-b56f-03e54a419f8c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:44.915147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2730a6-3e41-49a7-b56f-03e54a419f8c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:44.915599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2730a6-3e41-49a7-b56f-03e54a419f8c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:44.916019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2730a6-3e41-49a7-b56f-03e54a419f8c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:44.977455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bb2730a6-3e41-49a7-b56f-03e54a419f8c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:44.985183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bb2730a6-3e41-49a7-b56f-03e54a419f8c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082596 Aug 24 05:04:44.985743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 380/696] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:44 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:45.397592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=27 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:45.463658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=21 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:46.006167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8d4bdf80-2027-4e91-8bc2-c6fc33f19f83 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:46.006717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8d4bdf80-2027-4e91-8bc2-c6fc33f19f83 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:46.013079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4bdf80-2027-4e91-8bc2-c6fc33f19f83 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:46.013571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4bdf80-2027-4e91-8bc2-c6fc33f19f83 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:46.013984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4bdf80-2027-4e91-8bc2-c6fc33f19f83 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:46.014660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4bdf80-2027-4e91-8bc2-c6fc33f19f83 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:46.015131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4bdf80-2027-4e91-8bc2-c6fc33f19f83 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:46.015547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4bdf80-2027-4e91-8bc2-c6fc33f19f83 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:46.078255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8d4bdf80-2027-4e91-8bc2-c6fc33f19f83 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:46.085936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8d4bdf80-2027-4e91-8bc2-c6fc33f19f83 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084391 Aug 24 05:04:46.086487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 381/697] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:46 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:47.105423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c7c32fa2-b96d-459b-aeee-6874d9f5f7e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:47.106061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c7c32fa2-b96d-459b-aeee-6874d9f5f7e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:47.113260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7c32fa2-b96d-459b-aeee-6874d9f5f7e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:47.113738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7c32fa2-b96d-459b-aeee-6874d9f5f7e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:47.114174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7c32fa2-b96d-459b-aeee-6874d9f5f7e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:47.114902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7c32fa2-b96d-459b-aeee-6874d9f5f7e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:47.115353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7c32fa2-b96d-459b-aeee-6874d9f5f7e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:47.115771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7c32fa2-b96d-459b-aeee-6874d9f5f7e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:47.176894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c7c32fa2-b96d-459b-aeee-6874d9f5f7e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:47.184448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c7c32fa2-b96d-459b-aeee-6874d9f5f7e0 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082997 Aug 24 05:04:47.185004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 382/698] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:47 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:48.204680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d8ced0cc-99e2-48c2-843f-ed3bd4b6a2ce tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:48.205327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d8ced0cc-99e2-48c2-843f-ed3bd4b6a2ce tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:48.211749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8ced0cc-99e2-48c2-843f-ed3bd4b6a2ce tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:48.212230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8ced0cc-99e2-48c2-843f-ed3bd4b6a2ce tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:48.212662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8ced0cc-99e2-48c2-843f-ed3bd4b6a2ce tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:48.213343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8ced0cc-99e2-48c2-843f-ed3bd4b6a2ce tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:48.213794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8ced0cc-99e2-48c2-843f-ed3bd4b6a2ce tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:48.214216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8ced0cc-99e2-48c2-843f-ed3bd4b6a2ce tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:48.277114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d8ced0cc-99e2-48c2-843f-ed3bd4b6a2ce tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:48.279274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:48.286224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d8ced0cc-99e2-48c2-843f-ed3bd4b6a2ce tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085405 Aug 24 05:04:48.286801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 383/699] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:48 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:49.308189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0cf37099-3968-4539-a608-9525be00ae25 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:49.308869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0cf37099-3968-4539-a608-9525be00ae25 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:49.315710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cf37099-3968-4539-a608-9525be00ae25 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:49.316196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cf37099-3968-4539-a608-9525be00ae25 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:49.316628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cf37099-3968-4539-a608-9525be00ae25 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:49.317310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cf37099-3968-4539-a608-9525be00ae25 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:49.317761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cf37099-3968-4539-a608-9525be00ae25 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:49.318181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0cf37099-3968-4539-a608-9525be00ae25 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:49.383082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0cf37099-3968-4539-a608-9525be00ae25 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:49.390841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0cf37099-3968-4539-a608-9525be00ae25 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086739 Aug 24 05:04:49.391399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 384/700] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:49 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:50.412938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-09f525cc-55a2-4e72-8a0e-4f1a55d8788f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:50.413633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-09f525cc-55a2-4e72-8a0e-4f1a55d8788f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:50.419972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09f525cc-55a2-4e72-8a0e-4f1a55d8788f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:50.420705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09f525cc-55a2-4e72-8a0e-4f1a55d8788f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:50.421136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09f525cc-55a2-4e72-8a0e-4f1a55d8788f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:50.421814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09f525cc-55a2-4e72-8a0e-4f1a55d8788f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:50.422264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09f525cc-55a2-4e72-8a0e-4f1a55d8788f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:50.422705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09f525cc-55a2-4e72-8a0e-4f1a55d8788f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:50.484861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-09f525cc-55a2-4e72-8a0e-4f1a55d8788f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:50.492514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-09f525cc-55a2-4e72-8a0e-4f1a55d8788f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084075 Aug 24 05:04:50.493074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 385/701] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:50 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:51.513189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fcf68829-9fac-486b-9bf3-2f30ed8407ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:51.513868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fcf68829-9fac-486b-9bf3-2f30ed8407ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:51.520255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcf68829-9fac-486b-9bf3-2f30ed8407ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:51.520724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcf68829-9fac-486b-9bf3-2f30ed8407ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:51.521150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcf68829-9fac-486b-9bf3-2f30ed8407ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:51.521822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcf68829-9fac-486b-9bf3-2f30ed8407ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:51.522264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcf68829-9fac-486b-9bf3-2f30ed8407ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:51.522672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcf68829-9fac-486b-9bf3-2f30ed8407ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:51.583357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fcf68829-9fac-486b-9bf3-2f30ed8407ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:51.590974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fcf68829-9fac-486b-9bf3-2f30ed8407ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081624 Aug 24 05:04:51.591555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 386/702] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:51 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:52.612880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-41c6df24-a8e2-4370-8e8a-26aee07b4b5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:52.613573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-41c6df24-a8e2-4370-8e8a-26aee07b4b5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:52.619963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41c6df24-a8e2-4370-8e8a-26aee07b4b5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:52.620450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41c6df24-a8e2-4370-8e8a-26aee07b4b5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:52.620863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41c6df24-a8e2-4370-8e8a-26aee07b4b5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:52.621531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41c6df24-a8e2-4370-8e8a-26aee07b4b5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:52.621972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41c6df24-a8e2-4370-8e8a-26aee07b4b5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:52.622404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41c6df24-a8e2-4370-8e8a-26aee07b4b5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:52.688789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-41c6df24-a8e2-4370-8e8a-26aee07b4b5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:52.696496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-41c6df24-a8e2-4370-8e8a-26aee07b4b5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.088116 Aug 24 05:04:52.697047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 387/703] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:52 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:53.717446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e31c288a-47e2-4f4e-850d-a57daf7ba71e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:53.718151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e31c288a-47e2-4f4e-850d-a57daf7ba71e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:53.724490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31c288a-47e2-4f4e-850d-a57daf7ba71e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:53.724966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31c288a-47e2-4f4e-850d-a57daf7ba71e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:53.725400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31c288a-47e2-4f4e-850d-a57daf7ba71e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:53.726102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31c288a-47e2-4f4e-850d-a57daf7ba71e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:53.726553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31c288a-47e2-4f4e-850d-a57daf7ba71e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:53.727018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31c288a-47e2-4f4e-850d-a57daf7ba71e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:53.788643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e31c288a-47e2-4f4e-850d-a57daf7ba71e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:53.796583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e31c288a-47e2-4f4e-850d-a57daf7ba71e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083073 Aug 24 05:04:53.797149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 388/704] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:53 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:54.817840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c1f5b170-a4ca-4325-9d1a-6ac9119be72b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:54.818475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c1f5b170-a4ca-4325-9d1a-6ac9119be72b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:54.825043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f5b170-a4ca-4325-9d1a-6ac9119be72b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:54.825523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f5b170-a4ca-4325-9d1a-6ac9119be72b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:54.825957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f5b170-a4ca-4325-9d1a-6ac9119be72b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:54.826636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f5b170-a4ca-4325-9d1a-6ac9119be72b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:54.827115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f5b170-a4ca-4325-9d1a-6ac9119be72b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:54.827538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f5b170-a4ca-4325-9d1a-6ac9119be72b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:54.888295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c1f5b170-a4ca-4325-9d1a-6ac9119be72b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:54.896527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c1f5b170-a4ca-4325-9d1a-6ac9119be72b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082580 Aug 24 05:04:54.897085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 389/705] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:54 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:55.917284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bab8eb66-1158-4829-8c63-714d6947e52e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:55.917913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bab8eb66-1158-4829-8c63-714d6947e52e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:55.925024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bab8eb66-1158-4829-8c63-714d6947e52e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:55.925590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bab8eb66-1158-4829-8c63-714d6947e52e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:55.926021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bab8eb66-1158-4829-8c63-714d6947e52e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:55.926714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bab8eb66-1158-4829-8c63-714d6947e52e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:55.927167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bab8eb66-1158-4829-8c63-714d6947e52e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:55.927585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bab8eb66-1158-4829-8c63-714d6947e52e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:55.988892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bab8eb66-1158-4829-8c63-714d6947e52e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:55.996564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bab8eb66-1158-4829-8c63-714d6947e52e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083129 Aug 24 05:04:55.997126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 390/706] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:55 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:57.017709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8ecffcb9-8870-45fa-87f4-a5a7d0e917a1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:57.019098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8ecffcb9-8870-45fa-87f4-a5a7d0e917a1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:57.025302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ecffcb9-8870-45fa-87f4-a5a7d0e917a1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:57.025776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ecffcb9-8870-45fa-87f4-a5a7d0e917a1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:57.026199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ecffcb9-8870-45fa-87f4-a5a7d0e917a1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:57.026920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ecffcb9-8870-45fa-87f4-a5a7d0e917a1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:57.027392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ecffcb9-8870-45fa-87f4-a5a7d0e917a1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:57.027803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ecffcb9-8870-45fa-87f4-a5a7d0e917a1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:57.091969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8ecffcb9-8870-45fa-87f4-a5a7d0e917a1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:57.099843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8ecffcb9-8870-45fa-87f4-a5a7d0e917a1 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086007 Aug 24 05:04:57.100391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 391/707] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:57 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:58.120811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f743601c-0463-4152-9b02-b33dd94a90f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:58.121471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f743601c-0463-4152-9b02-b33dd94a90f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:58.127751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f743601c-0463-4152-9b02-b33dd94a90f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:58.128827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f743601c-0463-4152-9b02-b33dd94a90f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:58.129265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f743601c-0463-4152-9b02-b33dd94a90f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:58.129965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f743601c-0463-4152-9b02-b33dd94a90f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:58.130415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f743601c-0463-4152-9b02-b33dd94a90f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:58.130865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f743601c-0463-4152-9b02-b33dd94a90f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:58.191769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f743601c-0463-4152-9b02-b33dd94a90f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:58.199417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f743601c-0463-4152-9b02-b33dd94a90f6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082577 Aug 24 05:04:58.199981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 392/708] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:58 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:04:59.219561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a10e494b-799b-4150-a3eb-9979bf62d9de tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:04:59.220262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a10e494b-799b-4150-a3eb-9979bf62d9de tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:04:59.227352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a10e494b-799b-4150-a3eb-9979bf62d9de tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:59.227833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a10e494b-799b-4150-a3eb-9979bf62d9de tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:59.228263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a10e494b-799b-4150-a3eb-9979bf62d9de tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:59.228948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a10e494b-799b-4150-a3eb-9979bf62d9de tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:04:59.229398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a10e494b-799b-4150-a3eb-9979bf62d9de tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:04:59.229820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a10e494b-799b-4150-a3eb-9979bf62d9de tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:04:59.292858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a10e494b-799b-4150-a3eb-9979bf62d9de tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:04:59.300909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a10e494b-799b-4150-a3eb-9979bf62d9de tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085107 Aug 24 05:04:59.301457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 393/709] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:04:59 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:00.321505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-69afa274-a1c4-4682-b843-76e5478a743b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:00.322137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-69afa274-a1c4-4682-b843-76e5478a743b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:00.328492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69afa274-a1c4-4682-b843-76e5478a743b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:00.328966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69afa274-a1c4-4682-b843-76e5478a743b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:00.329390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69afa274-a1c4-4682-b843-76e5478a743b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:00.330061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69afa274-a1c4-4682-b843-76e5478a743b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:00.330500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69afa274-a1c4-4682-b843-76e5478a743b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:00.330936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69afa274-a1c4-4682-b843-76e5478a743b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:00.396134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-69afa274-a1c4-4682-b843-76e5478a743b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:00.403781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-69afa274-a1c4-4682-b843-76e5478a743b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086384 Aug 24 05:05:00.404329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 394/710] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:00 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:01.423765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-033c7de0-52de-4c35-9396-e95306e1c63b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:01.424426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-033c7de0-52de-4c35-9396-e95306e1c63b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:01.427206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=52 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:01.432459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033c7de0-52de-4c35-9396-e95306e1c63b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:01.432938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033c7de0-52de-4c35-9396-e95306e1c63b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:01.433365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033c7de0-52de-4c35-9396-e95306e1c63b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:01.434035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033c7de0-52de-4c35-9396-e95306e1c63b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:01.434483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033c7de0-52de-4c35-9396-e95306e1c63b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:01.434919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033c7de0-52de-4c35-9396-e95306e1c63b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:01.498318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-033c7de0-52de-4c35-9396-e95306e1c63b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:01.506914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-033c7de0-52de-4c35-9396-e95306e1c63b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087210 Aug 24 05:05:01.507461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 395/711] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:01 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:02.527053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b13b1543-5726-4c72-922a-a61eb5d86f1b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:02.527655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b13b1543-5726-4c72-922a-a61eb5d86f1b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:02.535816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b13b1543-5726-4c72-922a-a61eb5d86f1b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:02.536293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b13b1543-5726-4c72-922a-a61eb5d86f1b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:02.536724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b13b1543-5726-4c72-922a-a61eb5d86f1b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:02.537398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b13b1543-5726-4c72-922a-a61eb5d86f1b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:02.537844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b13b1543-5726-4c72-922a-a61eb5d86f1b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:02.538257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b13b1543-5726-4c72-922a-a61eb5d86f1b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:02.599166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b13b1543-5726-4c72-922a-a61eb5d86f1b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:02.606849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b13b1543-5726-4c72-922a-a61eb5d86f1b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083859 Aug 24 05:05:02.607400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 396/712] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:02 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:03.626320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4118ccf5-ed0b-4075-8542-0508916f7a58 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:03.627049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4118ccf5-ed0b-4075-8542-0508916f7a58 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:03.633571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4118ccf5-ed0b-4075-8542-0508916f7a58 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:03.634043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4118ccf5-ed0b-4075-8542-0508916f7a58 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:03.634471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4118ccf5-ed0b-4075-8542-0508916f7a58 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:03.635202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4118ccf5-ed0b-4075-8542-0508916f7a58 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:03.635648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4118ccf5-ed0b-4075-8542-0508916f7a58 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:03.636060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4118ccf5-ed0b-4075-8542-0508916f7a58 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:03.696973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4118ccf5-ed0b-4075-8542-0508916f7a58 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:03.704623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4118ccf5-ed0b-4075-8542-0508916f7a58 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082130 Aug 24 05:05:03.705176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 397/713] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:03 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:04.725945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f50595c6-0825-471f-a685-095ce13ef6ea tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:04.726645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f50595c6-0825-471f-a685-095ce13ef6ea tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:04.733136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f50595c6-0825-471f-a685-095ce13ef6ea tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:04.733620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f50595c6-0825-471f-a685-095ce13ef6ea tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:04.734054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f50595c6-0825-471f-a685-095ce13ef6ea tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:04.734766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f50595c6-0825-471f-a685-095ce13ef6ea tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:04.735489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f50595c6-0825-471f-a685-095ce13ef6ea tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:04.735738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f50595c6-0825-471f-a685-095ce13ef6ea tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:04.797889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f50595c6-0825-471f-a685-095ce13ef6ea tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:04.806372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f50595c6-0825-471f-a685-095ce13ef6ea tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084894 Aug 24 05:05:04.806960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 398/714] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:04 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:05.826884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7ed9d2d2-2441-485f-8837-740b05cf6cec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:05.827782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7ed9d2d2-2441-485f-8837-740b05cf6cec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:05.835423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2d2-2441-485f-8837-740b05cf6cec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:05.835906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2d2-2441-485f-8837-740b05cf6cec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:05.836343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2d2-2441-485f-8837-740b05cf6cec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:05.837033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2d2-2441-485f-8837-740b05cf6cec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:05.837488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2d2-2441-485f-8837-740b05cf6cec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:05.837907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ed9d2d2-2441-485f-8837-740b05cf6cec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:05.907766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7ed9d2d2-2441-485f-8837-740b05cf6cec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:05.915561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7ed9d2d2-2441-485f-8837-740b05cf6cec tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.092563 Aug 24 05:05:05.916131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 399/715] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:05 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:06.936801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-340056a3-a829-44f6-b9fb-2b8dee247896 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:06.937466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-340056a3-a829-44f6-b9fb-2b8dee247896 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:06.944305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-340056a3-a829-44f6-b9fb-2b8dee247896 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:06.944798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-340056a3-a829-44f6-b9fb-2b8dee247896 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:06.945226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-340056a3-a829-44f6-b9fb-2b8dee247896 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:06.945921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-340056a3-a829-44f6-b9fb-2b8dee247896 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:06.946371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-340056a3-a829-44f6-b9fb-2b8dee247896 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:06.946886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-340056a3-a829-44f6-b9fb-2b8dee247896 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:06.962371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:07.013868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-340056a3-a829-44f6-b9fb-2b8dee247896 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:07.021852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-340056a3-a829-44f6-b9fb-2b8dee247896 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.088939 Aug 24 05:05:07.022421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 400/716] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:06 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:08.041963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-02c048b8-d5db-47ca-bd2d-c8659d57f0a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:08.042599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-02c048b8-d5db-47ca-bd2d-c8659d57f0a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:08.049155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02c048b8-d5db-47ca-bd2d-c8659d57f0a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:08.049628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02c048b8-d5db-47ca-bd2d-c8659d57f0a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:08.050056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02c048b8-d5db-47ca-bd2d-c8659d57f0a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:08.050785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02c048b8-d5db-47ca-bd2d-c8659d57f0a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:08.051252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02c048b8-d5db-47ca-bd2d-c8659d57f0a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:08.051680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02c048b8-d5db-47ca-bd2d-c8659d57f0a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:08.111307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-02c048b8-d5db-47ca-bd2d-c8659d57f0a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:08.119720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-02c048b8-d5db-47ca-bd2d-c8659d57f0a9 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081674 Aug 24 05:05:08.120280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 401/717] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:08 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:09.140207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-823cb9ec-87e8-4ca2-898a-20e5153bf87f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:09.140885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-823cb9ec-87e8-4ca2-898a-20e5153bf87f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:09.147819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823cb9ec-87e8-4ca2-898a-20e5153bf87f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:09.148293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823cb9ec-87e8-4ca2-898a-20e5153bf87f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:09.148712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823cb9ec-87e8-4ca2-898a-20e5153bf87f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:09.149388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823cb9ec-87e8-4ca2-898a-20e5153bf87f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:09.149827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823cb9ec-87e8-4ca2-898a-20e5153bf87f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:09.150239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823cb9ec-87e8-4ca2-898a-20e5153bf87f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:09.211515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-823cb9ec-87e8-4ca2-898a-20e5153bf87f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:09.219127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-823cb9ec-87e8-4ca2-898a-20e5153bf87f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082736 Aug 24 05:05:09.219679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 402/718] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:09 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:10.239583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7dbe5e07-39c4-4acf-b997-1cc39af60c2f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:10.240258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7dbe5e07-39c4-4acf-b997-1cc39af60c2f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:10.246578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7dbe5e07-39c4-4acf-b997-1cc39af60c2f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:10.247094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7dbe5e07-39c4-4acf-b997-1cc39af60c2f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:10.247527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7dbe5e07-39c4-4acf-b997-1cc39af60c2f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:10.248207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7dbe5e07-39c4-4acf-b997-1cc39af60c2f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:10.248658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7dbe5e07-39c4-4acf-b997-1cc39af60c2f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:10.249079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7dbe5e07-39c4-4acf-b997-1cc39af60c2f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:10.540570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7dbe5e07-39c4-4acf-b997-1cc39af60c2f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:10.548582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7dbe5e07-39c4-4acf-b997-1cc39af60c2f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.313540 Aug 24 05:05:10.549138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 403/719] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:10 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:11.569462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b75181bc-b34e-48b9-b5e9-e138d0f4140c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:11.570137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b75181bc-b34e-48b9-b5e9-e138d0f4140c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:11.576483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b75181bc-b34e-48b9-b5e9-e138d0f4140c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:11.576953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b75181bc-b34e-48b9-b5e9-e138d0f4140c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:11.577406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b75181bc-b34e-48b9-b5e9-e138d0f4140c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:11.578082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b75181bc-b34e-48b9-b5e9-e138d0f4140c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:11.578525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b75181bc-b34e-48b9-b5e9-e138d0f4140c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:11.578962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b75181bc-b34e-48b9-b5e9-e138d0f4140c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:11.639027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b75181bc-b34e-48b9-b5e9-e138d0f4140c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:11.647165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b75181bc-b34e-48b9-b5e9-e138d0f4140c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081754 Aug 24 05:05:11.647722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 404/720] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:11 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:12.667031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e008e0f5-d3c2-4ada-8cb5-270e8d198032 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:12.667678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e008e0f5-d3c2-4ada-8cb5-270e8d198032 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:12.674284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e008e0f5-d3c2-4ada-8cb5-270e8d198032 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:12.674815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e008e0f5-d3c2-4ada-8cb5-270e8d198032 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:12.675243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e008e0f5-d3c2-4ada-8cb5-270e8d198032 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:12.676421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e008e0f5-d3c2-4ada-8cb5-270e8d198032 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:12.676863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e008e0f5-d3c2-4ada-8cb5-270e8d198032 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:12.677273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e008e0f5-d3c2-4ada-8cb5-270e8d198032 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:12.737312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e008e0f5-d3c2-4ada-8cb5-270e8d198032 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:12.745592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e008e0f5-d3c2-4ada-8cb5-270e8d198032 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.082432 Aug 24 05:05:12.746142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 405/721] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:12 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:13.766965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d78f7853-31be-411c-bf37-b07520ff04ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:13.767626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d78f7853-31be-411c-bf37-b07520ff04ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:13.775929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78f7853-31be-411c-bf37-b07520ff04ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:13.776415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78f7853-31be-411c-bf37-b07520ff04ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:13.776850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78f7853-31be-411c-bf37-b07520ff04ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:13.777549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78f7853-31be-411c-bf37-b07520ff04ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:13.778002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78f7853-31be-411c-bf37-b07520ff04ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:13.778426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d78f7853-31be-411c-bf37-b07520ff04ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:13.843656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d78f7853-31be-411c-bf37-b07520ff04ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:13.851603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d78f7853-31be-411c-bf37-b07520ff04ed tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.088661 Aug 24 05:05:13.852172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 406/722] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:13 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:14.875607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-245551a6-9e9b-490b-98f6-6f409931b9fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:14.876253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-245551a6-9e9b-490b-98f6-6f409931b9fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:14.882779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-245551a6-9e9b-490b-98f6-6f409931b9fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:14.883252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-245551a6-9e9b-490b-98f6-6f409931b9fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:14.883680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-245551a6-9e9b-490b-98f6-6f409931b9fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:14.884353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-245551a6-9e9b-490b-98f6-6f409931b9fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:14.884798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-245551a6-9e9b-490b-98f6-6f409931b9fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:14.885213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-245551a6-9e9b-490b-98f6-6f409931b9fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:14.951561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-245551a6-9e9b-490b-98f6-6f409931b9fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:14.959444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-245551a6-9e9b-490b-98f6-6f409931b9fe tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.088514 Aug 24 05:05:14.959996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 407/723] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:14 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:15.979600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2c4692d4-eba4-49b5-87c9-3c0076229943 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:15.980237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2c4692d4-eba4-49b5-87c9-3c0076229943 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:15.986189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c4692d4-eba4-49b5-87c9-3c0076229943 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:15.986611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c4692d4-eba4-49b5-87c9-3c0076229943 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:15.987075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c4692d4-eba4-49b5-87c9-3c0076229943 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:15.987757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c4692d4-eba4-49b5-87c9-3c0076229943 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:15.988249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c4692d4-eba4-49b5-87c9-3c0076229943 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:15.988668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c4692d4-eba4-49b5-87c9-3c0076229943 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:16.049285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2c4692d4-eba4-49b5-87c9-3c0076229943 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:16.056943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2c4692d4-eba4-49b5-87c9-3c0076229943 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.081348 Aug 24 05:05:16.057523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 408/724] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:15 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:17.077994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fb842f92-85bd-4c6c-9aad-63f6a1c95218 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:17.078659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fb842f92-85bd-4c6c-9aad-63f6a1c95218 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:17.085844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb842f92-85bd-4c6c-9aad-63f6a1c95218 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:17.086320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb842f92-85bd-4c6c-9aad-63f6a1c95218 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:17.086783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb842f92-85bd-4c6c-9aad-63f6a1c95218 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:17.087466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb842f92-85bd-4c6c-9aad-63f6a1c95218 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:17.087911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb842f92-85bd-4c6c-9aad-63f6a1c95218 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:17.088331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb842f92-85bd-4c6c-9aad-63f6a1c95218 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:17.155795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fb842f92-85bd-4c6c-9aad-63f6a1c95218 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:17.164311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fb842f92-85bd-4c6c-9aad-63f6a1c95218 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.090255 Aug 24 05:05:17.164878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 409/725] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:17 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:18.189822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-479c53ba-b733-4876-b3d6-47d2ecd22c3e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:18.190471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-479c53ba-b733-4876-b3d6-47d2ecd22c3e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:18.197733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-479c53ba-b733-4876-b3d6-47d2ecd22c3e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:18.198214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-479c53ba-b733-4876-b3d6-47d2ecd22c3e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:18.198650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-479c53ba-b733-4876-b3d6-47d2ecd22c3e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:18.199343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-479c53ba-b733-4876-b3d6-47d2ecd22c3e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:18.199792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-479c53ba-b733-4876-b3d6-47d2ecd22c3e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:18.200206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-479c53ba-b733-4876-b3d6-47d2ecd22c3e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:18.261381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-479c53ba-b733-4876-b3d6-47d2ecd22c3e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:18.269026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-479c53ba-b733-4876-b3d6-47d2ecd22c3e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083169 Aug 24 05:05:18.270249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 410/726] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:18 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:19.292292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bb5d30dd-af07-43c2-b803-6bf9b4fee3e4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:19.292968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bb5d30dd-af07-43c2-b803-6bf9b4fee3e4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:19.299696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb5d30dd-af07-43c2-b803-6bf9b4fee3e4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:19.300184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb5d30dd-af07-43c2-b803-6bf9b4fee3e4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:19.300768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb5d30dd-af07-43c2-b803-6bf9b4fee3e4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:19.301472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb5d30dd-af07-43c2-b803-6bf9b4fee3e4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:19.301927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb5d30dd-af07-43c2-b803-6bf9b4fee3e4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:19.302352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb5d30dd-af07-43c2-b803-6bf9b4fee3e4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:19.367424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bb5d30dd-af07-43c2-b803-6bf9b4fee3e4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:19.375347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bb5d30dd-af07-43c2-b803-6bf9b4fee3e4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086956 Aug 24 05:05:19.375903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 411/727] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:19 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:20.397168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f81db4c0-3cb3-4d4b-80cf-a898fdb171e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:20.397874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f81db4c0-3cb3-4d4b-80cf-a898fdb171e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:20.404110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f81db4c0-3cb3-4d4b-80cf-a898fdb171e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:20.404582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f81db4c0-3cb3-4d4b-80cf-a898fdb171e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:20.405005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f81db4c0-3cb3-4d4b-80cf-a898fdb171e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:20.405702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f81db4c0-3cb3-4d4b-80cf-a898fdb171e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:20.406142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f81db4c0-3cb3-4d4b-80cf-a898fdb171e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:20.406555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f81db4c0-3cb3-4d4b-80cf-a898fdb171e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:20.467856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f81db4c0-3cb3-4d4b-80cf-a898fdb171e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:20.475773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f81db4c0-3cb3-4d4b-80cf-a898fdb171e6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.083258 Aug 24 05:05:20.476399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 412/728] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:20 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:05:21.497659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-df9afb95-ad09-4eb6-b539-55b9914c5357 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:21.498347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-df9afb95-ad09-4eb6-b539-55b9914c5357 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:21.505854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df9afb95-ad09-4eb6-b539-55b9914c5357 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:21.506330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df9afb95-ad09-4eb6-b539-55b9914c5357 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:21.506794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df9afb95-ad09-4eb6-b539-55b9914c5357 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:21.507473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df9afb95-ad09-4eb6-b539-55b9914c5357 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:21.507920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df9afb95-ad09-4eb6-b539-55b9914c5357 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:21.508334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df9afb95-ad09-4eb6-b539-55b9914c5357 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:21.574061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-df9afb95-ad09-4eb6-b539-55b9914c5357 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:21.581940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-df9afb95-ad09-4eb6-b539-55b9914c5357 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.088104 Aug 24 05:05:21.582503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 413/729] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:21 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:22.602959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-823e6854-2a40-40d5-802a-8dda6dae630a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:22.603717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-823e6854-2a40-40d5-802a-8dda6dae630a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:22.610461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823e6854-2a40-40d5-802a-8dda6dae630a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:22.610968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823e6854-2a40-40d5-802a-8dda6dae630a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:22.611394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823e6854-2a40-40d5-802a-8dda6dae630a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:22.612067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823e6854-2a40-40d5-802a-8dda6dae630a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:22.612510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823e6854-2a40-40d5-802a-8dda6dae630a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:22.612920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-823e6854-2a40-40d5-802a-8dda6dae630a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:22.675736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-823e6854-2a40-40d5-802a-8dda6dae630a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:22.683581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-823e6854-2a40-40d5-802a-8dda6dae630a tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084622 Aug 24 05:05:22.684139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 414/730] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:22 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:23.704595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f41ba4e-b7a7-4b51-94fc-751c9455e4d6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:23.705268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1f41ba4e-b7a7-4b51-94fc-751c9455e4d6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:23.712235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f41ba4e-b7a7-4b51-94fc-751c9455e4d6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:23.712707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f41ba4e-b7a7-4b51-94fc-751c9455e4d6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:23.713133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f41ba4e-b7a7-4b51-94fc-751c9455e4d6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:23.713813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f41ba4e-b7a7-4b51-94fc-751c9455e4d6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:23.714258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f41ba4e-b7a7-4b51-94fc-751c9455e4d6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:23.714672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f41ba4e-b7a7-4b51-94fc-751c9455e4d6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:23.781632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1f41ba4e-b7a7-4b51-94fc-751c9455e4d6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:23.791805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1f41ba4e-b7a7-4b51-94fc-751c9455e4d6 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.091121 Aug 24 05:05:23.792832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 415/731] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:23 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:24.825957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ef8816ef-7820-4eaa-aee5-5465cf3e04c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:24.826567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ef8816ef-7820-4eaa-aee5-5465cf3e04c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:24.833191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef8816ef-7820-4eaa-aee5-5465cf3e04c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:24.833701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef8816ef-7820-4eaa-aee5-5465cf3e04c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:24.834753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef8816ef-7820-4eaa-aee5-5465cf3e04c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:24.835474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef8816ef-7820-4eaa-aee5-5465cf3e04c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:24.835958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef8816ef-7820-4eaa-aee5-5465cf3e04c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:24.836404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ef8816ef-7820-4eaa-aee5-5465cf3e04c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:24.903021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ef8816ef-7820-4eaa-aee5-5465cf3e04c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:24.911630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ef8816ef-7820-4eaa-aee5-5465cf3e04c4 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.089516 Aug 24 05:05:24.912312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 416/732] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:24 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:25.942058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aa6df255-df5e-4f3a-8a3e-af86e8fa19a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:25.942871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aa6df255-df5e-4f3a-8a3e-af86e8fa19a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:25.949956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa6df255-df5e-4f3a-8a3e-af86e8fa19a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:25.950449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa6df255-df5e-4f3a-8a3e-af86e8fa19a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:25.950918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa6df255-df5e-4f3a-8a3e-af86e8fa19a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:25.951714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa6df255-df5e-4f3a-8a3e-af86e8fa19a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:25.952260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa6df255-df5e-4f3a-8a3e-af86e8fa19a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:25.952686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa6df255-df5e-4f3a-8a3e-af86e8fa19a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:25.955608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:26.016666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aa6df255-df5e-4f3a-8a3e-af86e8fa19a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:26.025435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aa6df255-df5e-4f3a-8a3e-af86e8fa19a3 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087373 Aug 24 05:05:26.026008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 417/733] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:25 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:27.047905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a2ba4dfc-6104-4cf3-82c2-406eeb0de950 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:27.048534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a2ba4dfc-6104-4cf3-82c2-406eeb0de950 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:27.055771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2ba4dfc-6104-4cf3-82c2-406eeb0de950 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:27.055771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2ba4dfc-6104-4cf3-82c2-406eeb0de950 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:27.056213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2ba4dfc-6104-4cf3-82c2-406eeb0de950 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:27.056897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2ba4dfc-6104-4cf3-82c2-406eeb0de950 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:27.057346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2ba4dfc-6104-4cf3-82c2-406eeb0de950 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:27.057762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2ba4dfc-6104-4cf3-82c2-406eeb0de950 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:27.131635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a2ba4dfc-6104-4cf3-82c2-406eeb0de950 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:27.139744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a2ba4dfc-6104-4cf3-82c2-406eeb0de950 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.096139 Aug 24 05:05:27.140308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 418/734] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:27 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:28.161310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-09908a5a-c75c-4614-b221-a58e2ad8d1e2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:28.162038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-09908a5a-c75c-4614-b221-a58e2ad8d1e2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:28.168537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09908a5a-c75c-4614-b221-a58e2ad8d1e2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.169019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09908a5a-c75c-4614-b221-a58e2ad8d1e2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.169452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09908a5a-c75c-4614-b221-a58e2ad8d1e2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.170131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09908a5a-c75c-4614-b221-a58e2ad8d1e2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:28.170582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09908a5a-c75c-4614-b221-a58e2ad8d1e2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:28.171291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09908a5a-c75c-4614-b221-a58e2ad8d1e2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:28.235983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-09908a5a-c75c-4614-b221-a58e2ad8d1e2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:28.244454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-09908a5a-c75c-4614-b221-a58e2ad8d1e2 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.087061 Aug 24 05:05:28.245009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 419/735] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:28 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:29.265565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1e57ec15-7a8f-436f-a178-d62101e36a0b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:29.266279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1e57ec15-7a8f-436f-a178-d62101e36a0b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:29.273320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e57ec15-7a8f-436f-a178-d62101e36a0b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:29.273795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e57ec15-7a8f-436f-a178-d62101e36a0b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:29.274317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e57ec15-7a8f-436f-a178-d62101e36a0b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:29.275030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e57ec15-7a8f-436f-a178-d62101e36a0b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:29.275479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e57ec15-7a8f-436f-a178-d62101e36a0b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:29.275896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e57ec15-7a8f-436f-a178-d62101e36a0b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:29.343463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1e57ec15-7a8f-436f-a178-d62101e36a0b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:29.351376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1e57ec15-7a8f-436f-a178-d62101e36a0b tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.089696 Aug 24 05:05:29.351951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 420/736] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:29 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:30.371910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-04505637-e5c6-401c-b13d-8d57d12c3acb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:30.372590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-04505637-e5c6-401c-b13d-8d57d12c3acb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:30.378912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-04505637-e5c6-401c-b13d-8d57d12c3acb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:30.379392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-04505637-e5c6-401c-b13d-8d57d12c3acb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:30.379829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-04505637-e5c6-401c-b13d-8d57d12c3acb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:30.380508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-04505637-e5c6-401c-b13d-8d57d12c3acb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:30.381633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-04505637-e5c6-401c-b13d-8d57d12c3acb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:30.382164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-04505637-e5c6-401c-b13d-8d57d12c3acb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:30.445775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-04505637-e5c6-401c-b13d-8d57d12c3acb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:30.453421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-04505637-e5c6-401c-b13d-8d57d12c3acb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085402 Aug 24 05:05:30.453970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 421/737] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:30 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:31.473419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-56140fec-163d-4cbb-8845-33237620cedc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:31.474090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-56140fec-163d-4cbb-8845-33237620cedc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:31.476500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=54 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:31.481861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56140fec-163d-4cbb-8845-33237620cedc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.482336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56140fec-163d-4cbb-8845-33237620cedc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.482791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56140fec-163d-4cbb-8845-33237620cedc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.483514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56140fec-163d-4cbb-8845-33237620cedc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:31.483994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56140fec-163d-4cbb-8845-33237620cedc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:31.484425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56140fec-163d-4cbb-8845-33237620cedc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:31.547367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-56140fec-163d-4cbb-8845-33237620cedc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:31.555865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-56140fec-163d-4cbb-8845-33237620cedc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.086281 Aug 24 05:05:31.556425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 422/738] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:31 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:32.577222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9d23a5f4-2bd3-4b3c-9f78-1ae640eabceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:32.577934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9d23a5f4-2bd3-4b3c-9f78-1ae640eabceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:32.584469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d23a5f4-2bd3-4b3c-9f78-1ae640eabceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:32.584946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d23a5f4-2bd3-4b3c-9f78-1ae640eabceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:32.585374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d23a5f4-2bd3-4b3c-9f78-1ae640eabceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:32.586079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d23a5f4-2bd3-4b3c-9f78-1ae640eabceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:32.586526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d23a5f4-2bd3-4b3c-9f78-1ae640eabceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:32.586979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d23a5f4-2bd3-4b3c-9f78-1ae640eabceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:32.650645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9d23a5f4-2bd3-4b3c-9f78-1ae640eabceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:32.658355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9d23a5f4-2bd3-4b3c-9f78-1ae640eabceb tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085031 Aug 24 05:05:32.658950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 423/739] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:32 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:33.680813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-47a25c58-e1ce-49db-827a-3f02d29633fc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:33.681573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-47a25c58-e1ce-49db-827a-3f02d29633fc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:33.687995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a25c58-e1ce-49db-827a-3f02d29633fc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:33.688478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a25c58-e1ce-49db-827a-3f02d29633fc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:33.688960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a25c58-e1ce-49db-827a-3f02d29633fc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:33.689701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a25c58-e1ce-49db-827a-3f02d29633fc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:33.690202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a25c58-e1ce-49db-827a-3f02d29633fc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:33.690624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a25c58-e1ce-49db-827a-3f02d29633fc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:33.753644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-47a25c58-e1ce-49db-827a-3f02d29633fc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:33.762277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-47a25c58-e1ce-49db-827a-3f02d29633fc tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.085926 Aug 24 05:05:33.762874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 424/740] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:33 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:34.782279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b83e2e46-67e6-4e41-af9c-c5e032fc76cd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:34.782936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b83e2e46-67e6-4e41-af9c-c5e032fc76cd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:34.790647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83e2e46-67e6-4e41-af9c-c5e032fc76cd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.791161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83e2e46-67e6-4e41-af9c-c5e032fc76cd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.791598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83e2e46-67e6-4e41-af9c-c5e032fc76cd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.792285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83e2e46-67e6-4e41-af9c-c5e032fc76cd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:34.792740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83e2e46-67e6-4e41-af9c-c5e032fc76cd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:34.793161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83e2e46-67e6-4e41-af9c-c5e032fc76cd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:34.855025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b83e2e46-67e6-4e41-af9c-c5e032fc76cd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:05:34.862901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b83e2e46-67e6-4e41-af9c-c5e032fc76cd tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.084425 Aug 24 05:05:34.863456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 425/741] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:05:34 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:05:35.451351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:05:35.451832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:05:35.457833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:35.458327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:35.459366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:35.460053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:05:35.460487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:05:35.460899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:05:45.456134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=9 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:45.479191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=57 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:01.109868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:06:01.110493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:06:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 (ip 10.222.0.97) !!! Aug 24 05:06:08.664413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:06:08.665067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:06:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 (ip 10.222.0.97) !!! Aug 24 05:06:35.553150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-4d372b03-bf8e-4189-b56f-f16f14802181 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'services' on Instance uuid d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:06:35.652372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'services' on Instance uuid d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:06:45.594941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=4 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:45.657987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=4 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:26.707537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:07:26.708177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:07:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 (ip 10.222.0.97) !!! Aug 24 05:07:40.578918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:07:40.579559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:07:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 (ip 10.222.0.97) !!! Aug 24 05:07:43.623777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:07:43.624411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:07:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 (ip 10.222.0.97) !!! Aug 24 05:07:46.101621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:07:46.102160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:07:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 (ip 10.222.0.97) !!! Aug 24 05:08:35.820544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4d372b03-bf8e-4189-b56f-f16f14802181 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818" status: 202 len: 0 microversion: 2.1 time: 240.432352 Aug 24 05:08:35.828290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 317/742] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:04:35 2022] DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 => generated 0 bytes in 240435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:08:35.832442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-831ffcef-bff4-4ab9-8cf6-e4e184fb757e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:35.833841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-831ffcef-bff4-4ab9-8cf6-e4e184fb757e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:35.842534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dfd5b996-c529-44f9-908e-1c2d92fafb09) Aug 24 05:08:35.845417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-831ffcef-bff4-4ab9-8cf6-e4e184fb757e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 HTTP/1.1 Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:08:35.845991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:08:35.847756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:08:35.847756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:08:35.847756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:08:35.847756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:08:35.847756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:08:35.847756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:08:35.847756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:08:35.847756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:08:35.847756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:08:35.847756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dfd5b996-c529-44f9-908e-1c2d92fafb09) Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'server_id': 'd0463d0c-9ee3-4f76-91c6-2fcbdfb55053', 'id': '0cda133e-f89a-444c-bfa5-9a4d23378818'} Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:08:35.848378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dfd5b996-c529-44f9-908e-1c2d92fafb09) Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:08:35.850769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dfd5b996-c529-44f9-908e-1c2d92fafb09) Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:35.853619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dfd5b996-c529-44f9-908e-1c2d92fafb09) Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:08:35.855149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dfd5b996-c529-44f9-908e-1c2d92fafb09) Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dfd5b996-c529-44f9-908e-1c2d92fafb09) Aug 24 05:08:35.856926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:08:35.858194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-831ffcef-bff4-4ab9-8cf6-e4e184fb757e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:35.858194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-831ffcef-bff4-4ab9-8cf6-e4e184fb757e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:35.858194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-831ffcef-bff4-4ab9-8cf6-e4e184fb757e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:35.858194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-831ffcef-bff4-4ab9-8cf6-e4e184fb757e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:35.858572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-831ffcef-bff4-4ab9-8cf6-e4e184fb757e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:35.861739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-dfd5b996-c529-44f9-908e-1c2d92fafb09) {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:08:35.861739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7b1ee145-ff38-462c-bfb1-1598e8e2d7e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818" status: 400 len: 269 microversion: 2.1 time: 180.413619 Aug 24 05:08:35.864618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 426/743] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:05:35 2022] DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 => generated 269 bytes in 180418 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 05:08:35.893498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:35.894534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:35.906036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:35.906889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:35.908314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:35.909365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:35.909980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:35.911037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:35.946855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-831ffcef-bff4-4ab9-8cf6-e4e184fb757e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:08:35.956848 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-831ffcef-bff4-4ab9-8cf6-e4e184fb757e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1224 microversion: 2.1 time: 0.132975 Aug 24 05:08:35.957426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 318/744] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:08:35 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1224 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:08:36.047128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b96bf890-036c-4107-a253-19b160399096 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:08:36.047616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b96bf890-036c-4107-a253-19b160399096 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:08:36.054380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b96bf890-036c-4107-a253-19b160399096 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:36.054907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b96bf890-036c-4107-a253-19b160399096 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:36.055340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b96bf890-036c-4107-a253-19b160399096 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:36.056040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b96bf890-036c-4107-a253-19b160399096 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:08:36.056488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b96bf890-036c-4107-a253-19b160399096 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:08:36.056903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b96bf890-036c-4107-a253-19b160399096 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:08:45.905959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:45.940492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=4 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:46.051900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=4 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:46.077592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:21.118946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:09:21.118946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:09:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700 (ip 10.222.0.97) !!! Aug 24 05:09:28.674730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:09:28.675417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:09:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 (ip 10.222.0.97) !!! Aug 24 05:10:36.178394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'services' on Instance uuid d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:36.197290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-b96bf890-036c-4107-a253-19b160399096 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lazy-loading 'services' on Instance uuid 61f9cc46-e608-4e87-8a41-cbd6058576a0 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:36.292950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb4249d5-d299-46dc-8cfd-954f9c0565d8) Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 HTTP/1.1 Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:10:36.295427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:10:36.297334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:36.297334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:36.297334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:10:36.297334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:36.297334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:10:36.297334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:10:36.297334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:10:36.297334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:10:36.297334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:10:36.297334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb4249d5-d299-46dc-8cfd-954f9c0565d8) Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'server_id': 'd0463d0c-9ee3-4f76-91c6-2fcbdfb55053', 'id': '0cda133e-f89a-444c-bfa5-9a4d23378818'} Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:36.297953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb4249d5-d299-46dc-8cfd-954f9c0565d8) Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:36.299064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb4249d5-d299-46dc-8cfd-954f9c0565d8) Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.300446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb4249d5-d299-46dc-8cfd-954f9c0565d8) Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.301402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb4249d5-d299-46dc-8cfd-954f9c0565d8) Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb4249d5-d299-46dc-8cfd-954f9c0565d8) Aug 24 05:10:36.302466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.306214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-eb4249d5-d299-46dc-8cfd-954f9c0565d8) {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:36.306214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5f532857-45a7-425f-92ec-22526168a363 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818" status: 400 len: 269 microversion: 2.1 time: 120.430945 Aug 24 05:10:36.306214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 427/745] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:08:35 2022] DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 => generated 269 bytes in 120432 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:10:36.347502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b96bf890-036c-4107-a253-19b160399096 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700" status: 202 len: 0 microversion: 2.1 time: 120.388390 Aug 24 05:10:36.348208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 319/746] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:08:35 2022] DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700 => generated 0 bytes in 120390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:10:36.354771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.355472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.361785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.362275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.362719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.363405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.363850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.364268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.397344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.397862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.398306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.399614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lazy-loading 'fault' on Instance uuid 5bf50e90-6712-4e3e-b813-653bfe69d460 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:36.444828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:36.447189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.447686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.453766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.454252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.454615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c0721178-a390-4c39-b2b4-9e9ed8f60e2c tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1229 microversion: 2.1 time: 0.105062 Aug 24 05:10:36.454762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.455232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 320/747] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:36 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:36.455394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.455840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.456261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.460038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.460788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.467572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.468057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.468525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.469375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.469828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.470252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.549965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] HTTP exception thrown: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Request method failure captured: Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e HTTP/1.1 Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa7vgEWxIH4xlLamu9K66ml8YuLDEp_YQA2qs7UtL-6Z69FWBvRKKNvJInfMymaPcGe2WBDYhavc6QIMajs2OFq6W5mcvXNzykLs7D4t7A3-UF_eNDqrK1uKmrHM8wulHTZatXbcXJ79hUK7zHBY0hq-oxViEgUTqYJZWbuPL5XRyfU Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:10:36.551604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3c309287c4964e60a66398d9841b9c29", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 246605916c884dfab9aa75297e358d6f Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:10:36.552913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'server_id': '246c7f17-b6b8-470f-aa27-f23cac6e0df5', 'id': 'ff376299-7da9-46be-a490-9646a192e88e'} Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:36.553587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.555452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Returning 409 to user: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:36.557083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f0933d01-c1c0-4fd9-bf34-a44e68e695cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e" status: 409 len: 152 microversion: 2.1 time: 0.254344 Aug 24 05:10:36.557083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 428/748] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:36 2022] DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e => generated 152 bytes in 255 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:10:36.557235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'services' on Instance uuid d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:36.562632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.563155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.569292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.569766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.570214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.571832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.573078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.573078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.618395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a197cb21-1794-403b-8af5-58a58c92cb5e) Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 HTTP/1.1 Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:36.620762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:36.622308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:36.622308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:36.622308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:10:36.622308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:36.622308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:10:36.622308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:36.622308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:36.622308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:10:36.622308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:10:36.622308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a197cb21-1794-403b-8af5-58a58c92cb5e) Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'server_id': 'd0463d0c-9ee3-4f76-91c6-2fcbdfb55053', 'id': '0cda133e-f89a-444c-bfa5-9a4d23378818'} Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:36.622951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a197cb21-1794-403b-8af5-58a58c92cb5e) Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:36.623918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a197cb21-1794-403b-8af5-58a58c92cb5e) Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.625716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a197cb21-1794-403b-8af5-58a58c92cb5e) Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.627674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a197cb21-1794-403b-8af5-58a58c92cb5e) Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a197cb21-1794-403b-8af5-58a58c92cb5e) Aug 24 05:10:36.629966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.632421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a197cb21-1794-403b-8af5-58a58c92cb5e) {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:36.632421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5d23c5e0-0fcf-4901-9f17-f8066a410ab5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818" status: 400 len: 269 microversion: 2.1 time: 0.166373 Aug 24 05:10:36.632421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 321/749] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:36 2022] DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 => generated 269 bytes in 168 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:10:36.632421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.633823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.637166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.637657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.638086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.638808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.639259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.639676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.658024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lazy-loading 'services' on Instance uuid 61f9cc46-e608-4e87-8a41-cbd6058576a0 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:36.720224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23e933d7-363c-4fd7-8e80-9f632ff02d11) Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Request method failure captured: Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700 HTTP/1.1 Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa-xlX3G9LOFLr04Nwqz1haUhntNT1pzMDR4l37h-gUPSUg5pKaGXY1S3amAlCumK0pZYXWtygIusHjy4Ul-5gGjluXdok-RTmzF0zHWk17MrZ9KqcVOfOOJvT-LSx9LJBY1bL9FaeCpYehvxCR9gaRyiedmGVR-uc6aR6VIx92F6aA Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 3b37fd4d710b4a7ba471c224324d2a87 Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:10:36.722421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:10:36.724362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3b37fd4d710b4a7ba471c224324d2a87", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:36.724362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:36.724362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 3b37fd4d710b4a7ba471c224324d2a87 Aug 24 05:10:36.724362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:36.724362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-VolumesSnapshotTestJSON-2011091351-project Aug 24 05:10:36.724362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:10:36.724362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:10:36.724362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: fde5a0eecb8d411c82238c1ac3d4c0f1 Aug 24 05:10:36.724362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-VolumesSnapshotTestJSON-2011091351-project Aug 24 05:10:36.724362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23e933d7-363c-4fd7-8e80-9f632ff02d11) Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'server_id': '61f9cc46-e608-4e87-8a41-cbd6058576a0', 'id': '70782f84-5eb0-4648-bf74-8cc7d1972700'} Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:36.725375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23e933d7-363c-4fd7-8e80-9f632ff02d11) Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:36.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23e933d7-363c-4fd7-8e80-9f632ff02d11) Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.728057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23e933d7-363c-4fd7-8e80-9f632ff02d11) Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.729350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23e933d7-363c-4fd7-8e80-9f632ff02d11) Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23e933d7-363c-4fd7-8e80-9f632ff02d11) Aug 24 05:10:36.730679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.731946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-23e933d7-363c-4fd7-8e80-9f632ff02d11) {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:36.731946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4b606016-b23e-480c-a8e5-48739f465f38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700" status: 400 len: 269 microversion: 2.1 time: 0.169430 Aug 24 05:10:36.731946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 429/750] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:36 2022] DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700 => generated 269 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:10:36.731946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.732285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.734377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] HTTP exception thrown: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Request method failure captured: Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e HTTP/1.1 Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7vgEWxIH4xlLamu9K66ml8YuLDEp_YQA2qs7UtL-6Z69FWBvRKKNvJInfMymaPcGe2WBDYhavc6QIMajs2OFq6W5mcvXNzykLs7D4t7A3-UF_eNDqrK1uKmrHM8wulHTZatXbcXJ79hUK7zHBY0hq-oxViEgUTqYJZWbuPL5XRyfU Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:36.736736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3c309287c4964e60a66398d9841b9c29", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 246605916c884dfab9aa75297e358d6f Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:36.738311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'server_id': '246c7f17-b6b8-470f-aa27-f23cac6e0df5', 'id': 'ff376299-7da9-46be-a490-9646a192e88e'} Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:36.739325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.740904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Returning 409 to user: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:36.742876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-19dfaac6-8b1b-4dbc-8452-71304ded5da1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e" status: 409 len: 152 microversion: 2.1 time: 0.113272 Aug 24 05:10:36.742876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 322/751] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:36 2022] DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e => generated 152 bytes in 114 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:10:36.743211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.743889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.744365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.744784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.745080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.745275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.745536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.745965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.752891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.753379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.753823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.754547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.755026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.755446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.780654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.781125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.781554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.781989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lazy-loading 'fault' on Instance uuid 5bf50e90-6712-4e3e-b813-653bfe69d460 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:36.826108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:36.834077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4be9f6ec-6b76-434f-b793-c5de65e7e81f tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1229 microversion: 2.1 time: 0.108274 Aug 24 05:10:36.834674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 430/752] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:36 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:36.840318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.840809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.846838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.847324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.847521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'services' on Instance uuid d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:36.847752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.848444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.848891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.849308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.907438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-96ca526b-1120-49bb-acf1-2850abd7e8a6) Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 HTTP/1.1 Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:36.909853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:36.911479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:36.911479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:36.911479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:10:36.911479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:36.911479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:10:36.911479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:36.911479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:36.911479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:10:36.911479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:10:36.911479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-96ca526b-1120-49bb-acf1-2850abd7e8a6) Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'server_id': 'd0463d0c-9ee3-4f76-91c6-2fcbdfb55053', 'id': '0cda133e-f89a-444c-bfa5-9a4d23378818'} Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:36.912216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-96ca526b-1120-49bb-acf1-2850abd7e8a6) Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:36.913438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-96ca526b-1120-49bb-acf1-2850abd7e8a6) Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.915358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-96ca526b-1120-49bb-acf1-2850abd7e8a6) Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.916759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-96ca526b-1120-49bb-acf1-2850abd7e8a6) Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-96ca526b-1120-49bb-acf1-2850abd7e8a6) Aug 24 05:10:36.918029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:36.927247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-96ca526b-1120-49bb-acf1-2850abd7e8a6) {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:36.928190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-966a99c2-70ab-4704-a150-65b668c6122b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818" status: 400 len: 269 microversion: 2.1 time: 0.188384 Aug 24 05:10:36.928759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 323/753] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:36 2022] DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 => generated 269 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:10:36.941259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:36.942546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:36.944777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lazy-loading 'services' on Instance uuid 61f9cc46-e608-4e87-8a41-cbd6058576a0 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:36.950233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.951008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.951448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:36.952153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:36.952602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:36.953020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.023547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e8f0524-0f9b-4871-b3e0-2aacfc64572d) Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Request method failure captured: Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700 HTTP/1.1 Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa-xlX3G9LOFLr04Nwqz1haUhntNT1pzMDR4l37h-gUPSUg5pKaGXY1S3amAlCumK0pZYXWtygIusHjy4Ul-5gGjluXdok-RTmzF0zHWk17MrZ9KqcVOfOOJvT-LSx9LJBY1bL9FaeCpYehvxCR9gaRyiedmGVR-uc6aR6VIx92F6aA Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 3b37fd4d710b4a7ba471c224324d2a87 Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:10:37.027424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:10:37.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3b37fd4d710b4a7ba471c224324d2a87", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:37.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:37.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 3b37fd4d710b4a7ba471c224324d2a87 Aug 24 05:10:37.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:37.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-VolumesSnapshotTestJSON-2011091351-project Aug 24 05:10:37.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:10:37.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:10:37.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: fde5a0eecb8d411c82238c1ac3d4c0f1 Aug 24 05:10:37.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-VolumesSnapshotTestJSON-2011091351-project Aug 24 05:10:37.028770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e8f0524-0f9b-4871-b3e0-2aacfc64572d) Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'server_id': '61f9cc46-e608-4e87-8a41-cbd6058576a0', 'id': '70782f84-5eb0-4648-bf74-8cc7d1972700'} Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:37.029565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e8f0524-0f9b-4871-b3e0-2aacfc64572d) Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:37.030646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e8f0524-0f9b-4871-b3e0-2aacfc64572d) Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.032934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e8f0524-0f9b-4871-b3e0-2aacfc64572d) Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.034134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e8f0524-0f9b-4871-b3e0-2aacfc64572d) Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e8f0524-0f9b-4871-b3e0-2aacfc64572d) Aug 24 05:10:37.035787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.039063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8e8f0524-0f9b-4871-b3e0-2aacfc64572d) {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:37.039063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-996a4b7d-5811-4a32-9ecf-3d666801118c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700" status: 400 len: 269 microversion: 2.1 time: 0.192822 Aug 24 05:10:37.039063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 431/754] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:36 2022] DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700 => generated 269 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:10:37.043114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.043813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.061620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.061620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.061620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.061620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.062228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] HTTP exception thrown: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.062374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.062374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Request method failure captured: Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e HTTP/1.1 Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7vgEWxIH4xlLamu9K66ml8YuLDEp_YQA2qs7UtL-6Z69FWBvRKKNvJInfMymaPcGe2WBDYhavc6QIMajs2OFq6W5mcvXNzykLs7D4t7A3-UF_eNDqrK1uKmrHM8wulHTZatXbcXJ79hUK7zHBY0hq-oxViEgUTqYJZWbuPL5XRyfU Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:37.063746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3c309287c4964e60a66398d9841b9c29", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 246605916c884dfab9aa75297e358d6f Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:37.066080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'server_id': '246c7f17-b6b8-470f-aa27-f23cac6e0df5', 'id': 'ff376299-7da9-46be-a490-9646a192e88e'} Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:37.067660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.070382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Returning 409 to user: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:37.072668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a9bd09f2-c119-43d1-bf1f-febae5dd67d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e" status: 409 len: 152 microversion: 2.1 time: 0.133003 Aug 24 05:10:37.072668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 324/755] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:36 2022] DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:10:37.073702 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.074180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.080262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.081432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.081899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.082625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.083123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.083574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.109882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.112081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.112695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.113302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lazy-loading 'fault' on Instance uuid 5bf50e90-6712-4e3e-b813-653bfe69d460 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:37.171272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81f88a5d0ffe4c5abd85cdfc19d18694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa96f5af1de4cf5a59cdca9c785db52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:10:37.179423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c5e3a62d-44fa-45fa-b0bc-3633a503a62e tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 200 len: 1183 microversion: 2.1 time: 0.148648 Aug 24 05:10:37.180858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 432/756] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:37 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 1183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:10:37.186215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.186379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'services' on Instance uuid d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:37.188426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.193362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.193849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.194327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.195784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.196364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.197084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.248646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0edf94c-6cb5-4963-bca5-d76cf6c82f66) Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 HTTP/1.1 Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:37.251436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:37.254244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:37.254244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:37.254244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:10:37.254244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:37.254244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:10:37.254244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:37.254244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:37.254244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:10:37.254244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:10:37.254244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0edf94c-6cb5-4963-bca5-d76cf6c82f66) Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'server_id': 'd0463d0c-9ee3-4f76-91c6-2fcbdfb55053', 'id': '0cda133e-f89a-444c-bfa5-9a4d23378818'} Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:37.256524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0edf94c-6cb5-4963-bca5-d76cf6c82f66) Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:37.261773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0edf94c-6cb5-4963-bca5-d76cf6c82f66) Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0edf94c-6cb5-4963-bca5-d76cf6c82f66) Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.266644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0edf94c-6cb5-4963-bca5-d76cf6c82f66) Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0edf94c-6cb5-4963-bca5-d76cf6c82f66) Aug 24 05:10:37.269256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.271797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0edf94c-6cb5-4963-bca5-d76cf6c82f66) {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:37.271797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dccec64c-a58d-41bb-8892-28f5b2992896 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818" status: 400 len: 269 microversion: 2.1 time: 0.183706 Aug 24 05:10:37.271797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 325/757] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:37 2022] DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 => generated 269 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:10:37.271797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.272631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.274625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.275333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.275859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.276653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.277204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.277718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.308827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lazy-loading 'services' on Instance uuid 61f9cc46-e608-4e87-8a41-cbd6058576a0 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:37.368937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] HTTP exception thrown: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Request method failure captured: Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e HTTP/1.1 Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7vgEWxIH4xlLamu9K66ml8YuLDEp_YQA2qs7UtL-6Z69FWBvRKKNvJInfMymaPcGe2WBDYhavc6QIMajs2OFq6W5mcvXNzykLs7D4t7A3-UF_eNDqrK1uKmrHM8wulHTZatXbcXJ79hUK7zHBY0hq-oxViEgUTqYJZWbuPL5XRyfU Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:37.370519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3c309287c4964e60a66398d9841b9c29", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 246605916c884dfab9aa75297e358d6f Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:37.372036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'server_id': '246c7f17-b6b8-470f-aa27-f23cac6e0df5', 'id': 'ff376299-7da9-46be-a490-9646a192e88e'} Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:37.372857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.374363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Returning 409 to user: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:37.375602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1ca74450-affe-4daa-8708-05e9ca3816c4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e" status: 409 len: 152 microversion: 2.1 time: 0.115762 Aug 24 05:10:37.375602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 326/758] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:37 2022] DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e => generated 152 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:10:37.376911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.377513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.385971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.385971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.387112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.387775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.388392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.388852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.403500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f781126-13ac-451e-b7fa-700ded326e3b) Aug 24 05:10:37.404241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] HTTP exception thrown: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Request method failure captured: Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 HTTP/1.1 Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa9RHl7bSbeVQ_nUfbl45q14zFjaSy56fjn7_XABDHdYOF-09VkCdozH_ri4eZvwgO-kRJPCVlkFDJ12yjonHilvEFWnNAPkjzsMRuYcZuD6jARFuamqtjl3sIuywQ2bJavswpJdnqY-hKlfcivuCD94Zn2rmX_kS0HF1Ja02qcI6dQ Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: aaa96f5af1de4cf5a59cdca9c785db52 Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:37.405834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_aaa96f5af1de4cf5a59cdca9c785db52", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: aaa96f5af1de4cf5a59cdca9c785db52 Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-TestVolumeBootPattern-160960211-project Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 81f88a5d0ffe4c5abd85cdfc19d18694 Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-TestVolumeBootPattern-160960211-project Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:37.407482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '5bf50e90-6712-4e3e-b813-653bfe69d460'} Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:37.408353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:37.409762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.411672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Returning 404 to user: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Request method failure captured: Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700 HTTP/1.1 Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa-xlX3G9LOFLr04Nwqz1haUhntNT1pzMDR4l37h-gUPSUg5pKaGXY1S3amAlCumK0pZYXWtygIusHjy4Ul-5gGjluXdok-RTmzF0zHWk17MrZ9KqcVOfOOJvT-LSx9LJBY1bL9FaeCpYehvxCR9gaRyiedmGVR-uc6aR6VIx92F6aA Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 3b37fd4d710b4a7ba471c224324d2a87 Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:10:37.411815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:10:37.415180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3b37fd4d710b4a7ba471c224324d2a87", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:37.415180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:37.415180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 3b37fd4d710b4a7ba471c224324d2a87 Aug 24 05:10:37.415180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:37.415180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-VolumesSnapshotTestJSON-2011091351-project Aug 24 05:10:37.415180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:10:37.415180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:10:37.415180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: fde5a0eecb8d411c82238c1ac3d4c0f1 Aug 24 05:10:37.415180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-VolumesSnapshotTestJSON-2011091351-project Aug 24 05:10:37.415180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f781126-13ac-451e-b7fa-700ded326e3b) Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'server_id': '61f9cc46-e608-4e87-8a41-cbd6058576a0', 'id': '70782f84-5eb0-4648-bf74-8cc7d1972700'} Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:37.416312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f781126-13ac-451e-b7fa-700ded326e3b) Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:37.418277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f781126-13ac-451e-b7fa-700ded326e3b) Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.420697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f781126-13ac-451e-b7fa-700ded326e3b) Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.422670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f781126-13ac-451e-b7fa-700ded326e3b) Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f781126-13ac-451e-b7fa-700ded326e3b) Aug 24 05:10:37.424962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.426760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5e118b10-1678-4482-a2ad-9a9f6b052d5d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 404 len: 111 microversion: 2.1 time: 0.033889 Aug 24 05:10:37.426853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5f781126-13ac-451e-b7fa-700ded326e3b) {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:37.426955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 327/759] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:37 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:37.427035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7bfea7b2-bf8e-4d9b-b5ce-d56d708d22dc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700" status: 400 len: 269 microversion: 2.1 time: 0.226995 Aug 24 05:10:37.427035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 433/760] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:37 2022] DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700 => generated 269 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:10:37.427172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.427172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.427323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.427323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.427480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.427480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.427480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.427480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.427759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.427759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.428328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.429116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.429591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.431139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.431830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.432368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.510639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'services' on Instance uuid d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:37.552863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lazy-loading 'services' on Instance uuid 61f9cc46-e608-4e87-8a41-cbd6058576a0 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:10:37.586217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b9e2fd-c2f4-4391-8f89-9a460782e152) Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 HTTP/1.1 Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:37.588407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:37.589977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:37.589977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:37.589977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:10:37.589977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:10:37.589977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:10:37.589977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:37.589977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:37.589977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:10:37.589977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:10:37.589977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b9e2fd-c2f4-4391-8f89-9a460782e152) Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'server_id': 'd0463d0c-9ee3-4f76-91c6-2fcbdfb55053', 'id': '0cda133e-f89a-444c-bfa5-9a4d23378818'} Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:37.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b9e2fd-c2f4-4391-8f89-9a460782e152) Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:37.591939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b9e2fd-c2f4-4391-8f89-9a460782e152) Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.593091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b9e2fd-c2f4-4391-8f89-9a460782e152) Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.594063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b9e2fd-c2f4-4391-8f89-9a460782e152) Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b9e2fd-c2f4-4391-8f89-9a460782e152) Aug 24 05:10:37.595520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.596636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a5b9e2fd-c2f4-4391-8f89-9a460782e152) {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:37.596636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-86821900-7b5e-4631-9920-f741cc872c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818" status: 400 len: 269 microversion: 2.1 time: 0.180922 Aug 24 05:10:37.596636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 328/761] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:37 2022] DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments/0cda133e-f89a-444c-bfa5-9a4d23378818 => generated 269 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:10:37.596636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.596930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.602399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.602942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.603403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.604093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.604541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.604961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.626902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3882d41e-5450-4cf4-a71f-7bf9c03d2abc) Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Request method failure captured: Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700 HTTP/1.1 Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa-xlX3G9LOFLr04Nwqz1haUhntNT1pzMDR4l37h-gUPSUg5pKaGXY1S3amAlCumK0pZYXWtygIusHjy4Ul-5gGjluXdok-RTmzF0zHWk17MrZ9KqcVOfOOJvT-LSx9LJBY1bL9FaeCpYehvxCR9gaRyiedmGVR-uc6aR6VIx92F6aA Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 3b37fd4d710b4a7ba471c224324d2a87 Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:10:37.629104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:10:37.630443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3b37fd4d710b4a7ba471c224324d2a87", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3b37fd4d710b4a7ba471c224324d2a87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:37.630443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:37.630443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 3b37fd4d710b4a7ba471c224324d2a87 Aug 24 05:10:37.630443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2011091351 Aug 24 05:10:37.630443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-VolumesSnapshotTestJSON-2011091351-project Aug 24 05:10:37.630443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:10:37.630443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:10:37.630443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: fde5a0eecb8d411c82238c1ac3d4c0f1 Aug 24 05:10:37.630443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-VolumesSnapshotTestJSON-2011091351-project Aug 24 05:10:37.630443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3882d41e-5450-4cf4-a71f-7bf9c03d2abc) Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'server_id': '61f9cc46-e608-4e87-8a41-cbd6058576a0', 'id': '70782f84-5eb0-4648-bf74-8cc7d1972700'} Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:37.631124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3882d41e-5450-4cf4-a71f-7bf9c03d2abc) Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5177, in _detach_volume Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:37.632130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3882d41e-5450-4cf4-a71f-7bf9c03d2abc) Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.633904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5199, in detach_volume Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5179, in _detach_volume Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3882d41e-5450-4cf4-a71f-7bf9c03d2abc) Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.634933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3882d41e-5450-4cf4-a71f-7bf9c03d2abc) Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3882d41e-5450-4cf4-a71f-7bf9c03d2abc) Aug 24 05:10:37.636007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.637888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3882d41e-5450-4cf4-a71f-7bf9c03d2abc) {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:37.637888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0132c8c6-f3e6-4def-9004-20d38243934b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700" status: 400 len: 269 microversion: 2.1 time: 0.218618 Aug 24 05:10:37.637888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 434/762] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:37 2022] DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0/os-volume_attachments/70782f84-5eb0-4648-bf74-8cc7d1972700 => generated 269 bytes in 220 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:10:37.637888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.639046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.643156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.643724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.644170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.646280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.646280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.646280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.664903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] HTTP exception thrown: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Request method failure captured: Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 HTTP/1.1 Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa9RHl7bSbeVQ_nUfbl45q14zFjaSy56fjn7_XABDHdYOF-09VkCdozH_ri4eZvwgO-kRJPCVlkFDJ12yjonHilvEFWnNAPkjzsMRuYcZuD6jARFuamqtjl3sIuywQ2bJavswpJdnqY-hKlfcivuCD94Zn2rmX_kS0HF1Ja02qcI6dQ Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: aaa96f5af1de4cf5a59cdca9c785db52 Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:10:37.666708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_aaa96f5af1de4cf5a59cdca9c785db52", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: aaa96f5af1de4cf5a59cdca9c785db52 Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-TestVolumeBootPattern-160960211-project Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 81f88a5d0ffe4c5abd85cdfc19d18694 Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-TestVolumeBootPattern-160960211-project Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:37.668268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '5bf50e90-6712-4e3e-b813-653bfe69d460'} Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:37.669719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:37.672473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.674013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Returning 404 to user: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:37.674013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ffd84dc8-1dbf-4847-8844-aecd94fde188 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 404 len: 111 microversion: 2.1 time: 0.036193 Aug 24 05:10:37.677756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 435/763] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:37 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:37.688849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ff9bdd94-2975-429c-9a80-64cdcad1847b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.693187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ff9bdd94-2975-429c-9a80-64cdcad1847b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.704894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9bdd94-2975-429c-9a80-64cdcad1847b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.704894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9bdd94-2975-429c-9a80-64cdcad1847b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.704894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9bdd94-2975-429c-9a80-64cdcad1847b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.704894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9bdd94-2975-429c-9a80-64cdcad1847b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.705356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9bdd94-2975-429c-9a80-64cdcad1847b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.705356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9bdd94-2975-429c-9a80-64cdcad1847b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.720105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] HTTP exception thrown: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Request method failure captured: Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e HTTP/1.1 Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7vgEWxIH4xlLamu9K66ml8YuLDEp_YQA2qs7UtL-6Z69FWBvRKKNvJInfMymaPcGe2WBDYhavc6QIMajs2OFq6W5mcvXNzykLs7D4t7A3-UF_eNDqrK1uKmrHM8wulHTZatXbcXJ79hUK7zHBY0hq-oxViEgUTqYJZWbuPL5XRyfU Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:37.721866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3c309287c4964e60a66398d9841b9c29", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 246605916c884dfab9aa75297e358d6f Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:37.723459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'server_id': '246c7f17-b6b8-470f-aa27-f23cac6e0df5', 'id': 'ff376299-7da9-46be-a490-9646a192e88e'} Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:37.724248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued Aug 24 05:10:37.725652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:37.728227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Returning 409 to user: Cannot 'detach_volume' instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 while it is in vm_state rescued {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:37.729288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3b152855-8e95-41ed-ac8d-4975f62b0f7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e" status: 409 len: 152 microversion: 2.1 time: 0.137976 Aug 24 05:10:37.730170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 329/764] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:10:37 2022] DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments/ff376299-7da9-46be-a490-9646a192e88e => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 05:10:37.735337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b97f9b69-221b-4ed1-b4fe-4a3f210234a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.738939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b97f9b69-221b-4ed1-b4fe-4a3f210234a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.745872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b97f9b69-221b-4ed1-b4fe-4a3f210234a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.746360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b97f9b69-221b-4ed1-b4fe-4a3f210234a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.746875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b97f9b69-221b-4ed1-b4fe-4a3f210234a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.747643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b97f9b69-221b-4ed1-b4fe-4a3f210234a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.748102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b97f9b69-221b-4ed1-b4fe-4a3f210234a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.748578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b97f9b69-221b-4ed1-b4fe-4a3f210234a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.774142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ff9bdd94-2975-429c-9a80-64cdcad1847b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095199 Aug 24 05:10:37.774727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 436/765] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:37.780036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b23f34aa-0394-48b5-850d-518b7ba8722d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:37.782258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b23f34aa-0394-48b5-850d-518b7ba8722d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:37.788651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b23f34aa-0394-48b5-850d-518b7ba8722d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.789805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b23f34aa-0394-48b5-850d-518b7ba8722d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.790440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b23f34aa-0394-48b5-850d-518b7ba8722d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.791114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b23f34aa-0394-48b5-850d-518b7ba8722d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:37.791571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b23f34aa-0394-48b5-850d-518b7ba8722d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:37.791690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b97f9b69-221b-4ed1-b4fe-4a3f210234a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060024 Aug 24 05:10:37.792028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b23f34aa-0394-48b5-850d-518b7ba8722d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:37.792404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 330/766] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:37.797089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1053898176", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-776612737", "security_groups": [{"name": "tempest-secgroup-smoke-320450797"}], "block_device_mapping_v2": [{"uuid": "48414fe5-1080-49c5-9c4f-bc610759f223", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fe1b453b-00ae-410e-b60c-af6b5d416c32"}]}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:10:37.827576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b23f34aa-0394-48b5-850d-518b7ba8722d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051794 Aug 24 05:10:37.828360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 437/767] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:37.919463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] validate_networks() for [('fe1b453b-00ae-410e-b60c-af6b5d416c32', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:10:38.425803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:10:38.426375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:10:38.426660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:10:38.427088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:10:38.427492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:10:38.436533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.437005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.437426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.438132 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.438574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.439012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.455979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Getting quotas for project aaa96f5af1de4cf5a59cdca9c785db52. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:10:38.459851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Getting quotas for user 81f88a5d0ffe4c5abd85cdfc19d18694 and project aaa96f5af1de4cf5a59cdca9c785db52. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:10:38.521456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:10:38.524361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 6946ceae-8db9-43eb-bae3-4eb63510a44c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='48414fe5-1080-49c5-9c4f-bc610759f223',volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:10:38.595246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume 48414fe5-1080-49c5-9c4f-bc610759f223 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a734f12b-bf58-4972-b25d-eeeb9bb406fc) Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Request method failure captured: Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 476 Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa9RHl7bSbeVQ_nUfbl45q14zFjaSy56fjn7_XABDHdYOF-09VkCdozH_ri4eZvwgO-kRJPCVlkFDJ12yjonHilvEFWnNAPkjzsMRuYcZuD6jARFuamqtjl3sIuywQ2bJavswpJdnqY-hKlfcivuCD94Zn2rmX_kS0HF1Ja02qcI6dQ Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: aaa96f5af1de4cf5a59cdca9c785db52 Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:38.598585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:38.600181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_aaa96f5af1de4cf5a59cdca9c785db52", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:38.600181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:38.600181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: aaa96f5af1de4cf5a59cdca9c785db52 Aug 24 05:10:38.600181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:38.600181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-TestVolumeBootPattern-160960211-project Aug 24 05:10:38.600181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:38.600181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:38.600181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 81f88a5d0ffe4c5abd85cdfc19d18694 Aug 24 05:10:38.600181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-TestVolumeBootPattern-160960211-project Aug 24 05:10:38.600181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Aug 24 05:10:38.600919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1053898176", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-776612737", "security_groups": [{"name": "tempest-secgroup-smoke-320450797"}], "block_device_mapping_v2": [{"uuid": "48414fe5-1080-49c5-9c4f-bc610759f223", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fe1b453b-00ae-410e-b60c-af6b5d416c32"}]}} Aug 24 05:10:38.600919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:38.600919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Invalid volume: Invalid input received: Invalid volume: Volume 48414fe5-1080-49c5-9c4f-bc610759f223 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a734f12b-bf58-4972-b25d-eeeb9bb406fc) Aug 24 05:10:38.600919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1053898176', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-776612737', 'security_groups': [{'name': 'tempest-secgroup-smoke-320450797'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': '48414fe5-1080-49c5-9c4f-bc610759f223'}], 'networks': [{'uuid': 'fe1b453b-00ae-410e-b60c-af6b5d416c32'}]}}} Aug 24 05:10:38.600919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:38.600919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:38.600919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:38.600919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:38.600919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:38.600919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:38.602193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume 48414fe5-1080-49c5-9c4f-bc610759f223 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a734f12b-bf58-4972-b25d-eeeb9bb406fc) Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1958, in _validate_bdm Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4986, in _check_attach_and_reserve_volume Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:10:38.603604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Aug 24 05:10:38.604929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume 48414fe5-1080-49c5-9c4f-bc610759f223 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a734f12b-bf58-4972-b25d-eeeb9bb406fc) Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1537, in _provision_instances Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 05:10:38.606232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise self.value Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1447, in _provision_instances Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1853, in _bdm_validate_set_size_and_instance Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self._validate_bdm( Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1967, in _validate_bdm Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume 48414fe5-1080-49c5-9c4f-bc610759f223 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a734f12b-bf58-4972-b25d-eeeb9bb406fc) Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:38.607600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume 48414fe5-1080-49c5-9c4f-bc610759f223 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a734f12b-bf58-4972-b25d-eeeb9bb406fc) Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:38.608901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:38.610255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume 48414fe5-1080-49c5-9c4f-bc610759f223 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a734f12b-bf58-4972-b25d-eeeb9bb406fc) Aug 24 05:10:38.610255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:38.610255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume 48414fe5-1080-49c5-9c4f-bc610759f223 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-a734f12b-bf58-4972-b25d-eeeb9bb406fc) {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:38.610255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dfd66d95-7f59-469b-8aaf-4fef7dc9acaa tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 0.806690 Aug 24 05:10:38.610255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 331/768] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 05:10:37 2022] POST /compute/v2.1/servers => generated 295 bytes in 808 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:10:38.786375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3f604c35-55b5-4e09-a234-7fa70bb34880 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:38.789027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3f604c35-55b5-4e09-a234-7fa70bb34880 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:38.797155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f604c35-55b5-4e09-a234-7fa70bb34880 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.797636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f604c35-55b5-4e09-a234-7fa70bb34880 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.798072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f604c35-55b5-4e09-a234-7fa70bb34880 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.798785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f604c35-55b5-4e09-a234-7fa70bb34880 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.799705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f604c35-55b5-4e09-a234-7fa70bb34880 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.800387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f604c35-55b5-4e09-a234-7fa70bb34880 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.809303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7e2da940-9522-4130-995f-4c0cdbccb5b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:38.812345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7e2da940-9522-4130-995f-4c0cdbccb5b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:38.833562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2da940-9522-4130-995f-4c0cdbccb5b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.836691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3f604c35-55b5-4e09-a234-7fa70bb34880 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054363 Aug 24 05:10:38.837386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 438/769] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:38.841232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2da940-9522-4130-995f-4c0cdbccb5b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.841751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2da940-9522-4130-995f-4c0cdbccb5b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.842257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-54769d9e-e03a-4418-8ba1-6659a962a9d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:38.842503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2da940-9522-4130-995f-4c0cdbccb5b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.843004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2da940-9522-4130-995f-4c0cdbccb5b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.843437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2da940-9522-4130-995f-4c0cdbccb5b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.844377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-54769d9e-e03a-4418-8ba1-6659a962a9d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:38.852413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54769d9e-e03a-4418-8ba1-6659a962a9d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.852901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54769d9e-e03a-4418-8ba1-6659a962a9d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.853517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54769d9e-e03a-4418-8ba1-6659a962a9d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.854220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54769d9e-e03a-4418-8ba1-6659a962a9d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:38.854668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54769d9e-e03a-4418-8ba1-6659a962a9d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:38.855100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54769d9e-e03a-4418-8ba1-6659a962a9d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:38.888437 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-54769d9e-e03a-4418-8ba1-6659a962a9d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050005 Aug 24 05:10:38.891290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 439/770] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:38.898708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7e2da940-9522-4130-995f-4c0cdbccb5b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097624 Aug 24 05:10:38.899341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 332/771] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:39.115310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:39.115804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:39.122651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.123176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.123606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.124295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.124742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.125159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.140216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] HTTP exception thrown: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Request method failure captured: Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 HTTP/1.1 Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa9RHl7bSbeVQ_nUfbl45q14zFjaSy56fjn7_XABDHdYOF-09VkCdozH_ri4eZvwgO-kRJPCVlkFDJ12yjonHilvEFWnNAPkjzsMRuYcZuD6jARFuamqtjl3sIuywQ2bJavswpJdnqY-hKlfcivuCD94Zn2rmX_kS0HF1Ja02qcI6dQ Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: aaa96f5af1de4cf5a59cdca9c785db52 Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:10:39.141758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_aaa96f5af1de4cf5a59cdca9c785db52", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: aaa96f5af1de4cf5a59cdca9c785db52 Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-TestVolumeBootPattern-160960211-project Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 81f88a5d0ffe4c5abd85cdfc19d18694 Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-TestVolumeBootPattern-160960211-project Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:39.143360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '5bf50e90-6712-4e3e-b813-653bfe69d460'} Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:39.144151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:39.145346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:10:39.146558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Returning 404 to user: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:39.146558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-923cca44-4340-4f7e-b3e8-cbe1a03de90d tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "DELETE /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 404 len: 111 microversion: 2.1 time: 0.031746 Aug 24 05:10:39.146558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 440/772] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:10:39 2022] DELETE /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:39.152831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:39.153440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] [instance: 5bf50e90-6712-4e3e-b813-653bfe69d460] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:39.160047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.160530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.160963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.161651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.162101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.162518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.176527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] HTTP exception thrown: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Request method failure captured: Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 HTTP/1.1 Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa9RHl7bSbeVQ_nUfbl45q14zFjaSy56fjn7_XABDHdYOF-09VkCdozH_ri4eZvwgO-kRJPCVlkFDJ12yjonHilvEFWnNAPkjzsMRuYcZuD6jARFuamqtjl3sIuywQ2bJavswpJdnqY-hKlfcivuCD94Zn2rmX_kS0HF1Ja02qcI6dQ Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: aaa96f5af1de4cf5a59cdca9c785db52 Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:10:39.178046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_aaa96f5af1de4cf5a59cdca9c785db52", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/aaa96f5af1de4cf5a59cdca9c785db52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: aaa96f5af1de4cf5a59cdca9c785db52 Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-TestVolumeBootPattern-160960211 Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-TestVolumeBootPattern-160960211-project Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 81f88a5d0ffe4c5abd85cdfc19d18694 Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-TestVolumeBootPattern-160960211-project Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:39.179615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '5bf50e90-6712-4e3e-b813-653bfe69d460'} Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:10:39.180638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. Aug 24 05:10:39.182062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:10:39.183636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Returning 404 to user: Instance 5bf50e90-6712-4e3e-b813-653bfe69d460 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:10:39.183636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2948a7b1-2028-4f89-80a8-080c3d9996af tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460" status: 404 len: 111 microversion: 2.1 time: 0.031318 Aug 24 05:10:39.183636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 333/773] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:10:39 2022] GET /compute/v2.1/servers/5bf50e90-6712-4e3e-b813-653bfe69d460 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:10:39.848373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fe6537af-5e67-4a53-a705-864f993c60b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:39.850788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fe6537af-5e67-4a53-a705-864f993c60b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:39.858131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe6537af-5e67-4a53-a705-864f993c60b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.858613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe6537af-5e67-4a53-a705-864f993c60b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.859076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe6537af-5e67-4a53-a705-864f993c60b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.859782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe6537af-5e67-4a53-a705-864f993c60b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.860235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe6537af-5e67-4a53-a705-864f993c60b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.860659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe6537af-5e67-4a53-a705-864f993c60b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.892312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fe6537af-5e67-4a53-a705-864f993c60b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047827 Aug 24 05:10:39.892890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 441/774] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:39.906489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-112c997a-8f59-428d-8727-6f20b45df0ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:39.909050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-112c997a-8f59-428d-8727-6f20b45df0ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:39.911450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7c9a929b-5919-42ba-959f-d246f8b8c8ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:39.913610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7c9a929b-5919-42ba-959f-d246f8b8c8ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:39.916462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-112c997a-8f59-428d-8727-6f20b45df0ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.917033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-112c997a-8f59-428d-8727-6f20b45df0ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.917705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-112c997a-8f59-428d-8727-6f20b45df0ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.918505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-112c997a-8f59-428d-8727-6f20b45df0ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.918923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-112c997a-8f59-428d-8727-6f20b45df0ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.919349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-112c997a-8f59-428d-8727-6f20b45df0ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.920150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c9a929b-5919-42ba-959f-d246f8b8c8ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.920649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c9a929b-5919-42ba-959f-d246f8b8c8ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.921085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c9a929b-5919-42ba-959f-d246f8b8c8ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.921854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c9a929b-5919-42ba-959f-d246f8b8c8ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:39.922232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c9a929b-5919-42ba-959f-d246f8b8c8ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:39.922662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c9a929b-5919-42ba-959f-d246f8b8c8ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:39.955420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-112c997a-8f59-428d-8727-6f20b45df0ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056377 Aug 24 05:10:39.956213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7c9a929b-5919-42ba-959f-d246f8b8c8ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048794 Aug 24 05:10:39.956347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 334/775] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:39.956619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 442/776] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:40.904538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9c9719de-33b2-4488-b9d7-a8785487876f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:40.906723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9c9719de-33b2-4488-b9d7-a8785487876f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:40.913322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9719de-33b2-4488-b9d7-a8785487876f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.913999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9719de-33b2-4488-b9d7-a8785487876f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.914970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9719de-33b2-4488-b9d7-a8785487876f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:40.915591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9719de-33b2-4488-b9d7-a8785487876f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.916036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9719de-33b2-4488-b9d7-a8785487876f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.916454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9719de-33b2-4488-b9d7-a8785487876f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:40.942875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:40.947985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9c9719de-33b2-4488-b9d7-a8785487876f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047475 Aug 24 05:10:40.948590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 335/777] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:40.967713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2b81bd49-c6b8-46b1-92f0-b6646d8c5801 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:40.969850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2b81bd49-c6b8-46b1-92f0-b6646d8c5801 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:40.972825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f27dc8b3-80c2-4805-851a-bb7a25f8f546 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:40.975091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f27dc8b3-80c2-4805-851a-bb7a25f8f546 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:40.978554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b81bd49-c6b8-46b1-92f0-b6646d8c5801 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.979065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b81bd49-c6b8-46b1-92f0-b6646d8c5801 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.979499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b81bd49-c6b8-46b1-92f0-b6646d8c5801 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:40.980199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b81bd49-c6b8-46b1-92f0-b6646d8c5801 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.980644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b81bd49-c6b8-46b1-92f0-b6646d8c5801 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.981062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b81bd49-c6b8-46b1-92f0-b6646d8c5801 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:40.983241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f27dc8b3-80c2-4805-851a-bb7a25f8f546 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.984167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f27dc8b3-80c2-4805-851a-bb7a25f8f546 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.984851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f27dc8b3-80c2-4805-851a-bb7a25f8f546 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:40.985791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f27dc8b3-80c2-4805-851a-bb7a25f8f546 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:40.986247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f27dc8b3-80c2-4805-851a-bb7a25f8f546 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:40.986768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f27dc8b3-80c2-4805-851a-bb7a25f8f546 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:41.003044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:41.013436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2b81bd49-c6b8-46b1-92f0-b6646d8c5801 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049495 Aug 24 05:10:41.014000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 336/778] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:41.020487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f27dc8b3-80c2-4805-851a-bb7a25f8f546 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056312 Aug 24 05:10:41.021059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 443/779] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:41.960111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8f04aae8-9924-4523-a241-d900aa566a6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:41.962564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8f04aae8-9924-4523-a241-d900aa566a6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:41.969538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f04aae8-9924-4523-a241-d900aa566a6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.970019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f04aae8-9924-4523-a241-d900aa566a6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:41.970453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f04aae8-9924-4523-a241-d900aa566a6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:41.971212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f04aae8-9924-4523-a241-d900aa566a6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:41.971664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f04aae8-9924-4523-a241-d900aa566a6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:41.972086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f04aae8-9924-4523-a241-d900aa566a6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:42.003433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8f04aae8-9924-4523-a241-d900aa566a6f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047215 Aug 24 05:10:42.003923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 337/780] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:42.025658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f8ab2e41-bfd9-4ae7-a77c-7677bf36ce8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:42.028012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f8ab2e41-bfd9-4ae7-a77c-7677bf36ce8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:42.033805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0e69d3e6-6449-4a7b-a312-c1d67cc86515 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:42.035025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8ab2e41-bfd9-4ae7-a77c-7677bf36ce8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:42.035513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8ab2e41-bfd9-4ae7-a77c-7677bf36ce8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:42.035949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8ab2e41-bfd9-4ae7-a77c-7677bf36ce8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:42.036053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0e69d3e6-6449-4a7b-a312-c1d67cc86515 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:42.036655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8ab2e41-bfd9-4ae7-a77c-7677bf36ce8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:42.037104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8ab2e41-bfd9-4ae7-a77c-7677bf36ce8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:42.037523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8ab2e41-bfd9-4ae7-a77c-7677bf36ce8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:42.042488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e69d3e6-6449-4a7b-a312-c1d67cc86515 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:42.043016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e69d3e6-6449-4a7b-a312-c1d67cc86515 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:42.043624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e69d3e6-6449-4a7b-a312-c1d67cc86515 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:42.044345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e69d3e6-6449-4a7b-a312-c1d67cc86515 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:42.044800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e69d3e6-6449-4a7b-a312-c1d67cc86515 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:42.045225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e69d3e6-6449-4a7b-a312-c1d67cc86515 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:42.070264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f8ab2e41-bfd9-4ae7-a77c-7677bf36ce8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048605 Aug 24 05:10:42.075573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 444/781] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:42.082507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0e69d3e6-6449-4a7b-a312-c1d67cc86515 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052746 Aug 24 05:10:42.083113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 338/782] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:43.016023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-78e060ec-bf20-442a-b430-63a12bd4b447 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:43.018057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-78e060ec-bf20-442a-b430-63a12bd4b447 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:43.025204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78e060ec-bf20-442a-b430-63a12bd4b447 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.025688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78e060ec-bf20-442a-b430-63a12bd4b447 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.026256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78e060ec-bf20-442a-b430-63a12bd4b447 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.026870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78e060ec-bf20-442a-b430-63a12bd4b447 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.027316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78e060ec-bf20-442a-b430-63a12bd4b447 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.027730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78e060ec-bf20-442a-b430-63a12bd4b447 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.059150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-78e060ec-bf20-442a-b430-63a12bd4b447 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047164 Aug 24 05:10:43.059748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 445/783] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:43.083406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eee88e4b-ce17-48f8-a5c3-6d0d876136c7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:43.085531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-eee88e4b-ce17-48f8-a5c3-6d0d876136c7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:43.092955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eee88e4b-ce17-48f8-a5c3-6d0d876136c7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.093438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eee88e4b-ce17-48f8-a5c3-6d0d876136c7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.093864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eee88e4b-ce17-48f8-a5c3-6d0d876136c7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.094552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eee88e4b-ce17-48f8-a5c3-6d0d876136c7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.095020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eee88e4b-ce17-48f8-a5c3-6d0d876136c7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.095436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eee88e4b-ce17-48f8-a5c3-6d0d876136c7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.095570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5a64e432-6902-4b7d-90a5-3421341f8359 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:43.099030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5a64e432-6902-4b7d-90a5-3421341f8359 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:43.105886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a64e432-6902-4b7d-90a5-3421341f8359 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.106214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a64e432-6902-4b7d-90a5-3421341f8359 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.106604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a64e432-6902-4b7d-90a5-3421341f8359 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.107405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a64e432-6902-4b7d-90a5-3421341f8359 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:43.107914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a64e432-6902-4b7d-90a5-3421341f8359 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:43.108567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a64e432-6902-4b7d-90a5-3421341f8359 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:43.132632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-eee88e4b-ce17-48f8-a5c3-6d0d876136c7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053062 Aug 24 05:10:43.133989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 339/784] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:43.147717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5a64e432-6902-4b7d-90a5-3421341f8359 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056592 Aug 24 05:10:43.153499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 446/785] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:43 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:44.071631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-09668bd9-a047-41cd-8521-89b1b8d1792d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:44.073773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-09668bd9-a047-41cd-8521-89b1b8d1792d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:44.080019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09668bd9-a047-41cd-8521-89b1b8d1792d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.080496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09668bd9-a047-41cd-8521-89b1b8d1792d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.080939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09668bd9-a047-41cd-8521-89b1b8d1792d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:44.081621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09668bd9-a047-41cd-8521-89b1b8d1792d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.082070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09668bd9-a047-41cd-8521-89b1b8d1792d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.082482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09668bd9-a047-41cd-8521-89b1b8d1792d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:44.113554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-09668bd9-a047-41cd-8521-89b1b8d1792d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045963 Aug 24 05:10:44.114257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 340/786] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:44.145715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e7128b31-5378-4767-b3a3-433dc32dd303 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:44.147886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e7128b31-5378-4767-b3a3-433dc32dd303 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:44.155223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7128b31-5378-4767-b3a3-433dc32dd303 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.155710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7128b31-5378-4767-b3a3-433dc32dd303 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.156156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7128b31-5378-4767-b3a3-433dc32dd303 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:44.156857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7128b31-5378-4767-b3a3-433dc32dd303 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.157329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7128b31-5378-4767-b3a3-433dc32dd303 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.157728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7128b31-5378-4767-b3a3-433dc32dd303 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:44.163370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ebeb5151-eac7-420d-b116-09274c562fc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:44.166454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ebeb5151-eac7-420d-b116-09274c562fc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:44.172728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebeb5151-eac7-420d-b116-09274c562fc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.173214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebeb5151-eac7-420d-b116-09274c562fc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.173638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebeb5151-eac7-420d-b116-09274c562fc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:44.174328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebeb5151-eac7-420d-b116-09274c562fc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:44.175070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebeb5151-eac7-420d-b116-09274c562fc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:44.175486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebeb5151-eac7-420d-b116-09274c562fc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:44.194322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e7128b31-5378-4767-b3a3-433dc32dd303 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052475 Aug 24 05:10:44.195525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 447/787] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:44.213650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ebeb5151-eac7-420d-b116-09274c562fc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049190 Aug 24 05:10:44.213650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 341/788] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:45.126051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-beb3fe3c-9773-4f83-8e8c-4baf6fe0d779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:45.128222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-beb3fe3c-9773-4f83-8e8c-4baf6fe0d779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:45.134358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beb3fe3c-9773-4f83-8e8c-4baf6fe0d779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.134887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beb3fe3c-9773-4f83-8e8c-4baf6fe0d779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.135331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beb3fe3c-9773-4f83-8e8c-4baf6fe0d779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.136035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beb3fe3c-9773-4f83-8e8c-4baf6fe0d779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.136487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beb3fe3c-9773-4f83-8e8c-4baf6fe0d779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.136909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beb3fe3c-9773-4f83-8e8c-4baf6fe0d779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.172619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-beb3fe3c-9773-4f83-8e8c-4baf6fe0d779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050561 Aug 24 05:10:45.173287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 448/789] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:45.206887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-76ecb605-82c7-4587-bdc6-b7b925160077 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:45.209071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-76ecb605-82c7-4587-bdc6-b7b925160077 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:45.215601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76ecb605-82c7-4587-bdc6-b7b925160077 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.216087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76ecb605-82c7-4587-bdc6-b7b925160077 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.216529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76ecb605-82c7-4587-bdc6-b7b925160077 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.217240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76ecb605-82c7-4587-bdc6-b7b925160077 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.217693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76ecb605-82c7-4587-bdc6-b7b925160077 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.218116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76ecb605-82c7-4587-bdc6-b7b925160077 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.221501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-51e72931-976e-4a2f-8cda-3dc6d47fa707 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:45.223968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-51e72931-976e-4a2f-8cda-3dc6d47fa707 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:45.230828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51e72931-976e-4a2f-8cda-3dc6d47fa707 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.231307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51e72931-976e-4a2f-8cda-3dc6d47fa707 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.231737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51e72931-976e-4a2f-8cda-3dc6d47fa707 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.232467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51e72931-976e-4a2f-8cda-3dc6d47fa707 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:45.232911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51e72931-976e-4a2f-8cda-3dc6d47fa707 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:45.233544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51e72931-976e-4a2f-8cda-3dc6d47fa707 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:45.250496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-76ecb605-82c7-4587-bdc6-b7b925160077 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047570 Aug 24 05:10:45.252989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 342/790] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:45.274170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-51e72931-976e-4a2f-8cda-3dc6d47fa707 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056593 Aug 24 05:10:45.274772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 449/791] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:45 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:46.185235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8683db0a-8a21-4ed0-a514-37d9550abf03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:46.187393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8683db0a-8a21-4ed0-a514-37d9550abf03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:46.193391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8683db0a-8a21-4ed0-a514-37d9550abf03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:46.193866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8683db0a-8a21-4ed0-a514-37d9550abf03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:46.194298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8683db0a-8a21-4ed0-a514-37d9550abf03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:46.195020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8683db0a-8a21-4ed0-a514-37d9550abf03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:46.196377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8683db0a-8a21-4ed0-a514-37d9550abf03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:46.197056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8683db0a-8a21-4ed0-a514-37d9550abf03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:46.228214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8683db0a-8a21-4ed0-a514-37d9550abf03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046932 Aug 24 05:10:46.228904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 343/792] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:46.265131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-77c4c9e3-dc53-48e6-aeb3-c81bd25e422a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:46.267288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-77c4c9e3-dc53-48e6-aeb3-c81bd25e422a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:46.273877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c4c9e3-dc53-48e6-aeb3-c81bd25e422a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:46.274357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c4c9e3-dc53-48e6-aeb3-c81bd25e422a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:46.274819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c4c9e3-dc53-48e6-aeb3-c81bd25e422a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:46.275516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c4c9e3-dc53-48e6-aeb3-c81bd25e422a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:46.275963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c4c9e3-dc53-48e6-aeb3-c81bd25e422a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:46.276380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c4c9e3-dc53-48e6-aeb3-c81bd25e422a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:46.286542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a01b7c86-c836-4970-82c5-eb7a019f08d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:46.288707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a01b7c86-c836-4970-82c5-eb7a019f08d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:46.294956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a01b7c86-c836-4970-82c5-eb7a019f08d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:46.295438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a01b7c86-c836-4970-82c5-eb7a019f08d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:46.295871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a01b7c86-c836-4970-82c5-eb7a019f08d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:46.296566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a01b7c86-c836-4970-82c5-eb7a019f08d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:46.297017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a01b7c86-c836-4970-82c5-eb7a019f08d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:46.297438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a01b7c86-c836-4970-82c5-eb7a019f08d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:46.308849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-77c4c9e3-dc53-48e6-aeb3-c81bd25e422a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047628 Aug 24 05:10:46.313530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 450/793] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:46.331292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a01b7c86-c836-4970-82c5-eb7a019f08d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048580 Aug 24 05:10:46.332145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 344/794] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:46.716155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:10:46.716344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:10:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:10:47.240964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-409fdda6-b1f9-41e0-877d-edf5dbb0b3df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:47.243279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-409fdda6-b1f9-41e0-877d-edf5dbb0b3df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:47.249493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-409fdda6-b1f9-41e0-877d-edf5dbb0b3df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.249975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-409fdda6-b1f9-41e0-877d-edf5dbb0b3df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.250409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-409fdda6-b1f9-41e0-877d-edf5dbb0b3df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.251135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-409fdda6-b1f9-41e0-877d-edf5dbb0b3df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.251589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-409fdda6-b1f9-41e0-877d-edf5dbb0b3df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.252009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-409fdda6-b1f9-41e0-877d-edf5dbb0b3df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.285924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-409fdda6-b1f9-41e0-877d-edf5dbb0b3df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049097 Aug 24 05:10:47.286580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 451/795] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:47.320562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c9437d4e-9aab-4d71-b34d-fe5d0cc80c50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:47.322925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c9437d4e-9aab-4d71-b34d-fe5d0cc80c50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:47.329565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9437d4e-9aab-4d71-b34d-fe5d0cc80c50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.330038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9437d4e-9aab-4d71-b34d-fe5d0cc80c50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.330493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9437d4e-9aab-4d71-b34d-fe5d0cc80c50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.331206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9437d4e-9aab-4d71-b34d-fe5d0cc80c50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.331670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9437d4e-9aab-4d71-b34d-fe5d0cc80c50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.332065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9437d4e-9aab-4d71-b34d-fe5d0cc80c50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.344657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-715ba196-c7a8-45f6-8993-1f1a124b1ae4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:47.346825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-715ba196-c7a8-45f6-8993-1f1a124b1ae4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:47.353832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715ba196-c7a8-45f6-8993-1f1a124b1ae4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.354318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715ba196-c7a8-45f6-8993-1f1a124b1ae4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.354773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715ba196-c7a8-45f6-8993-1f1a124b1ae4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.355469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715ba196-c7a8-45f6-8993-1f1a124b1ae4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:47.355919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715ba196-c7a8-45f6-8993-1f1a124b1ae4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:47.356336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715ba196-c7a8-45f6-8993-1f1a124b1ae4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:47.364344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c9437d4e-9aab-4d71-b34d-fe5d0cc80c50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047723 Aug 24 05:10:47.364923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 345/796] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:47.387750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-715ba196-c7a8-45f6-8993-1f1a124b1ae4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047089 Aug 24 05:10:47.388322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 452/797] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:48.298476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ec0a259b-ca78-492f-a375-4135147b1911 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:48.300920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ec0a259b-ca78-492f-a375-4135147b1911 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:48.307708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec0a259b-ca78-492f-a375-4135147b1911 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:48.308190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec0a259b-ca78-492f-a375-4135147b1911 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:48.308617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec0a259b-ca78-492f-a375-4135147b1911 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:48.309306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec0a259b-ca78-492f-a375-4135147b1911 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:48.309752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec0a259b-ca78-492f-a375-4135147b1911 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:48.310168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec0a259b-ca78-492f-a375-4135147b1911 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:48.340445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ec0a259b-ca78-492f-a375-4135147b1911 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Aug 24 05:10:48.341136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 346/798] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:48.376014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3e5773db-8cbe-4b9e-b13f-621ac3c10f05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:48.378141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3e5773db-8cbe-4b9e-b13f-621ac3c10f05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:48.385019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e5773db-8cbe-4b9e-b13f-621ac3c10f05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:48.385486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e5773db-8cbe-4b9e-b13f-621ac3c10f05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:48.385921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e5773db-8cbe-4b9e-b13f-621ac3c10f05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:48.386610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e5773db-8cbe-4b9e-b13f-621ac3c10f05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:48.387092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e5773db-8cbe-4b9e-b13f-621ac3c10f05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:48.387510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e5773db-8cbe-4b9e-b13f-621ac3c10f05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:48.400187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-acfc00ce-6d31-4f52-b0fb-78835653f9f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:48.402388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-acfc00ce-6d31-4f52-b0fb-78835653f9f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:48.408383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acfc00ce-6d31-4f52-b0fb-78835653f9f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:48.408868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acfc00ce-6d31-4f52-b0fb-78835653f9f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:48.409300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acfc00ce-6d31-4f52-b0fb-78835653f9f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:48.409995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acfc00ce-6d31-4f52-b0fb-78835653f9f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:48.410445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acfc00ce-6d31-4f52-b0fb-78835653f9f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:48.410897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acfc00ce-6d31-4f52-b0fb-78835653f9f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:48.418951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3e5773db-8cbe-4b9e-b13f-621ac3c10f05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046814 Aug 24 05:10:48.419530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 453/799] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:48.446520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-acfc00ce-6d31-4f52-b0fb-78835653f9f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050249 Aug 24 05:10:48.447152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 347/800] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:49.353123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a3940f89-e631-4da8-a2b1-83a10c6621cc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:49.355207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a3940f89-e631-4da8-a2b1-83a10c6621cc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:49.361509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3940f89-e631-4da8-a2b1-83a10c6621cc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:49.361985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3940f89-e631-4da8-a2b1-83a10c6621cc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:49.362418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3940f89-e631-4da8-a2b1-83a10c6621cc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:49.363143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3940f89-e631-4da8-a2b1-83a10c6621cc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:49.363588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3940f89-e631-4da8-a2b1-83a10c6621cc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:49.364003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3940f89-e631-4da8-a2b1-83a10c6621cc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:49.397967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a3940f89-e631-4da8-a2b1-83a10c6621cc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049004 Aug 24 05:10:49.398894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 454/801] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:49.432282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f14e07a9-474b-469a-bfd9-f60ab157619b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:49.434463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f14e07a9-474b-469a-bfd9-f60ab157619b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:49.436345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:49.437016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=6 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:49.443502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e07a9-474b-469a-bfd9-f60ab157619b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:49.443987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e07a9-474b-469a-bfd9-f60ab157619b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:49.444425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e07a9-474b-469a-bfd9-f60ab157619b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:49.445199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e07a9-474b-469a-bfd9-f60ab157619b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:49.446312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e07a9-474b-469a-bfd9-f60ab157619b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:49.446958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e07a9-474b-469a-bfd9-f60ab157619b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:49.459002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b91ab2ac-1f1e-4551-ad60-654abd25ade8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:49.461336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b91ab2ac-1f1e-4551-ad60-654abd25ade8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:49.467368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b91ab2ac-1f1e-4551-ad60-654abd25ade8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:49.467856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b91ab2ac-1f1e-4551-ad60-654abd25ade8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:49.468290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b91ab2ac-1f1e-4551-ad60-654abd25ade8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:49.469027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b91ab2ac-1f1e-4551-ad60-654abd25ade8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:49.469482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b91ab2ac-1f1e-4551-ad60-654abd25ade8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:49.469942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b91ab2ac-1f1e-4551-ad60-654abd25ade8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:49.481476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f14e07a9-474b-469a-bfd9-f60ab157619b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053778 Aug 24 05:10:49.482051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 348/802] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:49.512163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b91ab2ac-1f1e-4551-ad60-654abd25ade8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057130 Aug 24 05:10:49.512974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 455/803] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:50.409718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-23c1bbc7-3268-4864-b900-aa68a9d4054b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:50.411814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-23c1bbc7-3268-4864-b900-aa68a9d4054b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:50.417951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c1bbc7-3268-4864-b900-aa68a9d4054b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.418427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c1bbc7-3268-4864-b900-aa68a9d4054b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.418894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c1bbc7-3268-4864-b900-aa68a9d4054b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.419582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c1bbc7-3268-4864-b900-aa68a9d4054b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.420111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c1bbc7-3268-4864-b900-aa68a9d4054b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.420533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c1bbc7-3268-4864-b900-aa68a9d4054b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.453120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-23c1bbc7-3268-4864-b900-aa68a9d4054b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047387 Aug 24 05:10:50.453792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 349/804] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:50.493769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7e0bf6f8-3fe8-477f-8dec-1221c312603e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:50.495981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7e0bf6f8-3fe8-477f-8dec-1221c312603e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:50.502474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0bf6f8-3fe8-477f-8dec-1221c312603e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.502979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0bf6f8-3fe8-477f-8dec-1221c312603e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.503418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0bf6f8-3fe8-477f-8dec-1221c312603e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.504110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0bf6f8-3fe8-477f-8dec-1221c312603e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.504556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0bf6f8-3fe8-477f-8dec-1221c312603e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.504974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0bf6f8-3fe8-477f-8dec-1221c312603e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.525641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a0218397-e25c-40df-ae7a-9669a0e64d3c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:50.528013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a0218397-e25c-40df-ae7a-9669a0e64d3c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:50.534027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0218397-e25c-40df-ae7a-9669a0e64d3c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.534507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0218397-e25c-40df-ae7a-9669a0e64d3c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.534973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0218397-e25c-40df-ae7a-9669a0e64d3c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.535664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0218397-e25c-40df-ae7a-9669a0e64d3c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:50.536281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0218397-e25c-40df-ae7a-9669a0e64d3c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:50.536705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0218397-e25c-40df-ae7a-9669a0e64d3c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:50.539868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7e0bf6f8-3fe8-477f-8dec-1221c312603e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050002 Aug 24 05:10:50.540639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 456/805] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:50.568077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a0218397-e25c-40df-ae7a-9669a0e64d3c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047127 Aug 24 05:10:50.568649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 350/806] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:51.465972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-81db28de-cd4d-4c6e-96c3-470879afc7f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:51.468127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-81db28de-cd4d-4c6e-96c3-470879afc7f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:51.474938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81db28de-cd4d-4c6e-96c3-470879afc7f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.475426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81db28de-cd4d-4c6e-96c3-470879afc7f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.475863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81db28de-cd4d-4c6e-96c3-470879afc7f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.477120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81db28de-cd4d-4c6e-96c3-470879afc7f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.477565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81db28de-cd4d-4c6e-96c3-470879afc7f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.477990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81db28de-cd4d-4c6e-96c3-470879afc7f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.510740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-81db28de-cd4d-4c6e-96c3-470879afc7f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048745 Aug 24 05:10:51.511443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 457/807] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:51.552674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-15e9d162-2e69-4840-8c95-39a6805ec693 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:51.555478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-15e9d162-2e69-4840-8c95-39a6805ec693 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:51.562064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15e9d162-2e69-4840-8c95-39a6805ec693 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.562561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15e9d162-2e69-4840-8c95-39a6805ec693 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.563015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15e9d162-2e69-4840-8c95-39a6805ec693 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.563720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15e9d162-2e69-4840-8c95-39a6805ec693 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.564174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15e9d162-2e69-4840-8c95-39a6805ec693 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.564597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15e9d162-2e69-4840-8c95-39a6805ec693 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.580873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-db0f80b9-7fb3-4273-8e65-a2aecf653312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:51.583052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-db0f80b9-7fb3-4273-8e65-a2aecf653312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:51.590609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db0f80b9-7fb3-4273-8e65-a2aecf653312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.591128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db0f80b9-7fb3-4273-8e65-a2aecf653312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.591557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db0f80b9-7fb3-4273-8e65-a2aecf653312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.592248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db0f80b9-7fb3-4273-8e65-a2aecf653312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:51.592693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db0f80b9-7fb3-4273-8e65-a2aecf653312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:51.593101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db0f80b9-7fb3-4273-8e65-a2aecf653312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:51.608234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-15e9d162-2e69-4840-8c95-39a6805ec693 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059188 Aug 24 05:10:51.608234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 351/808] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:51.626752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-db0f80b9-7fb3-4273-8e65-a2aecf653312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049846 Aug 24 05:10:51.627652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 458/809] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:52.523237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8593c05-a254-45fe-9785-fa6cc630a0b9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:52.525470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c8593c05-a254-45fe-9785-fa6cc630a0b9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:52.531592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8593c05-a254-45fe-9785-fa6cc630a0b9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:52.532070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8593c05-a254-45fe-9785-fa6cc630a0b9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:52.532499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8593c05-a254-45fe-9785-fa6cc630a0b9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:52.533192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8593c05-a254-45fe-9785-fa6cc630a0b9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:52.533642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8593c05-a254-45fe-9785-fa6cc630a0b9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:52.534059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8593c05-a254-45fe-9785-fa6cc630a0b9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:52.552038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:52.567348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c8593c05-a254-45fe-9785-fa6cc630a0b9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048080 Aug 24 05:10:52.568006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 352/810] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:52.620439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-36ceb9b9-e6ce-462d-a41a-5c64b2355561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:52.622629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-36ceb9b9-e6ce-462d-a41a-5c64b2355561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:52.629262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ceb9b9-e6ce-462d-a41a-5c64b2355561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:52.629736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ceb9b9-e6ce-462d-a41a-5c64b2355561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:52.630168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ceb9b9-e6ce-462d-a41a-5c64b2355561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:52.630898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ceb9b9-e6ce-462d-a41a-5c64b2355561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:52.631348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ceb9b9-e6ce-462d-a41a-5c64b2355561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:52.631769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ceb9b9-e6ce-462d-a41a-5c64b2355561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:52.639493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-aa9cddf3-654c-43bc-9dde-913244700d7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:52.641797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-aa9cddf3-654c-43bc-9dde-913244700d7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:52.648320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9cddf3-654c-43bc-9dde-913244700d7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:52.648910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9cddf3-654c-43bc-9dde-913244700d7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:52.649608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9cddf3-654c-43bc-9dde-913244700d7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:52.650329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9cddf3-654c-43bc-9dde-913244700d7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:52.650844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9cddf3-654c-43bc-9dde-913244700d7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:52.651267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa9cddf3-654c-43bc-9dde-913244700d7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:52.658666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:52.664641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-36ceb9b9-e6ce-462d-a41a-5c64b2355561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048321 Aug 24 05:10:52.665218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 459/811] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:52.683989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-aa9cddf3-654c-43bc-9dde-913244700d7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048631 Aug 24 05:10:52.684562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 353/812] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:53.581025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9032e623-5724-4b6d-a3bd-ccb3165fd344 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:53.583204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9032e623-5724-4b6d-a3bd-ccb3165fd344 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:53.590162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9032e623-5724-4b6d-a3bd-ccb3165fd344 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:53.590637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9032e623-5724-4b6d-a3bd-ccb3165fd344 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:53.591099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9032e623-5724-4b6d-a3bd-ccb3165fd344 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:53.591788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9032e623-5724-4b6d-a3bd-ccb3165fd344 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:53.592234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9032e623-5724-4b6d-a3bd-ccb3165fd344 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:53.592652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9032e623-5724-4b6d-a3bd-ccb3165fd344 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:53.623587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9032e623-5724-4b6d-a3bd-ccb3165fd344 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046641 Aug 24 05:10:53.624281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 460/813] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:53.676916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f4fa3cb6-fec8-408f-8ac3-ba6c061fe949 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:53.679078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f4fa3cb6-fec8-408f-8ac3-ba6c061fe949 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:53.685736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4fa3cb6-fec8-408f-8ac3-ba6c061fe949 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:53.686217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4fa3cb6-fec8-408f-8ac3-ba6c061fe949 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:53.686653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4fa3cb6-fec8-408f-8ac3-ba6c061fe949 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:53.687376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4fa3cb6-fec8-408f-8ac3-ba6c061fe949 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:53.687825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4fa3cb6-fec8-408f-8ac3-ba6c061fe949 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:53.688246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4fa3cb6-fec8-408f-8ac3-ba6c061fe949 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:53.696977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f204d904-6cf0-4857-a805-b587a00c4c90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:53.699214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f204d904-6cf0-4857-a805-b587a00c4c90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:53.705870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f204d904-6cf0-4857-a805-b587a00c4c90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:53.706348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f204d904-6cf0-4857-a805-b587a00c4c90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:53.706802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f204d904-6cf0-4857-a805-b587a00c4c90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:53.707494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f204d904-6cf0-4857-a805-b587a00c4c90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:53.707944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f204d904-6cf0-4857-a805-b587a00c4c90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:53.708357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f204d904-6cf0-4857-a805-b587a00c4c90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:53.720165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f4fa3cb6-fec8-408f-8ac3-ba6c061fe949 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047405 Aug 24 05:10:53.720735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 354/814] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:53.744853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f204d904-6cf0-4857-a805-b587a00c4c90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052417 Aug 24 05:10:53.745619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 461/815] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:54.639528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6ddb9261-3d8e-4065-b2bc-ce68412087ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:54.641862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6ddb9261-3d8e-4065-b2bc-ce68412087ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:54.648007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ddb9261-3d8e-4065-b2bc-ce68412087ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:54.649266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ddb9261-3d8e-4065-b2bc-ce68412087ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:54.649700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ddb9261-3d8e-4065-b2bc-ce68412087ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:54.650405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ddb9261-3d8e-4065-b2bc-ce68412087ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:54.650892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ddb9261-3d8e-4065-b2bc-ce68412087ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:54.651314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ddb9261-3d8e-4065-b2bc-ce68412087ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:54.683119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6ddb9261-3d8e-4065-b2bc-ce68412087ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047593 Aug 24 05:10:54.684145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 355/816] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:54.733027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1ab619a0-b9db-4c1f-870c-19b99fbc3fd0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:54.735252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1ab619a0-b9db-4c1f-870c-19b99fbc3fd0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:54.741784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab619a0-b9db-4c1f-870c-19b99fbc3fd0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:54.742514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab619a0-b9db-4c1f-870c-19b99fbc3fd0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:54.743038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab619a0-b9db-4c1f-870c-19b99fbc3fd0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:54.743739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab619a0-b9db-4c1f-870c-19b99fbc3fd0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:54.744188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab619a0-b9db-4c1f-870c-19b99fbc3fd0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:54.744617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab619a0-b9db-4c1f-870c-19b99fbc3fd0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:54.759808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a46c4b7c-9570-4fd0-ac0f-0f050d75cc23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:54.762380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a46c4b7c-9570-4fd0-ac0f-0f050d75cc23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:54.771858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46c4b7c-9570-4fd0-ac0f-0f050d75cc23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:54.772355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46c4b7c-9570-4fd0-ac0f-0f050d75cc23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:54.772797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46c4b7c-9570-4fd0-ac0f-0f050d75cc23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:54.774090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46c4b7c-9570-4fd0-ac0f-0f050d75cc23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:54.774543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46c4b7c-9570-4fd0-ac0f-0f050d75cc23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:54.774997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46c4b7c-9570-4fd0-ac0f-0f050d75cc23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:54.780496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1ab619a0-b9db-4c1f-870c-19b99fbc3fd0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051673 Aug 24 05:10:54.781073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 462/817] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:54.806573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a46c4b7c-9570-4fd0-ac0f-0f050d75cc23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051258 Aug 24 05:10:54.807190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 356/818] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:55.696227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-543b9f8b-1a9e-4e86-a569-b1ea060386b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:55.698353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-543b9f8b-1a9e-4e86-a569-b1ea060386b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:55.704787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-543b9f8b-1a9e-4e86-a569-b1ea060386b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:55.705335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-543b9f8b-1a9e-4e86-a569-b1ea060386b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:55.705804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-543b9f8b-1a9e-4e86-a569-b1ea060386b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:55.706720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-543b9f8b-1a9e-4e86-a569-b1ea060386b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:55.707263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-543b9f8b-1a9e-4e86-a569-b1ea060386b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:55.707677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-543b9f8b-1a9e-4e86-a569-b1ea060386b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:55.740508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-543b9f8b-1a9e-4e86-a569-b1ea060386b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048825 Aug 24 05:10:55.741070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 463/819] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:55.796229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-66688080-e19b-4197-b6d2-8e798c55accc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:55.798337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-66688080-e19b-4197-b6d2-8e798c55accc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:55.805697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66688080-e19b-4197-b6d2-8e798c55accc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:55.806170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66688080-e19b-4197-b6d2-8e798c55accc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:55.806594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66688080-e19b-4197-b6d2-8e798c55accc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:55.807302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66688080-e19b-4197-b6d2-8e798c55accc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:55.807750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66688080-e19b-4197-b6d2-8e798c55accc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:55.808168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66688080-e19b-4197-b6d2-8e798c55accc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:55.818703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b414b144-265a-410b-bcc0-341d21835820 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:55.821423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b414b144-265a-410b-bcc0-341d21835820 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:55.827547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b414b144-265a-410b-bcc0-341d21835820 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:55.828033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b414b144-265a-410b-bcc0-341d21835820 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:55.828463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b414b144-265a-410b-bcc0-341d21835820 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:55.829162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b414b144-265a-410b-bcc0-341d21835820 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:55.829715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b414b144-265a-410b-bcc0-341d21835820 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:55.830143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b414b144-265a-410b-bcc0-341d21835820 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:55.840459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-66688080-e19b-4197-b6d2-8e798c55accc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048107 Aug 24 05:10:55.841053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 357/820] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:55.869085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b414b144-265a-410b-bcc0-341d21835820 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054231 Aug 24 05:10:55.870819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 464/821] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:55 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:56.755025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b1cc668b-a4a5-4ea8-b4cf-deec19cfbdff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:56.757181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b1cc668b-a4a5-4ea8-b4cf-deec19cfbdff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:56.764192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1cc668b-a4a5-4ea8-b4cf-deec19cfbdff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:56.764679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1cc668b-a4a5-4ea8-b4cf-deec19cfbdff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:56.765118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1cc668b-a4a5-4ea8-b4cf-deec19cfbdff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:56.765820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1cc668b-a4a5-4ea8-b4cf-deec19cfbdff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:56.766273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1cc668b-a4a5-4ea8-b4cf-deec19cfbdff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:56.766713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1cc668b-a4a5-4ea8-b4cf-deec19cfbdff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:56.801195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b1cc668b-a4a5-4ea8-b4cf-deec19cfbdff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051613 Aug 24 05:10:56.801897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 358/822] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:56.856062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3ab1e504-11b8-49c6-84d4-8207d393a92d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:56.858178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3ab1e504-11b8-49c6-84d4-8207d393a92d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:56.864775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ab1e504-11b8-49c6-84d4-8207d393a92d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:56.865257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ab1e504-11b8-49c6-84d4-8207d393a92d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:56.865694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ab1e504-11b8-49c6-84d4-8207d393a92d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:56.866394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ab1e504-11b8-49c6-84d4-8207d393a92d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:56.866934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ab1e504-11b8-49c6-84d4-8207d393a92d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:56.867489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ab1e504-11b8-49c6-84d4-8207d393a92d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:56.881503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-65174d51-92d4-49ef-9a5b-bc901950398e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:56.883846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-65174d51-92d4-49ef-9a5b-bc901950398e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:56.890313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65174d51-92d4-49ef-9a5b-bc901950398e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:56.890835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65174d51-92d4-49ef-9a5b-bc901950398e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:56.891274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65174d51-92d4-49ef-9a5b-bc901950398e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:56.893357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65174d51-92d4-49ef-9a5b-bc901950398e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:56.893357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65174d51-92d4-49ef-9a5b-bc901950398e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:56.893357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65174d51-92d4-49ef-9a5b-bc901950398e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:56.900705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3ab1e504-11b8-49c6-84d4-8207d393a92d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051351 Aug 24 05:10:56.901286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 465/823] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:56.927757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-65174d51-92d4-49ef-9a5b-bc901950398e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050165 Aug 24 05:10:56.928339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 359/824] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:57.813749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-663dc8a0-e4d8-48bd-9930-c232a7c11cd7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:57.815900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-663dc8a0-e4d8-48bd-9930-c232a7c11cd7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:57.822667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-663dc8a0-e4d8-48bd-9930-c232a7c11cd7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:57.823171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-663dc8a0-e4d8-48bd-9930-c232a7c11cd7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:57.823609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-663dc8a0-e4d8-48bd-9930-c232a7c11cd7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:57.824310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-663dc8a0-e4d8-48bd-9930-c232a7c11cd7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:57.824762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-663dc8a0-e4d8-48bd-9930-c232a7c11cd7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:57.825188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-663dc8a0-e4d8-48bd-9930-c232a7c11cd7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:57.856650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-663dc8a0-e4d8-48bd-9930-c232a7c11cd7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046841 Aug 24 05:10:57.857313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 466/825] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:57.913175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-55c171c9-e3da-4df6-8893-d765c3c255ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:57.916071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-55c171c9-e3da-4df6-8893-d765c3c255ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:57.922641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55c171c9-e3da-4df6-8893-d765c3c255ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:57.923155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55c171c9-e3da-4df6-8893-d765c3c255ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:57.923589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55c171c9-e3da-4df6-8893-d765c3c255ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:57.924282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55c171c9-e3da-4df6-8893-d765c3c255ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:57.925023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55c171c9-e3da-4df6-8893-d765c3c255ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:57.925440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55c171c9-e3da-4df6-8893-d765c3c255ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:57.940597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-83d0a8d6-a079-4832-9f2d-c90044fd10fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:57.942788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-83d0a8d6-a079-4832-9f2d-c90044fd10fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:57.949322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83d0a8d6-a079-4832-9f2d-c90044fd10fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:57.949802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83d0a8d6-a079-4832-9f2d-c90044fd10fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:57.950264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83d0a8d6-a079-4832-9f2d-c90044fd10fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:57.950962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83d0a8d6-a079-4832-9f2d-c90044fd10fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:57.951408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83d0a8d6-a079-4832-9f2d-c90044fd10fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:57.951831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83d0a8d6-a079-4832-9f2d-c90044fd10fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:57.956706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-55c171c9-e3da-4df6-8893-d765c3c255ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047471 Aug 24 05:10:57.957292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 360/826] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:57.983682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-83d0a8d6-a079-4832-9f2d-c90044fd10fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046948 Aug 24 05:10:57.984256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 467/827] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:58.869855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9c9fee4e-4aa5-4dfc-a2e5-304c16c3610a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:58.872022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9c9fee4e-4aa5-4dfc-a2e5-304c16c3610a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:58.878078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9fee4e-4aa5-4dfc-a2e5-304c16c3610a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:58.878556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9fee4e-4aa5-4dfc-a2e5-304c16c3610a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:58.879018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9fee4e-4aa5-4dfc-a2e5-304c16c3610a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:58.879710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9fee4e-4aa5-4dfc-a2e5-304c16c3610a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:58.880159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9fee4e-4aa5-4dfc-a2e5-304c16c3610a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:58.880577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c9fee4e-4aa5-4dfc-a2e5-304c16c3610a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:58.911529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9c9fee4e-4aa5-4dfc-a2e5-304c16c3610a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 Aug 24 05:10:58.912093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 361/828] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:58.969495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5371e10b-3bc0-4bd1-aaa0-b4bb13f228c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:58.971692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5371e10b-3bc0-4bd1-aaa0-b4bb13f228c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:58.978847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5371e10b-3bc0-4bd1-aaa0-b4bb13f228c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:58.979329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5371e10b-3bc0-4bd1-aaa0-b4bb13f228c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:58.979761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5371e10b-3bc0-4bd1-aaa0-b4bb13f228c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:58.980543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5371e10b-3bc0-4bd1-aaa0-b4bb13f228c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:58.981009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5371e10b-3bc0-4bd1-aaa0-b4bb13f228c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:58.981417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5371e10b-3bc0-4bd1-aaa0-b4bb13f228c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:58.996915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-47fc2784-34d6-4adc-a8c6-4fd3726caff1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:58.999026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-47fc2784-34d6-4adc-a8c6-4fd3726caff1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:59.002449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:59.007026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fc2784-34d6-4adc-a8c6-4fd3726caff1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:59.007724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fc2784-34d6-4adc-a8c6-4fd3726caff1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:59.008276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fc2784-34d6-4adc-a8c6-4fd3726caff1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:59.008979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fc2784-34d6-4adc-a8c6-4fd3726caff1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:59.009433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fc2784-34d6-4adc-a8c6-4fd3726caff1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:59.009860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47fc2784-34d6-4adc-a8c6-4fd3726caff1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:59.013659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5371e10b-3bc0-4bd1-aaa0-b4bb13f228c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048068 Aug 24 05:10:59.014451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 468/829] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:10:59.043100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-47fc2784-34d6-4adc-a8c6-4fd3726caff1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050861 Aug 24 05:10:59.043773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 362/830] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:10:59.924944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c0d956aa-e3b8-424a-af3a-59c6802443e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:10:59.927218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c0d956aa-e3b8-424a-af3a-59c6802443e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:10:59.933710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0d956aa-e3b8-424a-af3a-59c6802443e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:59.934189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0d956aa-e3b8-424a-af3a-59c6802443e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:59.934622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0d956aa-e3b8-424a-af3a-59c6802443e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:59.935333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0d956aa-e3b8-424a-af3a-59c6802443e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:10:59.935779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0d956aa-e3b8-424a-af3a-59c6802443e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:10:59.936193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0d956aa-e3b8-424a-af3a-59c6802443e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:10:59.966533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c0d956aa-e3b8-424a-af3a-59c6802443e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045776 Aug 24 05:10:59.967359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 469/831] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:10:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:00.026230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9734ce4e-2708-4e26-8fcf-aaa73ae656de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:00.028321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9734ce4e-2708-4e26-8fcf-aaa73ae656de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:00.035221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9734ce4e-2708-4e26-8fcf-aaa73ae656de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:00.035698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9734ce4e-2708-4e26-8fcf-aaa73ae656de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:00.036123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9734ce4e-2708-4e26-8fcf-aaa73ae656de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:00.036826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9734ce4e-2708-4e26-8fcf-aaa73ae656de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:00.037266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9734ce4e-2708-4e26-8fcf-aaa73ae656de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:00.037682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9734ce4e-2708-4e26-8fcf-aaa73ae656de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:00.058075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7bfc0ee9-205d-4866-84f7-9c79cd86dfc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:00.060586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7bfc0ee9-205d-4866-84f7-9c79cd86dfc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:00.067019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfc0ee9-205d-4866-84f7-9c79cd86dfc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:00.067501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfc0ee9-205d-4866-84f7-9c79cd86dfc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:00.067937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfc0ee9-205d-4866-84f7-9c79cd86dfc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:00.068824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfc0ee9-205d-4866-84f7-9c79cd86dfc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:00.069278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfc0ee9-205d-4866-84f7-9c79cd86dfc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:00.069701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bfc0ee9-205d-4866-84f7-9c79cd86dfc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:00.071292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9734ce4e-2708-4e26-8fcf-aaa73ae656de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049585 Aug 24 05:11:00.071867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 363/832] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:00.102863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7bfc0ee9-205d-4866-84f7-9c79cd86dfc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051365 Aug 24 05:11:00.103449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 470/833] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:00.588963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:11:00.589191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:11:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:11:00.979312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1000fc51-c91b-4591-a09b-c20f04558937 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:00.981601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1000fc51-c91b-4591-a09b-c20f04558937 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:00.987891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1000fc51-c91b-4591-a09b-c20f04558937 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:00.988322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1000fc51-c91b-4591-a09b-c20f04558937 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:00.988756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1000fc51-c91b-4591-a09b-c20f04558937 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:00.989457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1000fc51-c91b-4591-a09b-c20f04558937 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:00.989911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1000fc51-c91b-4591-a09b-c20f04558937 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:00.990335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1000fc51-c91b-4591-a09b-c20f04558937 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:01.021508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1000fc51-c91b-4591-a09b-c20f04558937 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Aug 24 05:11:01.022073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 364/834] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:01.083825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-184a6e1d-8217-43a3-8e53-b21694a69f37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:01.086090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-184a6e1d-8217-43a3-8e53-b21694a69f37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:01.092941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-184a6e1d-8217-43a3-8e53-b21694a69f37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:01.093418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-184a6e1d-8217-43a3-8e53-b21694a69f37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:01.093848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-184a6e1d-8217-43a3-8e53-b21694a69f37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:01.094543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-184a6e1d-8217-43a3-8e53-b21694a69f37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:01.095011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-184a6e1d-8217-43a3-8e53-b21694a69f37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:01.095435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-184a6e1d-8217-43a3-8e53-b21694a69f37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:01.115512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9d511488-935f-4648-8b65-dd83ad368f6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:01.118448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9d511488-935f-4648-8b65-dd83ad368f6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:01.125191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d511488-935f-4648-8b65-dd83ad368f6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:01.125955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d511488-935f-4648-8b65-dd83ad368f6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:01.126498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d511488-935f-4648-8b65-dd83ad368f6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:01.127426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d511488-935f-4648-8b65-dd83ad368f6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:01.127901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d511488-935f-4648-8b65-dd83ad368f6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:01.128508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-184a6e1d-8217-43a3-8e53-b21694a69f37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048631 Aug 24 05:11:01.128691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d511488-935f-4648-8b65-dd83ad368f6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:01.129081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 471/835] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:01.165897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9d511488-935f-4648-8b65-dd83ad368f6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054278 Aug 24 05:11:01.166474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 365/836] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:02.033802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82da1543-c1e9-4a8e-99bb-51f360478e87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:02.035976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-82da1543-c1e9-4a8e-99bb-51f360478e87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:02.043968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82da1543-c1e9-4a8e-99bb-51f360478e87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:02.044443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82da1543-c1e9-4a8e-99bb-51f360478e87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:02.044873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82da1543-c1e9-4a8e-99bb-51f360478e87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:02.045558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82da1543-c1e9-4a8e-99bb-51f360478e87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:02.046003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82da1543-c1e9-4a8e-99bb-51f360478e87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:02.046419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82da1543-c1e9-4a8e-99bb-51f360478e87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:02.080896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-82da1543-c1e9-4a8e-99bb-51f360478e87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051148 Aug 24 05:11:02.081450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 472/837] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:02.142776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e407624a-c04c-42e1-9c0d-e5db9c5f2a2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:02.144899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e407624a-c04c-42e1-9c0d-e5db9c5f2a2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:02.152199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e407624a-c04c-42e1-9c0d-e5db9c5f2a2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:02.152673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e407624a-c04c-42e1-9c0d-e5db9c5f2a2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:02.153099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e407624a-c04c-42e1-9c0d-e5db9c5f2a2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:02.153794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e407624a-c04c-42e1-9c0d-e5db9c5f2a2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:02.154250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e407624a-c04c-42e1-9c0d-e5db9c5f2a2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:02.154655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e407624a-c04c-42e1-9c0d-e5db9c5f2a2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:02.177767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-72ab402a-66ec-4ce8-a14d-4b0cfd0d90b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:02.180111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-72ab402a-66ec-4ce8-a14d-4b0cfd0d90b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:02.185439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e407624a-c04c-42e1-9c0d-e5db9c5f2a2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046683 Aug 24 05:11:02.186020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 366/838] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:02.186489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ab402a-66ec-4ce8-a14d-4b0cfd0d90b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:02.187000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ab402a-66ec-4ce8-a14d-4b0cfd0d90b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:02.187435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ab402a-66ec-4ce8-a14d-4b0cfd0d90b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:02.188130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ab402a-66ec-4ce8-a14d-4b0cfd0d90b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:02.188578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ab402a-66ec-4ce8-a14d-4b0cfd0d90b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:02.188994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ab402a-66ec-4ce8-a14d-4b0cfd0d90b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:02.222121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-72ab402a-66ec-4ce8-a14d-4b0cfd0d90b4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048540 Aug 24 05:11:02.222740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 473/839] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:03.096588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-09d9dbad-9dbe-4e9d-8dbb-8e54a80235e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:03.098641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-09d9dbad-9dbe-4e9d-8dbb-8e54a80235e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:03.105178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09d9dbad-9dbe-4e9d-8dbb-8e54a80235e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:03.105648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09d9dbad-9dbe-4e9d-8dbb-8e54a80235e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:03.106075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09d9dbad-9dbe-4e9d-8dbb-8e54a80235e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:03.106779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09d9dbad-9dbe-4e9d-8dbb-8e54a80235e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:03.107227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09d9dbad-9dbe-4e9d-8dbb-8e54a80235e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:03.107643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09d9dbad-9dbe-4e9d-8dbb-8e54a80235e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:03.143704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-09d9dbad-9dbe-4e9d-8dbb-8e54a80235e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051112 Aug 24 05:11:03.144374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 367/840] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:03 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:03.198194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-57434c4a-129d-46d1-a48c-3988bcf0d6d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:03.200393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-57434c4a-129d-46d1-a48c-3988bcf0d6d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:03.206965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57434c4a-129d-46d1-a48c-3988bcf0d6d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:03.207440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57434c4a-129d-46d1-a48c-3988bcf0d6d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:03.207874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57434c4a-129d-46d1-a48c-3988bcf0d6d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:03.208555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57434c4a-129d-46d1-a48c-3988bcf0d6d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:03.209004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57434c4a-129d-46d1-a48c-3988bcf0d6d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:03.209423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57434c4a-129d-46d1-a48c-3988bcf0d6d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:03.235834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9b84c0d3-f417-4045-a393-cef9473d86fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:03.238072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9b84c0d3-f417-4045-a393-cef9473d86fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:03.245997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b84c0d3-f417-4045-a393-cef9473d86fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:03.246490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b84c0d3-f417-4045-a393-cef9473d86fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:03.246969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b84c0d3-f417-4045-a393-cef9473d86fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:03.247678 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b84c0d3-f417-4045-a393-cef9473d86fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:03.248153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b84c0d3-f417-4045-a393-cef9473d86fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:03.248570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b84c0d3-f417-4045-a393-cef9473d86fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:03.282263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9b84c0d3-f417-4045-a393-cef9473d86fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050415 Aug 24 05:11:03.283162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 368/841] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:03 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:03.391613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-57434c4a-129d-46d1-a48c-3988bcf0d6d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.197489 Aug 24 05:11:03.392083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 474/842] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:04.155815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d7783d7c-fa6e-47ae-abf8-3bac0448bbf5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:04.157977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d7783d7c-fa6e-47ae-abf8-3bac0448bbf5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:04.164221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7783d7c-fa6e-47ae-abf8-3bac0448bbf5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:04.164697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7783d7c-fa6e-47ae-abf8-3bac0448bbf5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:04.165127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7783d7c-fa6e-47ae-abf8-3bac0448bbf5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:04.165821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7783d7c-fa6e-47ae-abf8-3bac0448bbf5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:04.166269 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7783d7c-fa6e-47ae-abf8-3bac0448bbf5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:04.166707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7783d7c-fa6e-47ae-abf8-3bac0448bbf5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:04.170613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:04.198963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d7783d7c-fa6e-47ae-abf8-3bac0448bbf5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047054 Aug 24 05:11:04.199537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 369/843] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:04.295405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-46a9d25d-27e5-41ef-ba00-9e7ded97d48f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:04.297512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-46a9d25d-27e5-41ef-ba00-9e7ded97d48f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:04.301297 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:04.305943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46a9d25d-27e5-41ef-ba00-9e7ded97d48f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:04.306425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46a9d25d-27e5-41ef-ba00-9e7ded97d48f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:04.306889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46a9d25d-27e5-41ef-ba00-9e7ded97d48f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:04.307590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46a9d25d-27e5-41ef-ba00-9e7ded97d48f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:04.308039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46a9d25d-27e5-41ef-ba00-9e7ded97d48f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:04.308463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-46a9d25d-27e5-41ef-ba00-9e7ded97d48f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:04.339903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-46a9d25d-27e5-41ef-ba00-9e7ded97d48f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048451 Aug 24 05:11:04.340670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 475/844] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:04.405000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0cf592af-046c-4c8a-95fe-bd700dc31b54 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:04.407263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0cf592af-046c-4c8a-95fe-bd700dc31b54 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:04.413927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf592af-046c-4c8a-95fe-bd700dc31b54 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:04.414412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf592af-046c-4c8a-95fe-bd700dc31b54 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:04.414882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf592af-046c-4c8a-95fe-bd700dc31b54 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:04.415597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf592af-046c-4c8a-95fe-bd700dc31b54 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:04.416050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf592af-046c-4c8a-95fe-bd700dc31b54 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:04.416471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf592af-046c-4c8a-95fe-bd700dc31b54 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:04.447829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0cf592af-046c-4c8a-95fe-bd700dc31b54 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046824 Aug 24 05:11:04.448403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 370/845] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:05.211651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f5593241-c157-40d3-a701-2ed785ad89c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:05.213800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f5593241-c157-40d3-a701-2ed785ad89c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:05.221278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5593241-c157-40d3-a701-2ed785ad89c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:05.221752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5593241-c157-40d3-a701-2ed785ad89c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:05.222181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5593241-c157-40d3-a701-2ed785ad89c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:05.222900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5593241-c157-40d3-a701-2ed785ad89c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:05.223351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5593241-c157-40d3-a701-2ed785ad89c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:05.223769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5593241-c157-40d3-a701-2ed785ad89c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:05.241250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:05.256839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f5593241-c157-40d3-a701-2ed785ad89c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049240 Aug 24 05:11:05.257926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 476/846] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:05.352721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-421f269d-7309-44bb-a5da-e47b15c67c17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:05.354900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-421f269d-7309-44bb-a5da-e47b15c67c17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:05.360987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-421f269d-7309-44bb-a5da-e47b15c67c17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:05.361465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-421f269d-7309-44bb-a5da-e47b15c67c17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:05.361897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-421f269d-7309-44bb-a5da-e47b15c67c17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:05.362599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-421f269d-7309-44bb-a5da-e47b15c67c17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:05.363074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-421f269d-7309-44bb-a5da-e47b15c67c17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:05.363494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-421f269d-7309-44bb-a5da-e47b15c67c17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:05.394995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-421f269d-7309-44bb-a5da-e47b15c67c17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046259 Aug 24 05:11:05.395569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 371/847] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:05.460933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0c80240e-005a-4d6f-8343-25fe9496020d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:05.463246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0c80240e-005a-4d6f-8343-25fe9496020d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:05.469555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c80240e-005a-4d6f-8343-25fe9496020d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:05.470036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c80240e-005a-4d6f-8343-25fe9496020d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:05.470472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c80240e-005a-4d6f-8343-25fe9496020d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:05.471199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c80240e-005a-4d6f-8343-25fe9496020d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:05.471645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c80240e-005a-4d6f-8343-25fe9496020d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:05.472065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c80240e-005a-4d6f-8343-25fe9496020d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:05.506024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0c80240e-005a-4d6f-8343-25fe9496020d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049499 Aug 24 05:11:05.506580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 477/848] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:06.111665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:11:06.111900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:11:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:11:06.271292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6daab94a-1874-4c94-b451-8752be66e2cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:06.273754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6daab94a-1874-4c94-b451-8752be66e2cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:06.280369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6daab94a-1874-4c94-b451-8752be66e2cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:06.280854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6daab94a-1874-4c94-b451-8752be66e2cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:06.281289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6daab94a-1874-4c94-b451-8752be66e2cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:06.281986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6daab94a-1874-4c94-b451-8752be66e2cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:06.282438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6daab94a-1874-4c94-b451-8752be66e2cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:06.282890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6daab94a-1874-4c94-b451-8752be66e2cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:06.314742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6daab94a-1874-4c94-b451-8752be66e2cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047362 Aug 24 05:11:06.315315 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 372/849] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:06.408330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-15f65134-4b9c-4cdb-b10b-10ae562e7e38 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:06.410373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-15f65134-4b9c-4cdb-b10b-10ae562e7e38 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:06.417289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15f65134-4b9c-4cdb-b10b-10ae562e7e38 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:06.417761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15f65134-4b9c-4cdb-b10b-10ae562e7e38 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:06.418190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15f65134-4b9c-4cdb-b10b-10ae562e7e38 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:06.418912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15f65134-4b9c-4cdb-b10b-10ae562e7e38 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:06.419354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15f65134-4b9c-4cdb-b10b-10ae562e7e38 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:06.419766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15f65134-4b9c-4cdb-b10b-10ae562e7e38 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:06.452026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-15f65134-4b9c-4cdb-b10b-10ae562e7e38 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047427 Aug 24 05:11:06.452591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 478/850] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:06.519680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1ce60d60-0fc2-4bd5-a081-e005e00aa66d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:06.521930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1ce60d60-0fc2-4bd5-a081-e005e00aa66d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:06.528191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ce60d60-0fc2-4bd5-a081-e005e00aa66d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:06.528675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ce60d60-0fc2-4bd5-a081-e005e00aa66d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:06.529113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ce60d60-0fc2-4bd5-a081-e005e00aa66d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:06.529813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ce60d60-0fc2-4bd5-a081-e005e00aa66d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:06.530267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ce60d60-0fc2-4bd5-a081-e005e00aa66d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:06.530710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ce60d60-0fc2-4bd5-a081-e005e00aa66d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:06.564473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1ce60d60-0fc2-4bd5-a081-e005e00aa66d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048860 Aug 24 05:11:06.565038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 373/851] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:07.327346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bfbba87f-6d93-4f65-a400-3705b5ce7a6e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:07.329464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bfbba87f-6d93-4f65-a400-3705b5ce7a6e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:07.336894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bfbba87f-6d93-4f65-a400-3705b5ce7a6e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:07.337376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bfbba87f-6d93-4f65-a400-3705b5ce7a6e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:07.337812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bfbba87f-6d93-4f65-a400-3705b5ce7a6e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:07.338512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bfbba87f-6d93-4f65-a400-3705b5ce7a6e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:07.338987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bfbba87f-6d93-4f65-a400-3705b5ce7a6e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:07.339410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bfbba87f-6d93-4f65-a400-3705b5ce7a6e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:07.370930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bfbba87f-6d93-4f65-a400-3705b5ce7a6e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047505 Aug 24 05:11:07.371485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 479/852] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:07.467454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-93c8f306-27bb-4683-8994-accfb815ebe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:07.469578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-93c8f306-27bb-4683-8994-accfb815ebe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:07.475746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93c8f306-27bb-4683-8994-accfb815ebe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:07.476826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93c8f306-27bb-4683-8994-accfb815ebe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:07.477292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93c8f306-27bb-4683-8994-accfb815ebe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:07.478053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93c8f306-27bb-4683-8994-accfb815ebe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:07.478502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93c8f306-27bb-4683-8994-accfb815ebe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:07.478947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93c8f306-27bb-4683-8994-accfb815ebe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:07.509375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-93c8f306-27bb-4683-8994-accfb815ebe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045897 Aug 24 05:11:07.509938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 374/853] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:07.576878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-86e08332-9de8-4a6e-9d04-2cb6393adb59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:07.579121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-86e08332-9de8-4a6e-9d04-2cb6393adb59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:07.585038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86e08332-9de8-4a6e-9d04-2cb6393adb59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:07.585651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86e08332-9de8-4a6e-9d04-2cb6393adb59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:07.586100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86e08332-9de8-4a6e-9d04-2cb6393adb59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:07.586820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86e08332-9de8-4a6e-9d04-2cb6393adb59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:07.587278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86e08332-9de8-4a6e-9d04-2cb6393adb59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:07.587698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86e08332-9de8-4a6e-9d04-2cb6393adb59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:07.621021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-86e08332-9de8-4a6e-9d04-2cb6393adb59 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048068 Aug 24 05:11:07.621588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 480/854] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:08.384105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a844ee6c-a20e-4800-9d96-fa512d009320 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:08.386311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a844ee6c-a20e-4800-9d96-fa512d009320 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:08.392423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a844ee6c-a20e-4800-9d96-fa512d009320 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:08.392908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a844ee6c-a20e-4800-9d96-fa512d009320 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:08.393347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a844ee6c-a20e-4800-9d96-fa512d009320 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:08.394045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a844ee6c-a20e-4800-9d96-fa512d009320 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:08.394501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a844ee6c-a20e-4800-9d96-fa512d009320 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:08.394949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a844ee6c-a20e-4800-9d96-fa512d009320 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:08.426960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a844ee6c-a20e-4800-9d96-fa512d009320 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047550 Aug 24 05:11:08.427523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 375/855] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:08.521771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-115ad211-64d7-492e-b641-61a1e1c9c800 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:08.524022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-115ad211-64d7-492e-b641-61a1e1c9c800 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:08.530637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-115ad211-64d7-492e-b641-61a1e1c9c800 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:08.531146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-115ad211-64d7-492e-b641-61a1e1c9c800 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:08.531574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-115ad211-64d7-492e-b641-61a1e1c9c800 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:08.532262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-115ad211-64d7-492e-b641-61a1e1c9c800 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:08.532707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-115ad211-64d7-492e-b641-61a1e1c9c800 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:08.533121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-115ad211-64d7-492e-b641-61a1e1c9c800 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:08.565550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-115ad211-64d7-492e-b641-61a1e1c9c800 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047733 Aug 24 05:11:08.566101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 481/856] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:08.633438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f3480f5e-a2a0-4b3c-954b-c80a215fde73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:08.635785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f3480f5e-a2a0-4b3c-954b-c80a215fde73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:08.642209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3480f5e-a2a0-4b3c-954b-c80a215fde73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:08.642706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3480f5e-a2a0-4b3c-954b-c80a215fde73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:08.643166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3480f5e-a2a0-4b3c-954b-c80a215fde73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:08.643858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3480f5e-a2a0-4b3c-954b-c80a215fde73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:08.644312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3480f5e-a2a0-4b3c-954b-c80a215fde73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:08.644735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3480f5e-a2a0-4b3c-954b-c80a215fde73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:08.675908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f3480f5e-a2a0-4b3c-954b-c80a215fde73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046552 Aug 24 05:11:08.676476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 376/857] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:09.439758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5130b474-35c9-45c8-83f5-95940f82c3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:09.441914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5130b474-35c9-45c8-83f5-95940f82c3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:09.449980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5130b474-35c9-45c8-83f5-95940f82c3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:09.450461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5130b474-35c9-45c8-83f5-95940f82c3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:09.450927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5130b474-35c9-45c8-83f5-95940f82c3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:09.451624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5130b474-35c9-45c8-83f5-95940f82c3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:09.452072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5130b474-35c9-45c8-83f5-95940f82c3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:09.452488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5130b474-35c9-45c8-83f5-95940f82c3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:09.483774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5130b474-35c9-45c8-83f5-95940f82c3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046607 Aug 24 05:11:09.483774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 482/858] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:09.578931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-32fda269-0123-4f8f-97ab-2d4e1fcde8dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:09.581091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-32fda269-0123-4f8f-97ab-2d4e1fcde8dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:09.588883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fda269-0123-4f8f-97ab-2d4e1fcde8dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:09.589751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fda269-0123-4f8f-97ab-2d4e1fcde8dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:09.590510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fda269-0123-4f8f-97ab-2d4e1fcde8dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:09.591264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fda269-0123-4f8f-97ab-2d4e1fcde8dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:09.591729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fda269-0123-4f8f-97ab-2d4e1fcde8dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:09.592184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fda269-0123-4f8f-97ab-2d4e1fcde8dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:09.623670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-32fda269-0123-4f8f-97ab-2d4e1fcde8dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048771 Aug 24 05:11:09.624241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 377/859] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:09.688465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-52836b45-b82f-4b0f-a48d-c82fb1aee56d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:09.690731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-52836b45-b82f-4b0f-a48d-c82fb1aee56d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:09.697347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52836b45-b82f-4b0f-a48d-c82fb1aee56d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:09.697828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52836b45-b82f-4b0f-a48d-c82fb1aee56d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:09.698256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52836b45-b82f-4b0f-a48d-c82fb1aee56d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:09.698970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52836b45-b82f-4b0f-a48d-c82fb1aee56d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:09.699411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52836b45-b82f-4b0f-a48d-c82fb1aee56d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:09.699817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52836b45-b82f-4b0f-a48d-c82fb1aee56d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:09.731576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-52836b45-b82f-4b0f-a48d-c82fb1aee56d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047029 Aug 24 05:11:09.732150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 483/860] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:10.495493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5ef54168-5fe4-4408-94cd-59c2dcf1320a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:10.497645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5ef54168-5fe4-4408-94cd-59c2dcf1320a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:10.504107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef54168-5fe4-4408-94cd-59c2dcf1320a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:10.504583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef54168-5fe4-4408-94cd-59c2dcf1320a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:10.505010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef54168-5fe4-4408-94cd-59c2dcf1320a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:10.505688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef54168-5fe4-4408-94cd-59c2dcf1320a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:10.506133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef54168-5fe4-4408-94cd-59c2dcf1320a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:10.506550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef54168-5fe4-4408-94cd-59c2dcf1320a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:10.536585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5ef54168-5fe4-4408-94cd-59c2dcf1320a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045314 Aug 24 05:11:10.537140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 378/861] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:10.636429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-50afcdb9-4499-40a7-b82f-2d1cb341a45f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:10.638543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-50afcdb9-4499-40a7-b82f-2d1cb341a45f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:10.644578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50afcdb9-4499-40a7-b82f-2d1cb341a45f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:10.645059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50afcdb9-4499-40a7-b82f-2d1cb341a45f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:10.645490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50afcdb9-4499-40a7-b82f-2d1cb341a45f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:10.646174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50afcdb9-4499-40a7-b82f-2d1cb341a45f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:10.646618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50afcdb9-4499-40a7-b82f-2d1cb341a45f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:10.647062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50afcdb9-4499-40a7-b82f-2d1cb341a45f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:10.677520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-50afcdb9-4499-40a7-b82f-2d1cb341a45f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045649 Aug 24 05:11:10.678073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 484/862] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:10.743634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-611ba995-cfe1-4034-9d38-0bcc1f6a3626 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:10.745820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-611ba995-cfe1-4034-9d38-0bcc1f6a3626 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:10.752437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-611ba995-cfe1-4034-9d38-0bcc1f6a3626 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:10.752923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-611ba995-cfe1-4034-9d38-0bcc1f6a3626 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:10.753357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-611ba995-cfe1-4034-9d38-0bcc1f6a3626 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:10.754048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-611ba995-cfe1-4034-9d38-0bcc1f6a3626 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:10.754498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-611ba995-cfe1-4034-9d38-0bcc1f6a3626 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:10.754966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-611ba995-cfe1-4034-9d38-0bcc1f6a3626 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:10.784900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-611ba995-cfe1-4034-9d38-0bcc1f6a3626 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045821 Aug 24 05:11:10.785758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 379/863] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:11.548914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-95c49cde-e38b-4bbf-baa1-8be242e19f84 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:11.551386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-95c49cde-e38b-4bbf-baa1-8be242e19f84 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:11.559073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95c49cde-e38b-4bbf-baa1-8be242e19f84 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:11.559555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95c49cde-e38b-4bbf-baa1-8be242e19f84 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:11.560018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95c49cde-e38b-4bbf-baa1-8be242e19f84 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:11.560710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95c49cde-e38b-4bbf-baa1-8be242e19f84 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:11.561156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95c49cde-e38b-4bbf-baa1-8be242e19f84 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:11.561572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95c49cde-e38b-4bbf-baa1-8be242e19f84 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:11.593504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-95c49cde-e38b-4bbf-baa1-8be242e19f84 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048506 Aug 24 05:11:11.594078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 485/864] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:11.690565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ac1efe7f-b5db-4839-8e77-bf5a1f5fbf92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:11.692735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ac1efe7f-b5db-4839-8e77-bf5a1f5fbf92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:11.700513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac1efe7f-b5db-4839-8e77-bf5a1f5fbf92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:11.701002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac1efe7f-b5db-4839-8e77-bf5a1f5fbf92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:11.701434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac1efe7f-b5db-4839-8e77-bf5a1f5fbf92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:11.702145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac1efe7f-b5db-4839-8e77-bf5a1f5fbf92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:11.702593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac1efe7f-b5db-4839-8e77-bf5a1f5fbf92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:11.703045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac1efe7f-b5db-4839-8e77-bf5a1f5fbf92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:11.733653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ac1efe7f-b5db-4839-8e77-bf5a1f5fbf92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046962 Aug 24 05:11:11.734232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 380/865] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:11.798761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-21340516-b0be-455f-b646-c5d2bbc4440a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:11.801462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-21340516-b0be-455f-b646-c5d2bbc4440a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:11.808093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21340516-b0be-455f-b646-c5d2bbc4440a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:11.808565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21340516-b0be-455f-b646-c5d2bbc4440a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:11.808997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21340516-b0be-455f-b646-c5d2bbc4440a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:11.809681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21340516-b0be-455f-b646-c5d2bbc4440a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:11.810125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21340516-b0be-455f-b646-c5d2bbc4440a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:11.810539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21340516-b0be-455f-b646-c5d2bbc4440a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:11.839978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-21340516-b0be-455f-b646-c5d2bbc4440a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046453 Aug 24 05:11:11.840530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 486/866] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:12.605732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dd790235-e683-4773-9052-30bb28139d58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:12.607894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dd790235-e683-4773-9052-30bb28139d58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:12.613871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd790235-e683-4773-9052-30bb28139d58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:12.614356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd790235-e683-4773-9052-30bb28139d58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:12.614829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd790235-e683-4773-9052-30bb28139d58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:12.615525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd790235-e683-4773-9052-30bb28139d58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:12.616082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd790235-e683-4773-9052-30bb28139d58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:12.616516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd790235-e683-4773-9052-30bb28139d58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:12.646307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dd790235-e683-4773-9052-30bb28139d58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044877 Aug 24 05:11:12.646885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 381/867] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:12.745942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-69e97198-eef8-45a1-8a3b-246f529d1f9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:12.748157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-69e97198-eef8-45a1-8a3b-246f529d1f9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:12.755642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e97198-eef8-45a1-8a3b-246f529d1f9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:12.756352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e97198-eef8-45a1-8a3b-246f529d1f9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:12.756821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e97198-eef8-45a1-8a3b-246f529d1f9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:12.758306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e97198-eef8-45a1-8a3b-246f529d1f9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:12.758787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e97198-eef8-45a1-8a3b-246f529d1f9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:12.759225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e97198-eef8-45a1-8a3b-246f529d1f9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:12.792683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-69e97198-eef8-45a1-8a3b-246f529d1f9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050680 Aug 24 05:11:12.793254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 487/868] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:12.853337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0c010b6f-6ecb-4da4-ac3b-6a7fbdca215a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:12.855708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0c010b6f-6ecb-4da4-ac3b-6a7fbdca215a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:12.862279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c010b6f-6ecb-4da4-ac3b-6a7fbdca215a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:12.862873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c010b6f-6ecb-4da4-ac3b-6a7fbdca215a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:12.863334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c010b6f-6ecb-4da4-ac3b-6a7fbdca215a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:12.864020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c010b6f-6ecb-4da4-ac3b-6a7fbdca215a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:12.864468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c010b6f-6ecb-4da4-ac3b-6a7fbdca215a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:12.864891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c010b6f-6ecb-4da4-ac3b-6a7fbdca215a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:12.895863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0c010b6f-6ecb-4da4-ac3b-6a7fbdca215a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046796 Aug 24 05:11:12.896433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 382/869] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:13.659343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fcbc871c-78bd-4b1e-9470-8f300602d6a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:13.661455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fcbc871c-78bd-4b1e-9470-8f300602d6a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:13.668411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcbc871c-78bd-4b1e-9470-8f300602d6a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:13.668888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcbc871c-78bd-4b1e-9470-8f300602d6a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:13.669317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcbc871c-78bd-4b1e-9470-8f300602d6a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:13.670032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcbc871c-78bd-4b1e-9470-8f300602d6a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:13.670475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcbc871c-78bd-4b1e-9470-8f300602d6a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:13.670908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcbc871c-78bd-4b1e-9470-8f300602d6a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:13.700631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fcbc871c-78bd-4b1e-9470-8f300602d6a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045135 Aug 24 05:11:13.701179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 488/870] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:13.805502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e871b01a-f7d5-44e8-b1d3-644b0afd894c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:13.807695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e871b01a-f7d5-44e8-b1d3-644b0afd894c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:13.813719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e871b01a-f7d5-44e8-b1d3-644b0afd894c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:13.814205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e871b01a-f7d5-44e8-b1d3-644b0afd894c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:13.814649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e871b01a-f7d5-44e8-b1d3-644b0afd894c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:13.815360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e871b01a-f7d5-44e8-b1d3-644b0afd894c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:13.815814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e871b01a-f7d5-44e8-b1d3-644b0afd894c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:13.816237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e871b01a-f7d5-44e8-b1d3-644b0afd894c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:13.845969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e871b01a-f7d5-44e8-b1d3-644b0afd894c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044536 Aug 24 05:11:13.846528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 383/871] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:13.909046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-20c95798-556b-4db9-b9bd-74944ccdc67e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:13.911498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-20c95798-556b-4db9-b9bd-74944ccdc67e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:13.918938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20c95798-556b-4db9-b9bd-74944ccdc67e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:13.919421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20c95798-556b-4db9-b9bd-74944ccdc67e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:13.919881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20c95798-556b-4db9-b9bd-74944ccdc67e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:13.920570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20c95798-556b-4db9-b9bd-74944ccdc67e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:13.921017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20c95798-556b-4db9-b9bd-74944ccdc67e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:13.921467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20c95798-556b-4db9-b9bd-74944ccdc67e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:13.952238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-20c95798-556b-4db9-b9bd-74944ccdc67e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047063 Aug 24 05:11:13.952834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 489/872] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:14.713261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-de27f9b3-e663-48ff-b65f-00d46317ec0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:14.715516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-de27f9b3-e663-48ff-b65f-00d46317ec0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:14.722318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de27f9b3-e663-48ff-b65f-00d46317ec0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:14.722822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de27f9b3-e663-48ff-b65f-00d46317ec0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:14.723263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de27f9b3-e663-48ff-b65f-00d46317ec0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:14.723966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de27f9b3-e663-48ff-b65f-00d46317ec0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:14.724426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de27f9b3-e663-48ff-b65f-00d46317ec0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:14.724852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de27f9b3-e663-48ff-b65f-00d46317ec0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:14.758425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-de27f9b3-e663-48ff-b65f-00d46317ec0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048452 Aug 24 05:11:14.759017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 384/873] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:14.858360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a04af0a3-925a-421e-ac9e-a8924c06cd29 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:14.860509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a04af0a3-925a-421e-ac9e-a8924c06cd29 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:14.867304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04af0a3-925a-421e-ac9e-a8924c06cd29 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:14.867897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04af0a3-925a-421e-ac9e-a8924c06cd29 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:14.868443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04af0a3-925a-421e-ac9e-a8924c06cd29 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:14.869139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04af0a3-925a-421e-ac9e-a8924c06cd29 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:14.869590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04af0a3-925a-421e-ac9e-a8924c06cd29 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:14.870009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a04af0a3-925a-421e-ac9e-a8924c06cd29 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:14.900606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a04af0a3-925a-421e-ac9e-a8924c06cd29 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046180 Aug 24 05:11:14.901166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 490/874] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:14 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:14.965022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4c7bf85c-6e19-4ef4-83cc-aeb9d0e069b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:14.967142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4c7bf85c-6e19-4ef4-83cc-aeb9d0e069b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:14.973206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7bf85c-6e19-4ef4-83cc-aeb9d0e069b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:14.973730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7bf85c-6e19-4ef4-83cc-aeb9d0e069b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:14.974163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7bf85c-6e19-4ef4-83cc-aeb9d0e069b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:14.974887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7bf85c-6e19-4ef4-83cc-aeb9d0e069b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:14.975334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7bf85c-6e19-4ef4-83cc-aeb9d0e069b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:14.976519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7bf85c-6e19-4ef4-83cc-aeb9d0e069b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:15.003584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:15.009576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4c7bf85c-6e19-4ef4-83cc-aeb9d0e069b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048993 Aug 24 05:11:15.010147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 385/875] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:15.770737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-805c991c-cf7a-44e8-974c-977d89ea9e00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:15.772965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-805c991c-cf7a-44e8-974c-977d89ea9e00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:15.779234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-805c991c-cf7a-44e8-974c-977d89ea9e00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:15.779758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-805c991c-cf7a-44e8-974c-977d89ea9e00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:15.780190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-805c991c-cf7a-44e8-974c-977d89ea9e00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:15.780875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-805c991c-cf7a-44e8-974c-977d89ea9e00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:15.781321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-805c991c-cf7a-44e8-974c-977d89ea9e00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:15.781738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-805c991c-cf7a-44e8-974c-977d89ea9e00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:15.814221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-805c991c-cf7a-44e8-974c-977d89ea9e00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047461 Aug 24 05:11:15.814800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 491/876] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:15.914934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bd93b5f1-6406-4a21-944a-6568f1c8609a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:15.917173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bd93b5f1-6406-4a21-944a-6568f1c8609a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:15.923721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd93b5f1-6406-4a21-944a-6568f1c8609a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:15.924205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd93b5f1-6406-4a21-944a-6568f1c8609a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:15.925073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd93b5f1-6406-4a21-944a-6568f1c8609a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:15.925783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd93b5f1-6406-4a21-944a-6568f1c8609a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:15.926238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd93b5f1-6406-4a21-944a-6568f1c8609a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:15.926659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd93b5f1-6406-4a21-944a-6568f1c8609a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:15.956757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bd93b5f1-6406-4a21-944a-6568f1c8609a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047505 Aug 24 05:11:15.957319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 386/877] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:16.021830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bf9819f0-b4c3-4c10-9249-7855ef5557be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:16.024848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bf9819f0-b4c3-4c10-9249-7855ef5557be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:16.030841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9819f0-b4c3-4c10-9249-7855ef5557be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:16.031327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9819f0-b4c3-4c10-9249-7855ef5557be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:16.031798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9819f0-b4c3-4c10-9249-7855ef5557be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:16.032515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9819f0-b4c3-4c10-9249-7855ef5557be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:16.032967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9819f0-b4c3-4c10-9249-7855ef5557be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:16.033394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9819f0-b4c3-4c10-9249-7855ef5557be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:16.064489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bf9819f0-b4c3-4c10-9249-7855ef5557be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046701 Aug 24 05:11:16.065044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 492/878] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:16 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:16.828456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-65e3c065-c291-45ff-90a0-df8d87191732 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:16.830664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-65e3c065-c291-45ff-90a0-df8d87191732 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:16.837599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e3c065-c291-45ff-90a0-df8d87191732 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:16.838081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e3c065-c291-45ff-90a0-df8d87191732 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:16.838513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e3c065-c291-45ff-90a0-df8d87191732 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:16.839241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e3c065-c291-45ff-90a0-df8d87191732 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:16.839691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e3c065-c291-45ff-90a0-df8d87191732 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:16.840127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e3c065-c291-45ff-90a0-df8d87191732 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:16.872108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-65e3c065-c291-45ff-90a0-df8d87191732 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048034 Aug 24 05:11:16.872690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 387/879] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:16 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:16.971282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ce72accd-a45a-4ef8-adb4-44ed4abe52fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:16.973468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ce72accd-a45a-4ef8-adb4-44ed4abe52fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:16.981147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce72accd-a45a-4ef8-adb4-44ed4abe52fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:16.981629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce72accd-a45a-4ef8-adb4-44ed4abe52fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:16.982065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce72accd-a45a-4ef8-adb4-44ed4abe52fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:16.982797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce72accd-a45a-4ef8-adb4-44ed4abe52fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:16.983241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce72accd-a45a-4ef8-adb4-44ed4abe52fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:16.983655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce72accd-a45a-4ef8-adb4-44ed4abe52fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:16.988243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:17.016406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ce72accd-a45a-4ef8-adb4-44ed4abe52fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050570 Aug 24 05:11:17.016968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 493/880] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:17.076888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c9a79c45-8237-4f50-a001-f87f6f333dda tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:17.079125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c9a79c45-8237-4f50-a001-f87f6f333dda tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:17.086339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9a79c45-8237-4f50-a001-f87f6f333dda tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:17.087099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9a79c45-8237-4f50-a001-f87f6f333dda tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:17.087536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9a79c45-8237-4f50-a001-f87f6f333dda tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:17.088242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9a79c45-8237-4f50-a001-f87f6f333dda tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:17.088690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9a79c45-8237-4f50-a001-f87f6f333dda tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:17.089106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9a79c45-8237-4f50-a001-f87f6f333dda tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:17.119905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c9a79c45-8237-4f50-a001-f87f6f333dda tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046902 Aug 24 05:11:17.120468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 388/881] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:17.884410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5ed85e2e-8d48-41ef-8a2d-3b71a518af7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:17.886532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5ed85e2e-8d48-41ef-8a2d-3b71a518af7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:17.892537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ed85e2e-8d48-41ef-8a2d-3b71a518af7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:17.893007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ed85e2e-8d48-41ef-8a2d-3b71a518af7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:17.893442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ed85e2e-8d48-41ef-8a2d-3b71a518af7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:17.894125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ed85e2e-8d48-41ef-8a2d-3b71a518af7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:17.894575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ed85e2e-8d48-41ef-8a2d-3b71a518af7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:17.895020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ed85e2e-8d48-41ef-8a2d-3b71a518af7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:17.924152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5ed85e2e-8d48-41ef-8a2d-3b71a518af7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043720 Aug 24 05:11:17.924693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 494/882] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:18.028937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-53118ae9-1786-4707-937d-acd63c67130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:18.030990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-53118ae9-1786-4707-937d-acd63c67130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:18.036937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53118ae9-1786-4707-937d-acd63c67130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:18.037407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53118ae9-1786-4707-937d-acd63c67130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:18.037830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53118ae9-1786-4707-937d-acd63c67130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:18.039079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53118ae9-1786-4707-937d-acd63c67130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:18.039524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53118ae9-1786-4707-937d-acd63c67130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:18.039934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53118ae9-1786-4707-937d-acd63c67130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:18.070072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-53118ae9-1786-4707-937d-acd63c67130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Aug 24 05:11:18.070831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 389/883] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:18.132293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bf126285-b986-4594-b113-3decc5f47811 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:18.134645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bf126285-b986-4594-b113-3decc5f47811 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:18.141457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf126285-b986-4594-b113-3decc5f47811 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:18.141942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf126285-b986-4594-b113-3decc5f47811 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:18.142377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf126285-b986-4594-b113-3decc5f47811 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:18.143108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf126285-b986-4594-b113-3decc5f47811 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:18.143559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf126285-b986-4594-b113-3decc5f47811 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:18.143985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf126285-b986-4594-b113-3decc5f47811 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:18.179454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bf126285-b986-4594-b113-3decc5f47811 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050799 Aug 24 05:11:18.180000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 495/884] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:18.937440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2bdc8ce2-9e90-4f75-93a9-c908feb011bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:18.939710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2bdc8ce2-9e90-4f75-93a9-c908feb011bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:18.946875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ce2-9e90-4f75-93a9-c908feb011bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:18.947356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ce2-9e90-4f75-93a9-c908feb011bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:18.947787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ce2-9e90-4f75-93a9-c908feb011bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:18.948471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ce2-9e90-4f75-93a9-c908feb011bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:18.948920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ce2-9e90-4f75-93a9-c908feb011bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:18.949341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bdc8ce2-9e90-4f75-93a9-c908feb011bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:18.979111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2bdc8ce2-9e90-4f75-93a9-c908feb011bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045453 Aug 24 05:11:18.979111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 390/885] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:19.082395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cf96353d-2c73-41e8-8b96-321ef5a97cca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:19.085283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cf96353d-2c73-41e8-8b96-321ef5a97cca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:19.093136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf96353d-2c73-41e8-8b96-321ef5a97cca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:19.093631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf96353d-2c73-41e8-8b96-321ef5a97cca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:19.094068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf96353d-2c73-41e8-8b96-321ef5a97cca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:19.094796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf96353d-2c73-41e8-8b96-321ef5a97cca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:19.095250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf96353d-2c73-41e8-8b96-321ef5a97cca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:19.095681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf96353d-2c73-41e8-8b96-321ef5a97cca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:19.130258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cf96353d-2c73-41e8-8b96-321ef5a97cca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051770 Aug 24 05:11:19.130840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 496/886] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:19.191803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-82a081c2-ec80-49af-8666-86304fcc03ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:19.194530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-82a081c2-ec80-49af-8666-86304fcc03ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:19.201668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82a081c2-ec80-49af-8666-86304fcc03ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:19.202542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82a081c2-ec80-49af-8666-86304fcc03ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:19.203336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82a081c2-ec80-49af-8666-86304fcc03ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:19.204284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82a081c2-ec80-49af-8666-86304fcc03ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:19.205089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82a081c2-ec80-49af-8666-86304fcc03ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:19.205710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82a081c2-ec80-49af-8666-86304fcc03ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:19.244089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-82a081c2-ec80-49af-8666-86304fcc03ff tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056220 Aug 24 05:11:19.244665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 391/887] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:19.993018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f662907d-0fff-4200-ba87-42545222d18b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:19.995211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f662907d-0fff-4200-ba87-42545222d18b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:20.001637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f662907d-0fff-4200-ba87-42545222d18b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:20.002121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f662907d-0fff-4200-ba87-42545222d18b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:20.002558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f662907d-0fff-4200-ba87-42545222d18b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:20.003279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f662907d-0fff-4200-ba87-42545222d18b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:20.003736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f662907d-0fff-4200-ba87-42545222d18b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:20.004159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f662907d-0fff-4200-ba87-42545222d18b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:20.033776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f662907d-0fff-4200-ba87-42545222d18b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045030 Aug 24 05:11:20.034326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 497/888] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:20.144924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a672c474-879f-4baf-a05b-a4ab9575ab70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:20.148477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a672c474-879f-4baf-a05b-a4ab9575ab70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:20.156925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a672c474-879f-4baf-a05b-a4ab9575ab70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:20.157559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a672c474-879f-4baf-a05b-a4ab9575ab70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:20.158137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a672c474-879f-4baf-a05b-a4ab9575ab70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:20.159061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a672c474-879f-4baf-a05b-a4ab9575ab70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:20.159595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a672c474-879f-4baf-a05b-a4ab9575ab70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:20.160179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a672c474-879f-4baf-a05b-a4ab9575ab70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:20.200275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a672c474-879f-4baf-a05b-a4ab9575ab70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060262 Aug 24 05:11:20.201023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 392/889] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:20.258675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9c6892fe-9dfb-43bf-ba88-5e81b41b147b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:20.260964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9c6892fe-9dfb-43bf-ba88-5e81b41b147b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:20.266971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c6892fe-9dfb-43bf-ba88-5e81b41b147b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:20.267836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c6892fe-9dfb-43bf-ba88-5e81b41b147b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:20.268163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c6892fe-9dfb-43bf-ba88-5e81b41b147b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:20.268567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c6892fe-9dfb-43bf-ba88-5e81b41b147b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:20.269018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c6892fe-9dfb-43bf-ba88-5e81b41b147b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:20.269441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c6892fe-9dfb-43bf-ba88-5e81b41b147b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:20.300860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9c6892fe-9dfb-43bf-ba88-5e81b41b147b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047885 Aug 24 05:11:20.301415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 498/890] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:21.047376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1602b33c-c3f3-4f62-bb3d-d49c54d1b86a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:21.049551 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1602b33c-c3f3-4f62-bb3d-d49c54d1b86a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:21.057196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1602b33c-c3f3-4f62-bb3d-d49c54d1b86a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:21.057672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1602b33c-c3f3-4f62-bb3d-d49c54d1b86a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:21.058100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1602b33c-c3f3-4f62-bb3d-d49c54d1b86a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:21.058812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1602b33c-c3f3-4f62-bb3d-d49c54d1b86a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:21.059260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1602b33c-c3f3-4f62-bb3d-d49c54d1b86a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:21.059677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1602b33c-c3f3-4f62-bb3d-d49c54d1b86a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:21.092950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1602b33c-c3f3-4f62-bb3d-d49c54d1b86a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050882 Aug 24 05:11:21.093502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 393/891] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:21.215218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1d4f7324-664b-47e0-99d9-abb9838ae8c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:21.217326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1d4f7324-664b-47e0-99d9-abb9838ae8c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:21.223705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d4f7324-664b-47e0-99d9-abb9838ae8c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:21.224176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d4f7324-664b-47e0-99d9-abb9838ae8c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:21.224599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d4f7324-664b-47e0-99d9-abb9838ae8c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:21.225272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d4f7324-664b-47e0-99d9-abb9838ae8c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:21.225762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d4f7324-664b-47e0-99d9-abb9838ae8c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:21.226168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d4f7324-664b-47e0-99d9-abb9838ae8c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:21.255343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1d4f7324-664b-47e0-99d9-abb9838ae8c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044064 Aug 24 05:11:21.255879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 499/892] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:21.313290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-41245fc4-1f43-4634-84f5-d3df898ff1b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:21.315532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-41245fc4-1f43-4634-84f5-d3df898ff1b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:21.323019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41245fc4-1f43-4634-84f5-d3df898ff1b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:21.323507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41245fc4-1f43-4634-84f5-d3df898ff1b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:21.323926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41245fc4-1f43-4634-84f5-d3df898ff1b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:21.324683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41245fc4-1f43-4634-84f5-d3df898ff1b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:21.325126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41245fc4-1f43-4634-84f5-d3df898ff1b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:21.325539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41245fc4-1f43-4634-84f5-d3df898ff1b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:21.355861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-41245fc4-1f43-4634-84f5-d3df898ff1b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Aug 24 05:11:21.356411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 394/893] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:22.107475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c1f6c430-9923-40eb-b736-9858bc280aa0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:22.109519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c1f6c430-9923-40eb-b736-9858bc280aa0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:22.115775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f6c430-9923-40eb-b736-9858bc280aa0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:22.116772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f6c430-9923-40eb-b736-9858bc280aa0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:22.117306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f6c430-9923-40eb-b736-9858bc280aa0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:22.117921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f6c430-9923-40eb-b736-9858bc280aa0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:22.118374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f6c430-9923-40eb-b736-9858bc280aa0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:22.118829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1f6c430-9923-40eb-b736-9858bc280aa0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:22.157188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c1f6c430-9923-40eb-b736-9858bc280aa0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053743 Aug 24 05:11:22.157743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 500/894] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:22.267833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-171722f7-2eb7-4faa-954a-8c539c177db7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:22.270129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-171722f7-2eb7-4faa-954a-8c539c177db7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:22.276394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-171722f7-2eb7-4faa-954a-8c539c177db7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:22.276875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-171722f7-2eb7-4faa-954a-8c539c177db7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:22.277314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-171722f7-2eb7-4faa-954a-8c539c177db7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:22.278028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-171722f7-2eb7-4faa-954a-8c539c177db7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:22.278481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-171722f7-2eb7-4faa-954a-8c539c177db7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:22.278937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-171722f7-2eb7-4faa-954a-8c539c177db7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:22.309711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-171722f7-2eb7-4faa-954a-8c539c177db7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045819 Aug 24 05:11:22.310277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 395/895] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:22 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:22.368536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-518e603a-a60b-4185-8e6e-6454c2f02df2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:22.370675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-518e603a-a60b-4185-8e6e-6454c2f02df2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:22.377107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-518e603a-a60b-4185-8e6e-6454c2f02df2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:22.377580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-518e603a-a60b-4185-8e6e-6454c2f02df2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:22.378004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-518e603a-a60b-4185-8e6e-6454c2f02df2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:22.378705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-518e603a-a60b-4185-8e6e-6454c2f02df2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:22.379150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-518e603a-a60b-4185-8e6e-6454c2f02df2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:22.379567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-518e603a-a60b-4185-8e6e-6454c2f02df2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:22.409378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-518e603a-a60b-4185-8e6e-6454c2f02df2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045332 Aug 24 05:11:22.409926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 501/896] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:23.169883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8caa4a75-9778-42e6-9362-1328cc29f12f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:23.172003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8caa4a75-9778-42e6-9362-1328cc29f12f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:23.179024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8caa4a75-9778-42e6-9362-1328cc29f12f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:23.179514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8caa4a75-9778-42e6-9362-1328cc29f12f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:23.179953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8caa4a75-9778-42e6-9362-1328cc29f12f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:23.180658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8caa4a75-9778-42e6-9362-1328cc29f12f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:23.181113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8caa4a75-9778-42e6-9362-1328cc29f12f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:23.181539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8caa4a75-9778-42e6-9362-1328cc29f12f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:23.212851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8caa4a75-9778-42e6-9362-1328cc29f12f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046941 Aug 24 05:11:23.213412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 396/897] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:23.322538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d7ccf938-338c-45c7-9dac-cc354962e57b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:23.324801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d7ccf938-338c-45c7-9dac-cc354962e57b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:23.330876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ccf938-338c-45c7-9dac-cc354962e57b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:23.331356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ccf938-338c-45c7-9dac-cc354962e57b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:23.331785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ccf938-338c-45c7-9dac-cc354962e57b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:23.332472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ccf938-338c-45c7-9dac-cc354962e57b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:23.332919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ccf938-338c-45c7-9dac-cc354962e57b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:23.333335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ccf938-338c-45c7-9dac-cc354962e57b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:23.365807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d7ccf938-338c-45c7-9dac-cc354962e57b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047704 Aug 24 05:11:23.366427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 502/898] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:23.421913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dc1fb20f-8eff-4c59-971d-a43449d8758c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:23.424190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dc1fb20f-8eff-4c59-971d-a43449d8758c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:23.431189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc1fb20f-8eff-4c59-971d-a43449d8758c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:23.431671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc1fb20f-8eff-4c59-971d-a43449d8758c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:23.432105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc1fb20f-8eff-4c59-971d-a43449d8758c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:23.432833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc1fb20f-8eff-4c59-971d-a43449d8758c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:23.433277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc1fb20f-8eff-4c59-971d-a43449d8758c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:23.433870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc1fb20f-8eff-4c59-971d-a43449d8758c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:23.465197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dc1fb20f-8eff-4c59-971d-a43449d8758c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047158 Aug 24 05:11:23.466098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 397/899] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:24.225790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f193d5f-7c71-4025-9113-077f3086ea16 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:24.228187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1f193d5f-7c71-4025-9113-077f3086ea16 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:24.234917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f193d5f-7c71-4025-9113-077f3086ea16 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:24.235397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f193d5f-7c71-4025-9113-077f3086ea16 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:24.235828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f193d5f-7c71-4025-9113-077f3086ea16 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:24.236517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f193d5f-7c71-4025-9113-077f3086ea16 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:24.236959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f193d5f-7c71-4025-9113-077f3086ea16 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:24.237374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f193d5f-7c71-4025-9113-077f3086ea16 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:24.268371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1f193d5f-7c71-4025-9113-077f3086ea16 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046871 Aug 24 05:11:24.268830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 503/900] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:24.377816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3d7d4347-7067-41a3-96a7-3fea975f7d57 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:24.380000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3d7d4347-7067-41a3-96a7-3fea975f7d57 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:24.387277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d7d4347-7067-41a3-96a7-3fea975f7d57 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:24.387765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d7d4347-7067-41a3-96a7-3fea975f7d57 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:24.388203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d7d4347-7067-41a3-96a7-3fea975f7d57 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:24.388902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d7d4347-7067-41a3-96a7-3fea975f7d57 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:24.389355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d7d4347-7067-41a3-96a7-3fea975f7d57 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:24.389781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d7d4347-7067-41a3-96a7-3fea975f7d57 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:24.419358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3d7d4347-7067-41a3-96a7-3fea975f7d57 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Aug 24 05:11:24.419953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 398/901] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:24 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:24.477938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0b4bcf77-cbdd-40b4-88b8-509c352d7cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:24.479818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0b4bcf77-cbdd-40b4-88b8-509c352d7cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:24.486068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b4bcf77-cbdd-40b4-88b8-509c352d7cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:24.486552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b4bcf77-cbdd-40b4-88b8-509c352d7cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:24.487008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b4bcf77-cbdd-40b4-88b8-509c352d7cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:24.487696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b4bcf77-cbdd-40b4-88b8-509c352d7cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:24.488140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b4bcf77-cbdd-40b4-88b8-509c352d7cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:24.488551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b4bcf77-cbdd-40b4-88b8-509c352d7cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:24.521228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0b4bcf77-cbdd-40b4-88b8-509c352d7cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047626 Aug 24 05:11:24.521779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 504/902] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:25.280118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f30ac5ee-cd3b-4902-880b-eccf35afde81 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:25.282242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f30ac5ee-cd3b-4902-880b-eccf35afde81 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:25.289023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f30ac5ee-cd3b-4902-880b-eccf35afde81 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:25.289507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f30ac5ee-cd3b-4902-880b-eccf35afde81 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:25.289949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f30ac5ee-cd3b-4902-880b-eccf35afde81 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:25.290640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f30ac5ee-cd3b-4902-880b-eccf35afde81 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:25.291115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f30ac5ee-cd3b-4902-880b-eccf35afde81 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:25.291538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f30ac5ee-cd3b-4902-880b-eccf35afde81 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:25.321974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f30ac5ee-cd3b-4902-880b-eccf35afde81 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045826 Aug 24 05:11:25.322534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 399/903] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:25.431939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4823cb42-7c40-466f-8ea8-5e03ab229a2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:25.434095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4823cb42-7c40-466f-8ea8-5e03ab229a2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:25.441011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4823cb42-7c40-466f-8ea8-5e03ab229a2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:25.441560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4823cb42-7c40-466f-8ea8-5e03ab229a2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:25.442065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4823cb42-7c40-466f-8ea8-5e03ab229a2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:25.442869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4823cb42-7c40-466f-8ea8-5e03ab229a2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:25.443408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4823cb42-7c40-466f-8ea8-5e03ab229a2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:25.443926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4823cb42-7c40-466f-8ea8-5e03ab229a2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:25.479464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4823cb42-7c40-466f-8ea8-5e03ab229a2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051614 Aug 24 05:11:25.480036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 505/904] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:25.533941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5075c4f9-e1ca-4592-a8e5-84333a1a5a15 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:25.536038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5075c4f9-e1ca-4592-a8e5-84333a1a5a15 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:25.543421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5075c4f9-e1ca-4592-a8e5-84333a1a5a15 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:25.544148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5075c4f9-e1ca-4592-a8e5-84333a1a5a15 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:25.544617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5075c4f9-e1ca-4592-a8e5-84333a1a5a15 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:25.545325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5075c4f9-e1ca-4592-a8e5-84333a1a5a15 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:25.546037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5075c4f9-e1ca-4592-a8e5-84333a1a5a15 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:25.546856 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5075c4f9-e1ca-4592-a8e5-84333a1a5a15 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:25.580368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5075c4f9-e1ca-4592-a8e5-84333a1a5a15 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050752 Aug 24 05:11:25.580943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 400/905] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:26.336377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1ba69619-454c-405b-8ec8-42440acfcf00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:26.338506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1ba69619-454c-405b-8ec8-42440acfcf00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:26.344461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ba69619-454c-405b-8ec8-42440acfcf00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:26.344933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ba69619-454c-405b-8ec8-42440acfcf00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:26.345360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ba69619-454c-405b-8ec8-42440acfcf00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:26.346034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ba69619-454c-405b-8ec8-42440acfcf00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:26.346481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ba69619-454c-405b-8ec8-42440acfcf00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:26.346920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ba69619-454c-405b-8ec8-42440acfcf00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:26.375745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1ba69619-454c-405b-8ec8-42440acfcf00 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044283 Aug 24 05:11:26.376289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 506/906] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:26 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:26.492569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-270ca3d8-59ec-40ae-8f88-5ff28d93b9a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:26.494758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-270ca3d8-59ec-40ae-8f88-5ff28d93b9a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:26.500729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-270ca3d8-59ec-40ae-8f88-5ff28d93b9a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:26.501209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-270ca3d8-59ec-40ae-8f88-5ff28d93b9a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:26.501670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-270ca3d8-59ec-40ae-8f88-5ff28d93b9a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:26.502381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-270ca3d8-59ec-40ae-8f88-5ff28d93b9a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:26.502871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-270ca3d8-59ec-40ae-8f88-5ff28d93b9a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:26.503289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-270ca3d8-59ec-40ae-8f88-5ff28d93b9a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:26.532721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-270ca3d8-59ec-40ae-8f88-5ff28d93b9a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044874 Aug 24 05:11:26.533280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 401/907] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:26.592703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-182e0768-3d8d-4f06-afb0-19bb4765f648 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:26.594787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-182e0768-3d8d-4f06-afb0-19bb4765f648 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:26.601751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-182e0768-3d8d-4f06-afb0-19bb4765f648 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:26.602456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-182e0768-3d8d-4f06-afb0-19bb4765f648 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:26.602783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-182e0768-3d8d-4f06-afb0-19bb4765f648 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:26.603478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-182e0768-3d8d-4f06-afb0-19bb4765f648 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:26.603978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-182e0768-3d8d-4f06-afb0-19bb4765f648 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:26.604399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-182e0768-3d8d-4f06-afb0-19bb4765f648 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:26.635811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-182e0768-3d8d-4f06-afb0-19bb4765f648 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047070 Aug 24 05:11:26.636381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 507/908] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:27.387910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-60bf0a39-0500-4900-b397-f90cac6e8ea6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:27.390036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-60bf0a39-0500-4900-b397-f90cac6e8ea6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:27.396716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60bf0a39-0500-4900-b397-f90cac6e8ea6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:27.397198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60bf0a39-0500-4900-b397-f90cac6e8ea6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:27.397775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60bf0a39-0500-4900-b397-f90cac6e8ea6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:27.399030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60bf0a39-0500-4900-b397-f90cac6e8ea6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:27.399478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60bf0a39-0500-4900-b397-f90cac6e8ea6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:27.399897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60bf0a39-0500-4900-b397-f90cac6e8ea6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:27.417002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:27.431041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-60bf0a39-0500-4900-b397-f90cac6e8ea6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Aug 24 05:11:27.431611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 402/909] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:27.545056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1e7d4233-bfe4-4594-bf55-4725bd7a3f64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:27.547229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1e7d4233-bfe4-4594-bf55-4725bd7a3f64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:27.553600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e7d4233-bfe4-4594-bf55-4725bd7a3f64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:27.554809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e7d4233-bfe4-4594-bf55-4725bd7a3f64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:27.555310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e7d4233-bfe4-4594-bf55-4725bd7a3f64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:27.556004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e7d4233-bfe4-4594-bf55-4725bd7a3f64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:27.556446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e7d4233-bfe4-4594-bf55-4725bd7a3f64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:27.556858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e7d4233-bfe4-4594-bf55-4725bd7a3f64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:27.589643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1e7d4233-bfe4-4594-bf55-4725bd7a3f64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048550 Aug 24 05:11:27.590206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 508/910] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:27 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:27.650058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2e46a9e0-f44b-47b3-8c7b-fe3d6cdf7fc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:27.652327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2e46a9e0-f44b-47b3-8c7b-fe3d6cdf7fc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:27.658552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e46a9e0-f44b-47b3-8c7b-fe3d6cdf7fc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:27.659075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e46a9e0-f44b-47b3-8c7b-fe3d6cdf7fc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:27.659513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e46a9e0-f44b-47b3-8c7b-fe3d6cdf7fc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:27.660330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e46a9e0-f44b-47b3-8c7b-fe3d6cdf7fc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:27.660649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e46a9e0-f44b-47b3-8c7b-fe3d6cdf7fc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:27.661070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e46a9e0-f44b-47b3-8c7b-fe3d6cdf7fc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:27.693717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2e46a9e0-f44b-47b3-8c7b-fe3d6cdf7fc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049395 Aug 24 05:11:27.694327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 403/911] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:27 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:28.443323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a05f0795-9913-47e4-8679-367aaf7705be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:28.447686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a05f0795-9913-47e4-8679-367aaf7705be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:28.452725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a05f0795-9913-47e4-8679-367aaf7705be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:28.453204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a05f0795-9913-47e4-8679-367aaf7705be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:28.453636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a05f0795-9913-47e4-8679-367aaf7705be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:28.454327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a05f0795-9913-47e4-8679-367aaf7705be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:28.454812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a05f0795-9913-47e4-8679-367aaf7705be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:28.455240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a05f0795-9913-47e4-8679-367aaf7705be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:28.480968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:28.486272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a05f0795-9913-47e4-8679-367aaf7705be tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047023 Aug 24 05:11:28.486858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 509/912] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:28.601681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d34789e9-1728-48a6-9974-92081efba3da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:28.603869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d34789e9-1728-48a6-9974-92081efba3da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:28.610272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d34789e9-1728-48a6-9974-92081efba3da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:28.610774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d34789e9-1728-48a6-9974-92081efba3da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:28.611209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d34789e9-1728-48a6-9974-92081efba3da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:28.611892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d34789e9-1728-48a6-9974-92081efba3da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:28.612334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d34789e9-1728-48a6-9974-92081efba3da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:28.612751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d34789e9-1728-48a6-9974-92081efba3da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:28.643737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d34789e9-1728-48a6-9974-92081efba3da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046018 Aug 24 05:11:28.644295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 404/913] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:28.705556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-53b5a7bc-ae23-4851-b013-f1995159cad5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:28.707706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-53b5a7bc-ae23-4851-b013-f1995159cad5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:28.714189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53b5a7bc-ae23-4851-b013-f1995159cad5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:28.714664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53b5a7bc-ae23-4851-b013-f1995159cad5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:28.715115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53b5a7bc-ae23-4851-b013-f1995159cad5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:28.715795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53b5a7bc-ae23-4851-b013-f1995159cad5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:28.716234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53b5a7bc-ae23-4851-b013-f1995159cad5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:28.716674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53b5a7bc-ae23-4851-b013-f1995159cad5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:28.750120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-53b5a7bc-ae23-4851-b013-f1995159cad5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048443 Aug 24 05:11:28.751018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 510/914] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:29.497726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-efafb87b-a84b-4107-bd56-794d4ea0f42b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:29.500013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-efafb87b-a84b-4107-bd56-794d4ea0f42b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:29.501882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=85 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:29.508052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efafb87b-a84b-4107-bd56-794d4ea0f42b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:29.508532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efafb87b-a84b-4107-bd56-794d4ea0f42b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:29.508962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efafb87b-a84b-4107-bd56-794d4ea0f42b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:29.509654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efafb87b-a84b-4107-bd56-794d4ea0f42b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:29.510107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efafb87b-a84b-4107-bd56-794d4ea0f42b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:29.510521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efafb87b-a84b-4107-bd56-794d4ea0f42b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:29.541432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-efafb87b-a84b-4107-bd56-794d4ea0f42b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047715 Aug 24 05:11:29.541982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 405/915] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:29.656486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c40604a9-76a1-4055-b59d-b4eb87c83479 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:29.658710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c40604a9-76a1-4055-b59d-b4eb87c83479 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:29.665310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c40604a9-76a1-4055-b59d-b4eb87c83479 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:29.665790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c40604a9-76a1-4055-b59d-b4eb87c83479 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:29.666226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c40604a9-76a1-4055-b59d-b4eb87c83479 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:29.666963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c40604a9-76a1-4055-b59d-b4eb87c83479 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:29.667413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c40604a9-76a1-4055-b59d-b4eb87c83479 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:29.667835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c40604a9-76a1-4055-b59d-b4eb87c83479 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:29.699816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c40604a9-76a1-4055-b59d-b4eb87c83479 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047234 Aug 24 05:11:29.700389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 511/916] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:29.762452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d6f854e9-31ba-468c-a2ad-bbfcaf26273c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:29.764522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d6f854e9-31ba-468c-a2ad-bbfcaf26273c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:29.771026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f854e9-31ba-468c-a2ad-bbfcaf26273c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:29.771503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f854e9-31ba-468c-a2ad-bbfcaf26273c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:29.771933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f854e9-31ba-468c-a2ad-bbfcaf26273c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:29.773466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f854e9-31ba-468c-a2ad-bbfcaf26273c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:29.773922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f854e9-31ba-468c-a2ad-bbfcaf26273c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:29.774338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f854e9-31ba-468c-a2ad-bbfcaf26273c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:29.805883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d6f854e9-31ba-468c-a2ad-bbfcaf26273c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047592 Aug 24 05:11:29.806387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 406/917] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:30.554711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-003a2a30-c121-4521-a0e6-17051f18657e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:30.556855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-003a2a30-c121-4521-a0e6-17051f18657e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:30.562976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-003a2a30-c121-4521-a0e6-17051f18657e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:30.563484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-003a2a30-c121-4521-a0e6-17051f18657e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:30.563950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-003a2a30-c121-4521-a0e6-17051f18657e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:30.564645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-003a2a30-c121-4521-a0e6-17051f18657e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:30.565279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-003a2a30-c121-4521-a0e6-17051f18657e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:30.565705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-003a2a30-c121-4521-a0e6-17051f18657e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:30.600485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-003a2a30-c121-4521-a0e6-17051f18657e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050712 Aug 24 05:11:30.601696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 512/918] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:30.712447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-28269594-fc21-4ea8-9ded-5bf8bf2fb6e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:30.714578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-28269594-fc21-4ea8-9ded-5bf8bf2fb6e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:30.720865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28269594-fc21-4ea8-9ded-5bf8bf2fb6e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:30.721338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28269594-fc21-4ea8-9ded-5bf8bf2fb6e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:30.721766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28269594-fc21-4ea8-9ded-5bf8bf2fb6e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:30.722451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28269594-fc21-4ea8-9ded-5bf8bf2fb6e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:30.722932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28269594-fc21-4ea8-9ded-5bf8bf2fb6e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:30.723348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28269594-fc21-4ea8-9ded-5bf8bf2fb6e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:30.754588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-28269594-fc21-4ea8-9ded-5bf8bf2fb6e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046183 Aug 24 05:11:30.755099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 407/919] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:30.818264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9e2ad5aa-c42e-4550-b9c7-ce90c6f0f625 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:30.821937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9e2ad5aa-c42e-4550-b9c7-ce90c6f0f625 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:30.830806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e2ad5aa-c42e-4550-b9c7-ce90c6f0f625 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:30.831566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e2ad5aa-c42e-4550-b9c7-ce90c6f0f625 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:30.832005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e2ad5aa-c42e-4550-b9c7-ce90c6f0f625 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:30.832727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e2ad5aa-c42e-4550-b9c7-ce90c6f0f625 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:30.833172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e2ad5aa-c42e-4550-b9c7-ce90c6f0f625 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:30.833589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e2ad5aa-c42e-4550-b9c7-ce90c6f0f625 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:30.864774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9e2ad5aa-c42e-4550-b9c7-ce90c6f0f625 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050482 Aug 24 05:11:30.865354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 513/920] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:31.614591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b7f4edc2-6ba3-46ea-b2fe-56ff44d8b586 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:31.617254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b7f4edc2-6ba3-46ea-b2fe-56ff44d8b586 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:31.624640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7f4edc2-6ba3-46ea-b2fe-56ff44d8b586 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:31.625142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7f4edc2-6ba3-46ea-b2fe-56ff44d8b586 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:31.625612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7f4edc2-6ba3-46ea-b2fe-56ff44d8b586 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:31.626305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7f4edc2-6ba3-46ea-b2fe-56ff44d8b586 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:31.626782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7f4edc2-6ba3-46ea-b2fe-56ff44d8b586 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:31.627198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7f4edc2-6ba3-46ea-b2fe-56ff44d8b586 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:31.658385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b7f4edc2-6ba3-46ea-b2fe-56ff44d8b586 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047838 Aug 24 05:11:31.658980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 408/921] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:31.767305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b8ab4987-44cc-4f03-a317-33240ce6d445 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:31.769445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b8ab4987-44cc-4f03-a317-33240ce6d445 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:31.775835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8ab4987-44cc-4f03-a317-33240ce6d445 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:31.776320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8ab4987-44cc-4f03-a317-33240ce6d445 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:31.776756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8ab4987-44cc-4f03-a317-33240ce6d445 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:31.777456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8ab4987-44cc-4f03-a317-33240ce6d445 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:31.777906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8ab4987-44cc-4f03-a317-33240ce6d445 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:31.778325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8ab4987-44cc-4f03-a317-33240ce6d445 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:31.811240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b8ab4987-44cc-4f03-a317-33240ce6d445 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047813 Aug 24 05:11:31.811809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 514/922] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:31.878059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-302c5777-7a06-4c78-8688-f19a12a8f0ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:31.880094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-302c5777-7a06-4c78-8688-f19a12a8f0ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:31.886950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-302c5777-7a06-4c78-8688-f19a12a8f0ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:31.887434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-302c5777-7a06-4c78-8688-f19a12a8f0ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:31.887868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-302c5777-7a06-4c78-8688-f19a12a8f0ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:31.888563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-302c5777-7a06-4c78-8688-f19a12a8f0ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:31.889012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-302c5777-7a06-4c78-8688-f19a12a8f0ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:31.889427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-302c5777-7a06-4c78-8688-f19a12a8f0ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:31.923255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-302c5777-7a06-4c78-8688-f19a12a8f0ca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049235 Aug 24 05:11:31.923865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 409/923] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:32.673027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f1b5fb47-479e-48b5-9f22-6337aa6909ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:32.675802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f1b5fb47-479e-48b5-9f22-6337aa6909ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:32.683125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1b5fb47-479e-48b5-9f22-6337aa6909ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:32.683600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1b5fb47-479e-48b5-9f22-6337aa6909ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:32.684032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1b5fb47-479e-48b5-9f22-6337aa6909ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:32.684749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1b5fb47-479e-48b5-9f22-6337aa6909ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:32.685195 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1b5fb47-479e-48b5-9f22-6337aa6909ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:32.685609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1b5fb47-479e-48b5-9f22-6337aa6909ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:32.717418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f1b5fb47-479e-48b5-9f22-6337aa6909ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048551 Aug 24 05:11:32.717986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 515/924] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:32.823549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-637868ec-a9ff-4d8a-8bd2-dcfabd2ee672 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:32.825721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-637868ec-a9ff-4d8a-8bd2-dcfabd2ee672 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:32.832321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637868ec-a9ff-4d8a-8bd2-dcfabd2ee672 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:32.832822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637868ec-a9ff-4d8a-8bd2-dcfabd2ee672 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:32.833280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637868ec-a9ff-4d8a-8bd2-dcfabd2ee672 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:32.833985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637868ec-a9ff-4d8a-8bd2-dcfabd2ee672 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:32.834547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637868ec-a9ff-4d8a-8bd2-dcfabd2ee672 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:32.835440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637868ec-a9ff-4d8a-8bd2-dcfabd2ee672 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:32.867320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-637868ec-a9ff-4d8a-8bd2-dcfabd2ee672 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047987 Aug 24 05:11:32.867894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 410/925] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:32.937473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c9c03788-9687-48bd-9884-5760b04853fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:32.940822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c9c03788-9687-48bd-9884-5760b04853fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:32.950289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9c03788-9687-48bd-9884-5760b04853fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:32.951125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9c03788-9687-48bd-9884-5760b04853fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:32.951812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9c03788-9687-48bd-9884-5760b04853fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:32.952923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9c03788-9687-48bd-9884-5760b04853fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:32.953654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9c03788-9687-48bd-9884-5760b04853fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:32.954337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9c03788-9687-48bd-9884-5760b04853fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:32.989438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c9c03788-9687-48bd-9884-5760b04853fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058262 Aug 24 05:11:32.990003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 516/926] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:33.730376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-194828b9-5512-45c7-96cd-fa04b14975f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:33.732541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-194828b9-5512-45c7-96cd-fa04b14975f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:33.738816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-194828b9-5512-45c7-96cd-fa04b14975f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:33.739301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-194828b9-5512-45c7-96cd-fa04b14975f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:33.739732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-194828b9-5512-45c7-96cd-fa04b14975f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:33.740422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-194828b9-5512-45c7-96cd-fa04b14975f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:33.740870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-194828b9-5512-45c7-96cd-fa04b14975f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:33.741329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-194828b9-5512-45c7-96cd-fa04b14975f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:33.773085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-194828b9-5512-45c7-96cd-fa04b14975f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046990 Aug 24 05:11:33.774051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 411/927] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:33.880569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-803c00f4-6fe3-4daa-9a93-8dfbe4ae5bf5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:33.882879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-803c00f4-6fe3-4daa-9a93-8dfbe4ae5bf5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:33.889385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-803c00f4-6fe3-4daa-9a93-8dfbe4ae5bf5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:33.889858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-803c00f4-6fe3-4daa-9a93-8dfbe4ae5bf5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:33.890290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-803c00f4-6fe3-4daa-9a93-8dfbe4ae5bf5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:33.891020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-803c00f4-6fe3-4daa-9a93-8dfbe4ae5bf5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:33.891472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-803c00f4-6fe3-4daa-9a93-8dfbe4ae5bf5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:33.891890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-803c00f4-6fe3-4daa-9a93-8dfbe4ae5bf5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:33.921910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-803c00f4-6fe3-4daa-9a93-8dfbe4ae5bf5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045300 Aug 24 05:11:33.922452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 517/928] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:33 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:34.002024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-41fdf600-7601-43fb-81c6-db606f913293 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:34.004141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-41fdf600-7601-43fb-81c6-db606f913293 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:34.011627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41fdf600-7601-43fb-81c6-db606f913293 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:34.012107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41fdf600-7601-43fb-81c6-db606f913293 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:34.012542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41fdf600-7601-43fb-81c6-db606f913293 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:34.013243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41fdf600-7601-43fb-81c6-db606f913293 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:34.013692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41fdf600-7601-43fb-81c6-db606f913293 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:34.014118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41fdf600-7601-43fb-81c6-db606f913293 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:34.045825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-41fdf600-7601-43fb-81c6-db606f913293 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047806 Aug 24 05:11:34.046417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 412/929] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:34.785419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-652d2833-d6e4-4cb4-be3f-7e6a68b9b97f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:34.787726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-652d2833-d6e4-4cb4-be3f-7e6a68b9b97f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:34.790396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=85 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:34.795798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-652d2833-d6e4-4cb4-be3f-7e6a68b9b97f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:34.796286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-652d2833-d6e4-4cb4-be3f-7e6a68b9b97f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:34.796717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-652d2833-d6e4-4cb4-be3f-7e6a68b9b97f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:34.797419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-652d2833-d6e4-4cb4-be3f-7e6a68b9b97f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:34.797871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-652d2833-d6e4-4cb4-be3f-7e6a68b9b97f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:34.798324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-652d2833-d6e4-4cb4-be3f-7e6a68b9b97f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:34.829475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-652d2833-d6e4-4cb4-be3f-7e6a68b9b97f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048036 Aug 24 05:11:34.830031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 518/930] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:34.935519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-56fab27f-4a54-4152-887e-90dbb2f1efb3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:34.937674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-56fab27f-4a54-4152-887e-90dbb2f1efb3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:34.943764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56fab27f-4a54-4152-887e-90dbb2f1efb3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:34.944311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56fab27f-4a54-4152-887e-90dbb2f1efb3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:34.944886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56fab27f-4a54-4152-887e-90dbb2f1efb3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:34.945597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56fab27f-4a54-4152-887e-90dbb2f1efb3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:34.946051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56fab27f-4a54-4152-887e-90dbb2f1efb3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:34.946473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56fab27f-4a54-4152-887e-90dbb2f1efb3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:34.976780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-56fab27f-4a54-4152-887e-90dbb2f1efb3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Aug 24 05:11:34.977339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 413/931] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:35.182633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ff908e9e-45e0-417c-baba-300d79a76e5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:35.184922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ff908e9e-45e0-417c-baba-300d79a76e5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:35.191079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff908e9e-45e0-417c-baba-300d79a76e5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:35.191563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff908e9e-45e0-417c-baba-300d79a76e5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:35.191992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff908e9e-45e0-417c-baba-300d79a76e5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:35.192680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff908e9e-45e0-417c-baba-300d79a76e5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:35.193127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff908e9e-45e0-417c-baba-300d79a76e5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:35.193544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff908e9e-45e0-417c-baba-300d79a76e5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:35.224540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ff908e9e-45e0-417c-baba-300d79a76e5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170784 Aug 24 05:11:35.225100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 519/932] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:35.972197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-298ff98a-7bd8-467e-aac5-1cc11a3b6f08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:35.974364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-298ff98a-7bd8-467e-aac5-1cc11a3b6f08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:35.980857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-298ff98a-7bd8-467e-aac5-1cc11a3b6f08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:35.981332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-298ff98a-7bd8-467e-aac5-1cc11a3b6f08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:35.981764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-298ff98a-7bd8-467e-aac5-1cc11a3b6f08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:35.982456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-298ff98a-7bd8-467e-aac5-1cc11a3b6f08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:35.982935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-298ff98a-7bd8-467e-aac5-1cc11a3b6f08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:35.983361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-298ff98a-7bd8-467e-aac5-1cc11a3b6f08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:35.989204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6552f2b6-e933-47ae-97d5-f481febd202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:35.992625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6552f2b6-e933-47ae-97d5-f481febd202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:35.998739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6552f2b6-e933-47ae-97d5-f481febd202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:35.999216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6552f2b6-e933-47ae-97d5-f481febd202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:35.999640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6552f2b6-e933-47ae-97d5-f481febd202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:36.000333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6552f2b6-e933-47ae-97d5-f481febd202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:36.000773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6552f2b6-e933-47ae-97d5-f481febd202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:36.001184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6552f2b6-e933-47ae-97d5-f481febd202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:36.015201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-298ff98a-7bd8-467e-aac5-1cc11a3b6f08 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.176922 Aug 24 05:11:36.015776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 414/933] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:36.033307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6552f2b6-e933-47ae-97d5-f481febd202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048019 Aug 24 05:11:36.033841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 520/934] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:35 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:36.236648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1a4104cb-ae4f-4091-afb1-1c81f0dc0e62 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:36.238778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1a4104cb-ae4f-4091-afb1-1c81f0dc0e62 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:36.245595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a4104cb-ae4f-4091-afb1-1c81f0dc0e62 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:36.246078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a4104cb-ae4f-4091-afb1-1c81f0dc0e62 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:36.246510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a4104cb-ae4f-4091-afb1-1c81f0dc0e62 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:36.247234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a4104cb-ae4f-4091-afb1-1c81f0dc0e62 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:36.247680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a4104cb-ae4f-4091-afb1-1c81f0dc0e62 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:36.248129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a4104cb-ae4f-4091-afb1-1c81f0dc0e62 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:36.291910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1a4104cb-ae4f-4091-afb1-1c81f0dc0e62 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058794 Aug 24 05:11:36.292954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 415/935] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:37.028128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9c54a955-4993-4a72-b8ce-c6fd9c755e6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:37.030320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9c54a955-4993-4a72-b8ce-c6fd9c755e6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:37.036768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c54a955-4993-4a72-b8ce-c6fd9c755e6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:37.037244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c54a955-4993-4a72-b8ce-c6fd9c755e6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:37.037673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c54a955-4993-4a72-b8ce-c6fd9c755e6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:37.038724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c54a955-4993-4a72-b8ce-c6fd9c755e6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:37.039182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c54a955-4993-4a72-b8ce-c6fd9c755e6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:37.039607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c54a955-4993-4a72-b8ce-c6fd9c755e6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:37.045734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4732a434-8b7f-4c5f-a2da-d15edc6b8472 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:37.047951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4732a434-8b7f-4c5f-a2da-d15edc6b8472 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:37.054440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4732a434-8b7f-4c5f-a2da-d15edc6b8472 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:37.054883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4732a434-8b7f-4c5f-a2da-d15edc6b8472 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:37.055304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4732a434-8b7f-4c5f-a2da-d15edc6b8472 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:37.056001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4732a434-8b7f-4c5f-a2da-d15edc6b8472 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:37.056450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4732a434-8b7f-4c5f-a2da-d15edc6b8472 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:37.056866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4732a434-8b7f-4c5f-a2da-d15edc6b8472 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:37.071746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9c54a955-4993-4a72-b8ce-c6fd9c755e6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047575 Aug 24 05:11:37.072315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 521/936] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:37.088078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4732a434-8b7f-4c5f-a2da-d15edc6b8472 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046457 Aug 24 05:11:37.088647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 416/937] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:37.309159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bd062175-3ceb-4145-a66a-a24482d4a023 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:37.311310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bd062175-3ceb-4145-a66a-a24482d4a023 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:37.317217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd062175-3ceb-4145-a66a-a24482d4a023 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:37.317690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd062175-3ceb-4145-a66a-a24482d4a023 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:37.318119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd062175-3ceb-4145-a66a-a24482d4a023 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:37.318830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd062175-3ceb-4145-a66a-a24482d4a023 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:37.319919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd062175-3ceb-4145-a66a-a24482d4a023 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:37.320444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd062175-3ceb-4145-a66a-a24482d4a023 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:37.349150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bd062175-3ceb-4145-a66a-a24482d4a023 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Aug 24 05:11:37.349680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 522/938] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:38.083385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9e27e541-0280-4c47-b01a-5df6f0bddb07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:38.085971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9e27e541-0280-4c47-b01a-5df6f0bddb07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:38.092918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e27e541-0280-4c47-b01a-5df6f0bddb07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:38.093403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e27e541-0280-4c47-b01a-5df6f0bddb07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:38.093838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e27e541-0280-4c47-b01a-5df6f0bddb07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:38.094538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e27e541-0280-4c47-b01a-5df6f0bddb07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:38.095018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e27e541-0280-4c47-b01a-5df6f0bddb07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:38.095445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e27e541-0280-4c47-b01a-5df6f0bddb07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:38.101525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ae49be18-1a23-471d-9954-2ea5c2c746bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:38.103933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ae49be18-1a23-471d-9954-2ea5c2c746bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:38.110492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae49be18-1a23-471d-9954-2ea5c2c746bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:38.111002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae49be18-1a23-471d-9954-2ea5c2c746bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:38.111428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae49be18-1a23-471d-9954-2ea5c2c746bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:38.112119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae49be18-1a23-471d-9954-2ea5c2c746bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:38.112563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae49be18-1a23-471d-9954-2ea5c2c746bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:38.112975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae49be18-1a23-471d-9954-2ea5c2c746bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:38.128049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9e27e541-0280-4c47-b01a-5df6f0bddb07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048692 Aug 24 05:11:38.128638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 417/939] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:38.144648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ae49be18-1a23-471d-9954-2ea5c2c746bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047657 Aug 24 05:11:38.145191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 523/940] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:38.361459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-23b3c67a-d55d-434d-b504-8e5709931ac3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:38.363550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-23b3c67a-d55d-434d-b504-8e5709931ac3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:38.369982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23b3c67a-d55d-434d-b504-8e5709931ac3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:38.370459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23b3c67a-d55d-434d-b504-8e5709931ac3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:38.370923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23b3c67a-d55d-434d-b504-8e5709931ac3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:38.371607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23b3c67a-d55d-434d-b504-8e5709931ac3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:38.372053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23b3c67a-d55d-434d-b504-8e5709931ac3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:38.372464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23b3c67a-d55d-434d-b504-8e5709931ac3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:38.402985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-23b3c67a-d55d-434d-b504-8e5709931ac3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045516 Aug 24 05:11:38.403545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 418/941] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:39.141371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-92b7d9ee-c703-4d28-b952-06a79b37a94d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:39.143559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-92b7d9ee-c703-4d28-b952-06a79b37a94d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:39.150631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92b7d9ee-c703-4d28-b952-06a79b37a94d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:39.151146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92b7d9ee-c703-4d28-b952-06a79b37a94d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:39.151587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92b7d9ee-c703-4d28-b952-06a79b37a94d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:39.152374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92b7d9ee-c703-4d28-b952-06a79b37a94d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:39.152833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92b7d9ee-c703-4d28-b952-06a79b37a94d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:39.153260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92b7d9ee-c703-4d28-b952-06a79b37a94d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:39.157962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4aac8e6d-6ea0-45b7-9304-4cf45ef4cfaf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:39.160176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4aac8e6d-6ea0-45b7-9304-4cf45ef4cfaf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:39.167727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4aac8e6d-6ea0-45b7-9304-4cf45ef4cfaf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:39.168213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4aac8e6d-6ea0-45b7-9304-4cf45ef4cfaf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:39.168644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4aac8e6d-6ea0-45b7-9304-4cf45ef4cfaf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:39.169345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4aac8e6d-6ea0-45b7-9304-4cf45ef4cfaf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:39.169806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4aac8e6d-6ea0-45b7-9304-4cf45ef4cfaf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:39.170230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4aac8e6d-6ea0-45b7-9304-4cf45ef4cfaf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:39.174108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:39.186961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-92b7d9ee-c703-4d28-b952-06a79b37a94d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049365 Aug 24 05:11:39.187808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 524/942] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:39.203135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4aac8e6d-6ea0-45b7-9304-4cf45ef4cfaf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049378 Aug 24 05:11:39.203718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 419/943] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:39.414304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8b8383c6-f749-4959-94f8-a60279695762 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:39.416384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8b8383c6-f749-4959-94f8-a60279695762 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:39.422388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b8383c6-f749-4959-94f8-a60279695762 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:39.422894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b8383c6-f749-4959-94f8-a60279695762 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:39.423316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b8383c6-f749-4959-94f8-a60279695762 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:39.424000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b8383c6-f749-4959-94f8-a60279695762 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:39.424440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b8383c6-f749-4959-94f8-a60279695762 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:39.424853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b8383c6-f749-4959-94f8-a60279695762 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:39.455507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8b8383c6-f749-4959-94f8-a60279695762 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045158 Aug 24 05:11:39.456053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 525/944] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:40.200053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-449e48eb-1f91-4498-8786-975707e3cc03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:40.202195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-449e48eb-1f91-4498-8786-975707e3cc03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:40.208958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-449e48eb-1f91-4498-8786-975707e3cc03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:40.209445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-449e48eb-1f91-4498-8786-975707e3cc03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:40.210529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-449e48eb-1f91-4498-8786-975707e3cc03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:40.211267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-449e48eb-1f91-4498-8786-975707e3cc03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:40.211716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-449e48eb-1f91-4498-8786-975707e3cc03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:40.212148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-449e48eb-1f91-4498-8786-975707e3cc03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:40.216683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0ab71857-f38e-471e-ad41-06342100fda6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:40.218959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0ab71857-f38e-471e-ad41-06342100fda6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:40.225507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ab71857-f38e-471e-ad41-06342100fda6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:40.226152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ab71857-f38e-471e-ad41-06342100fda6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:40.226702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ab71857-f38e-471e-ad41-06342100fda6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:40.227413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ab71857-f38e-471e-ad41-06342100fda6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:40.227867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ab71857-f38e-471e-ad41-06342100fda6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:40.228293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ab71857-f38e-471e-ad41-06342100fda6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:40.242614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-449e48eb-1f91-4498-8786-975707e3cc03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046525 Aug 24 05:11:40.243425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 420/945] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:40.246172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:40.261124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0ab71857-f38e-471e-ad41-06342100fda6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048424 Aug 24 05:11:40.261693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 526/946] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:40.467676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d17e2b7e-cb6a-4e6e-bac6-f0d9f809fa6d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:40.469804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d17e2b7e-cb6a-4e6e-bac6-f0d9f809fa6d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:40.476950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d17e2b7e-cb6a-4e6e-bac6-f0d9f809fa6d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:40.477434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d17e2b7e-cb6a-4e6e-bac6-f0d9f809fa6d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:40.477874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d17e2b7e-cb6a-4e6e-bac6-f0d9f809fa6d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:40.478577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d17e2b7e-cb6a-4e6e-bac6-f0d9f809fa6d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:40.479059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d17e2b7e-cb6a-4e6e-bac6-f0d9f809fa6d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:40.479487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d17e2b7e-cb6a-4e6e-bac6-f0d9f809fa6d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:40.510632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d17e2b7e-cb6a-4e6e-bac6-f0d9f809fa6d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046881 Aug 24 05:11:40.511224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 421/947] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:41.254715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9f8bc13a-c42b-4760-9686-9306d8b34f33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:41.257370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9f8bc13a-c42b-4760-9686-9306d8b34f33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:41.264717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f8bc13a-c42b-4760-9686-9306d8b34f33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:41.265606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f8bc13a-c42b-4760-9686-9306d8b34f33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:41.266408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f8bc13a-c42b-4760-9686-9306d8b34f33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:41.267770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f8bc13a-c42b-4760-9686-9306d8b34f33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:41.268708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f8bc13a-c42b-4760-9686-9306d8b34f33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:41.269459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f8bc13a-c42b-4760-9686-9306d8b34f33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:41.275987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7016c29f-ae8d-4fe2-9e3d-297d47073c21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:41.279845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7016c29f-ae8d-4fe2-9e3d-297d47073c21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:41.289651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7016c29f-ae8d-4fe2-9e3d-297d47073c21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:41.290533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7016c29f-ae8d-4fe2-9e3d-297d47073c21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:41.291306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7016c29f-ae8d-4fe2-9e3d-297d47073c21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:41.292036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7016c29f-ae8d-4fe2-9e3d-297d47073c21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:41.292490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7016c29f-ae8d-4fe2-9e3d-297d47073c21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:41.292916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7016c29f-ae8d-4fe2-9e3d-297d47073c21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:41.309831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9f8bc13a-c42b-4760-9686-9306d8b34f33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058250 Aug 24 05:11:41.309831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 527/948] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:41.327194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7016c29f-ae8d-4fe2-9e3d-297d47073c21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057393 Aug 24 05:11:41.327764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 422/949] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:41.523492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-967ee03b-5e94-4aba-995f-cb49af73306c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:41.525598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-967ee03b-5e94-4aba-995f-cb49af73306c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:41.531611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-967ee03b-5e94-4aba-995f-cb49af73306c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:41.532076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-967ee03b-5e94-4aba-995f-cb49af73306c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:41.532499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-967ee03b-5e94-4aba-995f-cb49af73306c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:41.533182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-967ee03b-5e94-4aba-995f-cb49af73306c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:41.533623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-967ee03b-5e94-4aba-995f-cb49af73306c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:41.534034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-967ee03b-5e94-4aba-995f-cb49af73306c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:41.566489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-967ee03b-5e94-4aba-995f-cb49af73306c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047549 Aug 24 05:11:41.567087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 528/950] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:41 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:42.322406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0801e9a9-05e2-4670-80fa-beef6fb227fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:42.324596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0801e9a9-05e2-4670-80fa-beef6fb227fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:42.331267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0801e9a9-05e2-4670-80fa-beef6fb227fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:42.331784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0801e9a9-05e2-4670-80fa-beef6fb227fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:42.332181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0801e9a9-05e2-4670-80fa-beef6fb227fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:42.332875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0801e9a9-05e2-4670-80fa-beef6fb227fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:42.333329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0801e9a9-05e2-4670-80fa-beef6fb227fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:42.333753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0801e9a9-05e2-4670-80fa-beef6fb227fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:42.340205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c88a635c-c667-4386-962e-0b66fe2af1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:42.342346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c88a635c-c667-4386-962e-0b66fe2af1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:42.348999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c88a635c-c667-4386-962e-0b66fe2af1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:42.349483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c88a635c-c667-4386-962e-0b66fe2af1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:42.349913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c88a635c-c667-4386-962e-0b66fe2af1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:42.350596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c88a635c-c667-4386-962e-0b66fe2af1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:42.351761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c88a635c-c667-4386-962e-0b66fe2af1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:42.352180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c88a635c-c667-4386-962e-0b66fe2af1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:42.377250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0801e9a9-05e2-4670-80fa-beef6fb227fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059379 Aug 24 05:11:42.378162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 423/951] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:42.382498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c88a635c-c667-4386-962e-0b66fe2af1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046887 Aug 24 05:11:42.383003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 529/952] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:42.578900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8e587b54-aae3-47ec-8b70-ce887cce6995 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:42.580973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8e587b54-aae3-47ec-8b70-ce887cce6995 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:42.587553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e587b54-aae3-47ec-8b70-ce887cce6995 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:42.588032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e587b54-aae3-47ec-8b70-ce887cce6995 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:42.588459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e587b54-aae3-47ec-8b70-ce887cce6995 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:42.589145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e587b54-aae3-47ec-8b70-ce887cce6995 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:42.589590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e587b54-aae3-47ec-8b70-ce887cce6995 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:42.590005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e587b54-aae3-47ec-8b70-ce887cce6995 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:42.622602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8e587b54-aae3-47ec-8b70-ce887cce6995 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047641 Aug 24 05:11:42.623203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 424/953] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:43.394577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a0f18046-fda7-4d62-81cf-477894571ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:43.396856 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a0f18046-fda7-4d62-81cf-477894571ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:43.397044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ca2001ad-ae12-4a8e-957b-2ee52974eb1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:43.399252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ca2001ad-ae12-4a8e-957b-2ee52974eb1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:43.403814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0f18046-fda7-4d62-81cf-477894571ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:43.404306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0f18046-fda7-4d62-81cf-477894571ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:43.404768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0f18046-fda7-4d62-81cf-477894571ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:43.405469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca2001ad-ae12-4a8e-957b-2ee52974eb1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:43.405587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0f18046-fda7-4d62-81cf-477894571ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:43.405928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0f18046-fda7-4d62-81cf-477894571ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:43.406047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca2001ad-ae12-4a8e-957b-2ee52974eb1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:43.406350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0f18046-fda7-4d62-81cf-477894571ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:43.406453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca2001ad-ae12-4a8e-957b-2ee52974eb1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:43.407084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca2001ad-ae12-4a8e-957b-2ee52974eb1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:43.407534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca2001ad-ae12-4a8e-957b-2ee52974eb1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:43.407957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca2001ad-ae12-4a8e-957b-2ee52974eb1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:43.436556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a0f18046-fda7-4d62-81cf-477894571ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046125 Aug 24 05:11:43.437123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 425/954] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:43 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:43.437955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ca2001ad-ae12-4a8e-957b-2ee52974eb1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048967 Aug 24 05:11:43.438462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 530/955] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:43.635865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-617552da-fdd0-4357-905a-cca906ae63fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:43.638029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-617552da-fdd0-4357-905a-cca906ae63fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:43.643998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-617552da-fdd0-4357-905a-cca906ae63fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:43.644468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-617552da-fdd0-4357-905a-cca906ae63fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:43.644947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-617552da-fdd0-4357-905a-cca906ae63fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:43.645578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-617552da-fdd0-4357-905a-cca906ae63fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:43.646034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-617552da-fdd0-4357-905a-cca906ae63fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:43.646451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-617552da-fdd0-4357-905a-cca906ae63fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:43.681053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-617552da-fdd0-4357-905a-cca906ae63fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050033 Aug 24 05:11:43.681654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 426/956] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:44.449377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-366b6bc8-c101-4c6c-874d-5c08844c12b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:44.449945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-027edc72-44a6-42a3-9b0b-90a7b997f96e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:44.451935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-366b6bc8-c101-4c6c-874d-5c08844c12b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:44.452069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-027edc72-44a6-42a3-9b0b-90a7b997f96e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:44.458654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-366b6bc8-c101-4c6c-874d-5c08844c12b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.458918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-027edc72-44a6-42a3-9b0b-90a7b997f96e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.459142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-366b6bc8-c101-4c6c-874d-5c08844c12b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.459388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-027edc72-44a6-42a3-9b0b-90a7b997f96e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.459569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-366b6bc8-c101-4c6c-874d-5c08844c12b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.459822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-027edc72-44a6-42a3-9b0b-90a7b997f96e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.461001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-366b6bc8-c101-4c6c-874d-5c08844c12b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.461151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-027edc72-44a6-42a3-9b0b-90a7b997f96e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.461586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-366b6bc8-c101-4c6c-874d-5c08844c12b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.461713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-027edc72-44a6-42a3-9b0b-90a7b997f96e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.462008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-366b6bc8-c101-4c6c-874d-5c08844c12b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.462129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-027edc72-44a6-42a3-9b0b-90a7b997f96e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.492860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-366b6bc8-c101-4c6c-874d-5c08844c12b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048542 Aug 24 05:11:44.493426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 531/957] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:44.495008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-027edc72-44a6-42a3-9b0b-90a7b997f96e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049007 Aug 24 05:11:44.495588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 427/958] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:44.693372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fb6d552c-0c50-4d8e-ad34-1e55d810727b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:44.696170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fb6d552c-0c50-4d8e-ad34-1e55d810727b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:44.702340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb6d552c-0c50-4d8e-ad34-1e55d810727b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.702782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb6d552c-0c50-4d8e-ad34-1e55d810727b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.703211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb6d552c-0c50-4d8e-ad34-1e55d810727b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.703896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb6d552c-0c50-4d8e-ad34-1e55d810727b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:44.704339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb6d552c-0c50-4d8e-ad34-1e55d810727b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:44.704773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb6d552c-0c50-4d8e-ad34-1e55d810727b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:44.742442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fb6d552c-0c50-4d8e-ad34-1e55d810727b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052471 Aug 24 05:11:44.743041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 532/959] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:45.505620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6080e402-8ed4-4f8d-afff-61f1e51ab7c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:45.507455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b983166b-abfa-4973-8709-00d60eaff94f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:45.508075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6080e402-8ed4-4f8d-afff-61f1e51ab7c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:45.509653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b983166b-abfa-4973-8709-00d60eaff94f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:45.516457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b983166b-abfa-4973-8709-00d60eaff94f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.516704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6080e402-8ed4-4f8d-afff-61f1e51ab7c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.516934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b983166b-abfa-4973-8709-00d60eaff94f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.517101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6080e402-8ed4-4f8d-afff-61f1e51ab7c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.517372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b983166b-abfa-4973-8709-00d60eaff94f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.517538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6080e402-8ed4-4f8d-afff-61f1e51ab7c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.518072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b983166b-abfa-4973-8709-00d60eaff94f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.518234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6080e402-8ed4-4f8d-afff-61f1e51ab7c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.518512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b983166b-abfa-4973-8709-00d60eaff94f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.518738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6080e402-8ed4-4f8d-afff-61f1e51ab7c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.518967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b983166b-abfa-4973-8709-00d60eaff94f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.519102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6080e402-8ed4-4f8d-afff-61f1e51ab7c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.550376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6080e402-8ed4-4f8d-afff-61f1e51ab7c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048494 Aug 24 05:11:45.550984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 428/960] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:45 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:45.552486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b983166b-abfa-4973-8709-00d60eaff94f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049173 Aug 24 05:11:45.553341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 533/961] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:45.755792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ca599b1b-56c0-45e3-87ad-a305ea8d26f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:45.759931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ca599b1b-56c0-45e3-87ad-a305ea8d26f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:45.766498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca599b1b-56c0-45e3-87ad-a305ea8d26f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.767029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca599b1b-56c0-45e3-87ad-a305ea8d26f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.767467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca599b1b-56c0-45e3-87ad-a305ea8d26f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.768164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca599b1b-56c0-45e3-87ad-a305ea8d26f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:45.768618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca599b1b-56c0-45e3-87ad-a305ea8d26f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:45.769040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca599b1b-56c0-45e3-87ad-a305ea8d26f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:45.798141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ca599b1b-56c0-45e3-87ad-a305ea8d26f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047340 Aug 24 05:11:45.798712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 429/962] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:46.562981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-43f1273f-b307-4417-8b55-4d28d20f5857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:46.565179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-43f1273f-b307-4417-8b55-4d28d20f5857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:46.565491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-47f37e11-f149-40e9-b92a-7e06f59748aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:46.567603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-47f37e11-f149-40e9-b92a-7e06f59748aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:46.571761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43f1273f-b307-4417-8b55-4d28d20f5857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:46.572241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43f1273f-b307-4417-8b55-4d28d20f5857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:46.572676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43f1273f-b307-4417-8b55-4d28d20f5857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:46.573373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43f1273f-b307-4417-8b55-4d28d20f5857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:46.573820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43f1273f-b307-4417-8b55-4d28d20f5857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:46.574050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47f37e11-f149-40e9-b92a-7e06f59748aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:46.574246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43f1273f-b307-4417-8b55-4d28d20f5857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:46.574524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47f37e11-f149-40e9-b92a-7e06f59748aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:46.574997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47f37e11-f149-40e9-b92a-7e06f59748aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:46.575680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47f37e11-f149-40e9-b92a-7e06f59748aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:46.576124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47f37e11-f149-40e9-b92a-7e06f59748aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:46.576543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47f37e11-f149-40e9-b92a-7e06f59748aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:46.604694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-43f1273f-b307-4417-8b55-4d28d20f5857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045642 Aug 24 05:11:46.605257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 534/963] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:46.606551 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-47f37e11-f149-40e9-b92a-7e06f59748aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Aug 24 05:11:46.607137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 430/964] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:46.811246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-66e790ae-5916-442f-9c10-21f241a0ff67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:46.813364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-66e790ae-5916-442f-9c10-21f241a0ff67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:46.819428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e790ae-5916-442f-9c10-21f241a0ff67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:46.819906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e790ae-5916-442f-9c10-21f241a0ff67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:46.820436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e790ae-5916-442f-9c10-21f241a0ff67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:46.821122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e790ae-5916-442f-9c10-21f241a0ff67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:46.821573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e790ae-5916-442f-9c10-21f241a0ff67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:46.821992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e790ae-5916-442f-9c10-21f241a0ff67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:46.853000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-66e790ae-5916-442f-9c10-21f241a0ff67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045673 Aug 24 05:11:46.853554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 535/965] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:47.617392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d79523dc-ab9c-416e-ae2c-d9dfd6a602da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:47.618415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0e9a561f-1714-4b04-af89-027a1ad8e119 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:47.619737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d79523dc-ab9c-416e-ae2c-d9dfd6a602da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:47.620687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0e9a561f-1714-4b04-af89-027a1ad8e119 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:47.626742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79523dc-ab9c-416e-ae2c-d9dfd6a602da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:47.627188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e9a561f-1714-4b04-af89-027a1ad8e119 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:47.627328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79523dc-ab9c-416e-ae2c-d9dfd6a602da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:47.627683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e9a561f-1714-4b04-af89-027a1ad8e119 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:47.627837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79523dc-ab9c-416e-ae2c-d9dfd6a602da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:47.628118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e9a561f-1714-4b04-af89-027a1ad8e119 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:47.628389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79523dc-ab9c-416e-ae2c-d9dfd6a602da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:47.628813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e9a561f-1714-4b04-af89-027a1ad8e119 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:47.628915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79523dc-ab9c-416e-ae2c-d9dfd6a602da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:47.629261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e9a561f-1714-4b04-af89-027a1ad8e119 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:47.629521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79523dc-ab9c-416e-ae2c-d9dfd6a602da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:47.629678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e9a561f-1714-4b04-af89-027a1ad8e119 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:47.661423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0e9a561f-1714-4b04-af89-027a1ad8e119 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046891 Aug 24 05:11:47.661691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d79523dc-ab9c-416e-ae2c-d9dfd6a602da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048417 Aug 24 05:11:47.661995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 536/966] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:47.663111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 431/967] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:47.864479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9960cbc4-0a2a-406e-9526-e119ac5ce223 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:47.867298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9960cbc4-0a2a-406e-9526-e119ac5ce223 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:47.873481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9960cbc4-0a2a-406e-9526-e119ac5ce223 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:47.873894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9960cbc4-0a2a-406e-9526-e119ac5ce223 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:47.874327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9960cbc4-0a2a-406e-9526-e119ac5ce223 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:47.875044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9960cbc4-0a2a-406e-9526-e119ac5ce223 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:47.875488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9960cbc4-0a2a-406e-9526-e119ac5ce223 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:47.875903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9960cbc4-0a2a-406e-9526-e119ac5ce223 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:47.905486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9960cbc4-0a2a-406e-9526-e119ac5ce223 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044956 Aug 24 05:11:47.906041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 537/968] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:48.673932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-57e80437-a428-41fe-a59b-e023cc1b80fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:48.674481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c1d4d3cb-405e-435e-8bb2-49a46dadc691 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:48.676295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-57e80437-a428-41fe-a59b-e023cc1b80fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:48.676586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c1d4d3cb-405e-435e-8bb2-49a46dadc691 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:48.683360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57e80437-a428-41fe-a59b-e023cc1b80fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.683843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57e80437-a428-41fe-a59b-e023cc1b80fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.683970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1d4d3cb-405e-435e-8bb2-49a46dadc691 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.684273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57e80437-a428-41fe-a59b-e023cc1b80fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.684440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1d4d3cb-405e-435e-8bb2-49a46dadc691 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.684875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1d4d3cb-405e-435e-8bb2-49a46dadc691 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.684982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57e80437-a428-41fe-a59b-e023cc1b80fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.685532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57e80437-a428-41fe-a59b-e023cc1b80fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.685630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1d4d3cb-405e-435e-8bb2-49a46dadc691 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.685954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57e80437-a428-41fe-a59b-e023cc1b80fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.686053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1d4d3cb-405e-435e-8bb2-49a46dadc691 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.686408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1d4d3cb-405e-435e-8bb2-49a46dadc691 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.716617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c1d4d3cb-405e-435e-8bb2-49a46dadc691 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Aug 24 05:11:48.716842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-57e80437-a428-41fe-a59b-e023cc1b80fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046975 Aug 24 05:11:48.717187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 538/969] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:48.717599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 432/970] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:48.918127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3b8e50ad-d21e-43fa-9b41-f1fa18b5dbbd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:48.920320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3b8e50ad-d21e-43fa-9b41-f1fa18b5dbbd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:48.926652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3b8e50ad-d21e-43fa-9b41-f1fa18b5dbbd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.927101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3b8e50ad-d21e-43fa-9b41-f1fa18b5dbbd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.927531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3b8e50ad-d21e-43fa-9b41-f1fa18b5dbbd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.928221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3b8e50ad-d21e-43fa-9b41-f1fa18b5dbbd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:48.928667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3b8e50ad-d21e-43fa-9b41-f1fa18b5dbbd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:48.929086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3b8e50ad-d21e-43fa-9b41-f1fa18b5dbbd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:48.959947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3b8e50ad-d21e-43fa-9b41-f1fa18b5dbbd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046340 Aug 24 05:11:48.961290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 539/971] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:49.728363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d68cbc83-fd61-4a38-9cf2-b0fe08ec0342 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:49.728959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c0b44fa8-8ac2-494d-b4ae-d8beef76df76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:49.730556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d68cbc83-fd61-4a38-9cf2-b0fe08ec0342 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:49.730711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c0b44fa8-8ac2-494d-b4ae-d8beef76df76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:49.737127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d68cbc83-fd61-4a38-9cf2-b0fe08ec0342 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:49.737534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0b44fa8-8ac2-494d-b4ae-d8beef76df76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:49.737663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d68cbc83-fd61-4a38-9cf2-b0fe08ec0342 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:49.738013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0b44fa8-8ac2-494d-b4ae-d8beef76df76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:49.738142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d68cbc83-fd61-4a38-9cf2-b0fe08ec0342 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:49.738443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0b44fa8-8ac2-494d-b4ae-d8beef76df76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:49.738733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d68cbc83-fd61-4a38-9cf2-b0fe08ec0342 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:49.739157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0b44fa8-8ac2-494d-b4ae-d8beef76df76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:49.739268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d68cbc83-fd61-4a38-9cf2-b0fe08ec0342 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:49.739591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d68cbc83-fd61-4a38-9cf2-b0fe08ec0342 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:49.739701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0b44fa8-8ac2-494d-b4ae-d8beef76df76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:49.740001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0b44fa8-8ac2-494d-b4ae-d8beef76df76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:49.771205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d68cbc83-fd61-4a38-9cf2-b0fe08ec0342 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046880 Aug 24 05:11:49.771792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 433/972] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:49.772441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c0b44fa8-8ac2-494d-b4ae-d8beef76df76 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047687 Aug 24 05:11:49.773753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 540/973] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:49.973048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f2a7ad73-443c-4bf5-ae8d-b50cf1d72cf9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:49.975442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f2a7ad73-443c-4bf5-ae8d-b50cf1d72cf9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:49.982338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a7ad73-443c-4bf5-ae8d-b50cf1d72cf9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:49.982781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a7ad73-443c-4bf5-ae8d-b50cf1d72cf9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:49.983210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a7ad73-443c-4bf5-ae8d-b50cf1d72cf9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:49.984034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a7ad73-443c-4bf5-ae8d-b50cf1d72cf9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:49.984477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a7ad73-443c-4bf5-ae8d-b50cf1d72cf9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:49.984891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a7ad73-443c-4bf5-ae8d-b50cf1d72cf9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:50.015894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f2a7ad73-443c-4bf5-ae8d-b50cf1d72cf9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046698 Aug 24 05:11:50.016447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 434/974] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:50.784456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f575ed17-c49c-430f-8c43-dd07af6efff4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:50.785447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-047f49bd-7bbe-4325-8999-8ed08116ecdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:50.786977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f575ed17-c49c-430f-8c43-dd07af6efff4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:50.787558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-047f49bd-7bbe-4325-8999-8ed08116ecdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:50.793804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f575ed17-c49c-430f-8c43-dd07af6efff4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:50.794036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-047f49bd-7bbe-4325-8999-8ed08116ecdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:50.794280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f575ed17-c49c-430f-8c43-dd07af6efff4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:50.794523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-047f49bd-7bbe-4325-8999-8ed08116ecdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:50.794720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f575ed17-c49c-430f-8c43-dd07af6efff4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:50.794994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-047f49bd-7bbe-4325-8999-8ed08116ecdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:50.795539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f575ed17-c49c-430f-8c43-dd07af6efff4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:50.795685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-047f49bd-7bbe-4325-8999-8ed08116ecdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:50.795984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f575ed17-c49c-430f-8c43-dd07af6efff4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:50.796138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-047f49bd-7bbe-4325-8999-8ed08116ecdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:50.796396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f575ed17-c49c-430f-8c43-dd07af6efff4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:50.796575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-047f49bd-7bbe-4325-8999-8ed08116ecdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:50.823547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:50.828799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-047f49bd-7bbe-4325-8999-8ed08116ecdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047276 Aug 24 05:11:50.829007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f575ed17-c49c-430f-8c43-dd07af6efff4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048319 Aug 24 05:11:50.829620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 435/975] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:50.829745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 541/976] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:51.028026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-70f5584a-19fe-4db3-918e-f64fd1686c02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:51.030140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-70f5584a-19fe-4db3-918e-f64fd1686c02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:51.036156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-70f5584a-19fe-4db3-918e-f64fd1686c02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:51.036640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-70f5584a-19fe-4db3-918e-f64fd1686c02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:51.037093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-70f5584a-19fe-4db3-918e-f64fd1686c02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:51.037969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-70f5584a-19fe-4db3-918e-f64fd1686c02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:51.038486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-70f5584a-19fe-4db3-918e-f64fd1686c02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:51.038937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-70f5584a-19fe-4db3-918e-f64fd1686c02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:51.069131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-70f5584a-19fe-4db3-918e-f64fd1686c02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045233 Aug 24 05:11:51.070340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 436/977] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:51.841793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dd6c4a2b-a043-4e53-8e8a-9eddaa976c10 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:51.843704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bfc765aa-9517-4bcb-8adb-510f9f3c943e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:51.844113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dd6c4a2b-a043-4e53-8e8a-9eddaa976c10 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:51.845846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bfc765aa-9517-4bcb-8adb-510f9f3c943e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:51.850941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd6c4a2b-a043-4e53-8e8a-9eddaa976c10 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:51.851448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd6c4a2b-a043-4e53-8e8a-9eddaa976c10 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:51.851886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd6c4a2b-a043-4e53-8e8a-9eddaa976c10 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:51.852538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bfc765aa-9517-4bcb-8adb-510f9f3c943e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:51.852654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd6c4a2b-a043-4e53-8e8a-9eddaa976c10 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:51.853021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bfc765aa-9517-4bcb-8adb-510f9f3c943e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:51.853185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd6c4a2b-a043-4e53-8e8a-9eddaa976c10 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:51.853461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd6c4a2b-a043-4e53-8e8a-9eddaa976c10 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:51.853570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bfc765aa-9517-4bcb-8adb-510f9f3c943e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:51.854153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bfc765aa-9517-4bcb-8adb-510f9f3c943e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:51.854606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bfc765aa-9517-4bcb-8adb-510f9f3c943e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:51.855060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bfc765aa-9517-4bcb-8adb-510f9f3c943e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:51.884683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dd6c4a2b-a043-4e53-8e8a-9eddaa976c10 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046921 Aug 24 05:11:51.885243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 542/978] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:51.885515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bfc765aa-9517-4bcb-8adb-510f9f3c943e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046013 Aug 24 05:11:51.886166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 437/979] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:52.083701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aafc8c27-983b-4a55-a90b-f1479f0010d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:52.086770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aafc8c27-983b-4a55-a90b-f1479f0010d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:52.096816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aafc8c27-983b-4a55-a90b-f1479f0010d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:52.096816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aafc8c27-983b-4a55-a90b-f1479f0010d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:52.096816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aafc8c27-983b-4a55-a90b-f1479f0010d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:52.096816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aafc8c27-983b-4a55-a90b-f1479f0010d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:52.097254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aafc8c27-983b-4a55-a90b-f1479f0010d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:52.097254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aafc8c27-983b-4a55-a90b-f1479f0010d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:52.099252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:11:52.128316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aafc8c27-983b-4a55-a90b-f1479f0010d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049378 Aug 24 05:11:52.128857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 543/980] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:52.897444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cbe36454-afea-48f5-ab99-9ca4e614fa2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:52.899075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d7794dc6-ae5d-44a4-a662-b4761dcc1421 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:52.900390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cbe36454-afea-48f5-ab99-9ca4e614fa2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:52.901535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d7794dc6-ae5d-44a4-a662-b4761dcc1421 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:52.907084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbe36454-afea-48f5-ab99-9ca4e614fa2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:52.907568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbe36454-afea-48f5-ab99-9ca4e614fa2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:52.908006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbe36454-afea-48f5-ab99-9ca4e614fa2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:52.908392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7794dc6-ae5d-44a4-a662-b4761dcc1421 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:52.908698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbe36454-afea-48f5-ab99-9ca4e614fa2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:52.908873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7794dc6-ae5d-44a4-a662-b4761dcc1421 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:52.909149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbe36454-afea-48f5-ab99-9ca4e614fa2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:52.909305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7794dc6-ae5d-44a4-a662-b4761dcc1421 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:52.909571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbe36454-afea-48f5-ab99-9ca4e614fa2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:52.909980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7794dc6-ae5d-44a4-a662-b4761dcc1421 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:52.910429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7794dc6-ae5d-44a4-a662-b4761dcc1421 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:52.910877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d7794dc6-ae5d-44a4-a662-b4761dcc1421 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:52.940832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cbe36454-afea-48f5-ab99-9ca4e614fa2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047417 Aug 24 05:11:52.941082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d7794dc6-ae5d-44a4-a662-b4761dcc1421 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047877 Aug 24 05:11:52.941797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 438/982] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:52.941931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 544/982] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:53.141192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1d15aef8-2a01-49f0-a17d-b5ce3b0d4efb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:53.143368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1d15aef8-2a01-49f0-a17d-b5ce3b0d4efb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:53.149398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d15aef8-2a01-49f0-a17d-b5ce3b0d4efb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:53.149799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d15aef8-2a01-49f0-a17d-b5ce3b0d4efb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:53.150227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d15aef8-2a01-49f0-a17d-b5ce3b0d4efb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:53.150934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d15aef8-2a01-49f0-a17d-b5ce3b0d4efb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:53.151382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d15aef8-2a01-49f0-a17d-b5ce3b0d4efb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:53.151794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d15aef8-2a01-49f0-a17d-b5ce3b0d4efb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:53.181559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1d15aef8-2a01-49f0-a17d-b5ce3b0d4efb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044256 Aug 24 05:11:53.182408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 439/983] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:53.953501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6a657838-a25c-4505-9cc6-a3fa37729cc4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:53.954067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ca042a01-cad0-461d-b47a-03e2b6eeb100 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:53.955656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ca042a01-cad0-461d-b47a-03e2b6eeb100 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:53.955788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6a657838-a25c-4505-9cc6-a3fa37729cc4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:53.963019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca042a01-cad0-461d-b47a-03e2b6eeb100 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:53.963504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca042a01-cad0-461d-b47a-03e2b6eeb100 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:53.963774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a657838-a25c-4505-9cc6-a3fa37729cc4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:53.963937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca042a01-cad0-461d-b47a-03e2b6eeb100 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:53.964265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a657838-a25c-4505-9cc6-a3fa37729cc4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:53.964631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca042a01-cad0-461d-b47a-03e2b6eeb100 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:53.964818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a657838-a25c-4505-9cc6-a3fa37729cc4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:53.965080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca042a01-cad0-461d-b47a-03e2b6eeb100 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:53.965500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca042a01-cad0-461d-b47a-03e2b6eeb100 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:53.965612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a657838-a25c-4505-9cc6-a3fa37729cc4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:53.965962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a657838-a25c-4505-9cc6-a3fa37729cc4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:53.966398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a657838-a25c-4505-9cc6-a3fa37729cc4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:53.996902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ca042a01-cad0-461d-b47a-03e2b6eeb100 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047177 Aug 24 05:11:53.997196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6a657838-a25c-4505-9cc6-a3fa37729cc4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047438 Aug 24 05:11:53.997698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 440/984] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:53.997819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 545/985] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:54.193583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-51d590e8-c491-46f8-8b0b-d41a3189d0f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:54.195977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-51d590e8-c491-46f8-8b0b-d41a3189d0f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:54.201887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51d590e8-c491-46f8-8b0b-d41a3189d0f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:54.202369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51d590e8-c491-46f8-8b0b-d41a3189d0f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:54.202832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51d590e8-c491-46f8-8b0b-d41a3189d0f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:54.203572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51d590e8-c491-46f8-8b0b-d41a3189d0f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:54.203971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51d590e8-c491-46f8-8b0b-d41a3189d0f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:54.204394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51d590e8-c491-46f8-8b0b-d41a3189d0f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:54.235592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-51d590e8-c491-46f8-8b0b-d41a3189d0f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Aug 24 05:11:54.236174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 441/986] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:55.009474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82512184-13e7-461d-94d9-a25a42a4472d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:55.010048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-abc6fc87-9ecd-479d-87bf-a997ec4e705c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:55.011708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-82512184-13e7-461d-94d9-a25a42a4472d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:55.011843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-abc6fc87-9ecd-479d-87bf-a997ec4e705c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:55.018268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82512184-13e7-461d-94d9-a25a42a4472d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:55.018434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc6fc87-9ecd-479d-87bf-a997ec4e705c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:55.018787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82512184-13e7-461d-94d9-a25a42a4472d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:55.018912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc6fc87-9ecd-479d-87bf-a997ec4e705c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:55.019226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82512184-13e7-461d-94d9-a25a42a4472d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:55.019341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc6fc87-9ecd-479d-87bf-a997ec4e705c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:55.019916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82512184-13e7-461d-94d9-a25a42a4472d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:55.020043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc6fc87-9ecd-479d-87bf-a997ec4e705c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:55.020366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82512184-13e7-461d-94d9-a25a42a4472d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:55.020475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc6fc87-9ecd-479d-87bf-a997ec4e705c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:55.020783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82512184-13e7-461d-94d9-a25a42a4472d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:55.020885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc6fc87-9ecd-479d-87bf-a997ec4e705c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:55.051700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-82512184-13e7-461d-94d9-a25a42a4472d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046793 Aug 24 05:11:55.051958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-abc6fc87-9ecd-479d-87bf-a997ec4e705c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046540 Aug 24 05:11:55.052448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 546/987] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:55.052591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 442/988] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:55 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:55.248963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-27f5b7ab-e6aa-4889-a69c-033e9f8902cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:55.250945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-27f5b7ab-e6aa-4889-a69c-033e9f8902cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:55.257372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27f5b7ab-e6aa-4889-a69c-033e9f8902cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:55.257895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27f5b7ab-e6aa-4889-a69c-033e9f8902cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:55.258433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27f5b7ab-e6aa-4889-a69c-033e9f8902cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:55.259170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27f5b7ab-e6aa-4889-a69c-033e9f8902cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:55.259623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27f5b7ab-e6aa-4889-a69c-033e9f8902cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:55.260054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27f5b7ab-e6aa-4889-a69c-033e9f8902cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:55.290569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-27f5b7ab-e6aa-4889-a69c-033e9f8902cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Aug 24 05:11:55.291149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 547/989] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:56.064874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-94430042-ffa6-49c0-bd46-33a0a094852b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:56.065411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fa52e87c-5064-48e0-8bf5-a831bc60e8d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:56.066982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fa52e87c-5064-48e0-8bf5-a831bc60e8d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:56.067118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-94430042-ffa6-49c0-bd46-33a0a094852b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:56.074416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa52e87c-5064-48e0-8bf5-a831bc60e8d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:56.074934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa52e87c-5064-48e0-8bf5-a831bc60e8d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:56.075368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa52e87c-5064-48e0-8bf5-a831bc60e8d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:56.075813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94430042-ffa6-49c0-bd46-33a0a094852b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:56.076071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa52e87c-5064-48e0-8bf5-a831bc60e8d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:56.076300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94430042-ffa6-49c0-bd46-33a0a094852b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:56.076518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa52e87c-5064-48e0-8bf5-a831bc60e8d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:56.076732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94430042-ffa6-49c0-bd46-33a0a094852b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:56.076939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa52e87c-5064-48e0-8bf5-a831bc60e8d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:56.077423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94430042-ffa6-49c0-bd46-33a0a094852b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:56.077867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94430042-ffa6-49c0-bd46-33a0a094852b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:56.078279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94430042-ffa6-49c0-bd46-33a0a094852b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:56.107160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fa52e87c-5064-48e0-8bf5-a831bc60e8d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046319 Aug 24 05:11:56.107720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 548/990] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:56.108305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-94430042-ffa6-49c0-bd46-33a0a094852b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047520 Aug 24 05:11:56.108867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 443/991] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:56.303433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c7b9d911-7083-48ac-9b91-4bb8cd2ea77e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:56.306246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c7b9d911-7083-48ac-9b91-4bb8cd2ea77e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:56.312342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b9d911-7083-48ac-9b91-4bb8cd2ea77e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:56.312822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b9d911-7083-48ac-9b91-4bb8cd2ea77e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:56.313257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b9d911-7083-48ac-9b91-4bb8cd2ea77e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:56.313947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b9d911-7083-48ac-9b91-4bb8cd2ea77e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:56.314404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b9d911-7083-48ac-9b91-4bb8cd2ea77e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:56.314854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7b9d911-7083-48ac-9b91-4bb8cd2ea77e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:56.345399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c7b9d911-7083-48ac-9b91-4bb8cd2ea77e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046107 Aug 24 05:11:56.345947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 549/992] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:57.119642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-39f0cd79-7292-41f2-9a74-ceba5ce9d5a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:57.120382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-78d95806-c137-4fba-b0e2-51fc1de13f1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:57.121777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-39f0cd79-7292-41f2-9a74-ceba5ce9d5a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:57.122523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-78d95806-c137-4fba-b0e2-51fc1de13f1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:57.128424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39f0cd79-7292-41f2-9a74-ceba5ce9d5a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:57.128858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78d95806-c137-4fba-b0e2-51fc1de13f1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:57.128965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39f0cd79-7292-41f2-9a74-ceba5ce9d5a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:57.129331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78d95806-c137-4fba-b0e2-51fc1de13f1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:57.129443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39f0cd79-7292-41f2-9a74-ceba5ce9d5a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:57.129759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78d95806-c137-4fba-b0e2-51fc1de13f1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:57.130012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39f0cd79-7292-41f2-9a74-ceba5ce9d5a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:57.130457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39f0cd79-7292-41f2-9a74-ceba5ce9d5a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:57.130562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78d95806-c137-4fba-b0e2-51fc1de13f1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:57.130901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39f0cd79-7292-41f2-9a74-ceba5ce9d5a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:57.131019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78d95806-c137-4fba-b0e2-51fc1de13f1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:57.131328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78d95806-c137-4fba-b0e2-51fc1de13f1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:57.162337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-39f0cd79-7292-41f2-9a74-ceba5ce9d5a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046995 Aug 24 05:11:57.162567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-78d95806-c137-4fba-b0e2-51fc1de13f1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045849 Aug 24 05:11:57.163212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 550/994] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:57.163881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 444/994] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:57.357543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-40f0be14-15ad-447c-ae47-e837a1eabaec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:57.359692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-40f0be14-15ad-447c-ae47-e837a1eabaec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:57.365756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40f0be14-15ad-447c-ae47-e837a1eabaec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:57.366235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40f0be14-15ad-447c-ae47-e837a1eabaec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:57.366655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40f0be14-15ad-447c-ae47-e837a1eabaec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:57.367365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40f0be14-15ad-447c-ae47-e837a1eabaec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:57.367801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40f0be14-15ad-447c-ae47-e837a1eabaec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:57.368215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40f0be14-15ad-447c-ae47-e837a1eabaec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:57.400271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-40f0be14-15ad-447c-ae47-e837a1eabaec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046611 Aug 24 05:11:57.400824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 551/995] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:58.175589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-508ef0c1-9441-430c-9c91-724cb579ff42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:58.177643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-508ef0c1-9441-430c-9c91-724cb579ff42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:58.180087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bb2d6cdc-994a-4123-ba89-f4cb84c07845 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:58.183761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bb2d6cdc-994a-4123-ba89-f4cb84c07845 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:58.185151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508ef0c1-9441-430c-9c91-724cb579ff42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:58.185651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508ef0c1-9441-430c-9c91-724cb579ff42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:58.186107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508ef0c1-9441-430c-9c91-724cb579ff42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:58.186851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508ef0c1-9441-430c-9c91-724cb579ff42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:58.187313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508ef0c1-9441-430c-9c91-724cb579ff42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:58.187989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508ef0c1-9441-430c-9c91-724cb579ff42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:58.195832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2d6cdc-994a-4123-ba89-f4cb84c07845 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:58.196710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2d6cdc-994a-4123-ba89-f4cb84c07845 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:58.198068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2d6cdc-994a-4123-ba89-f4cb84c07845 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:58.198403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2d6cdc-994a-4123-ba89-f4cb84c07845 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:58.199312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2d6cdc-994a-4123-ba89-f4cb84c07845 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:58.200096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bb2d6cdc-994a-4123-ba89-f4cb84c07845 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:58.220299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-508ef0c1-9441-430c-9c91-724cb579ff42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049092 Aug 24 05:11:58.220873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 445/996] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:58.236918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bb2d6cdc-994a-4123-ba89-f4cb84c07845 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063634 Aug 24 05:11:58.237795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 552/997] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:58.412382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f0cf2bee-0b61-48dd-8bd6-ce712924d4c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:58.415558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f0cf2bee-0b61-48dd-8bd6-ce712924d4c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:58.421729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0cf2bee-0b61-48dd-8bd6-ce712924d4c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:58.422213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0cf2bee-0b61-48dd-8bd6-ce712924d4c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:58.422680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0cf2bee-0b61-48dd-8bd6-ce712924d4c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:58.423400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0cf2bee-0b61-48dd-8bd6-ce712924d4c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:58.423851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0cf2bee-0b61-48dd-8bd6-ce712924d4c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:58.424280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0cf2bee-0b61-48dd-8bd6-ce712924d4c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:58.454650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f0cf2bee-0b61-48dd-8bd6-ce712924d4c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046408 Aug 24 05:11:58.455524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 446/998] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:11:59.232854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-52d3bd50-e966-4f0a-936c-d4186114246a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:59.235024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-52d3bd50-e966-4f0a-936c-d4186114246a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:59.242542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52d3bd50-e966-4f0a-936c-d4186114246a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:59.242973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52d3bd50-e966-4f0a-936c-d4186114246a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:59.243404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52d3bd50-e966-4f0a-936c-d4186114246a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:59.244131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52d3bd50-e966-4f0a-936c-d4186114246a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:59.244633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52d3bd50-e966-4f0a-936c-d4186114246a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:59.245054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52d3bd50-e966-4f0a-936c-d4186114246a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:59.249926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-468ec9d9-5684-4137-bf54-cd0ff2962be5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:59.252139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-468ec9d9-5684-4137-bf54-cd0ff2962be5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:59.260974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-468ec9d9-5684-4137-bf54-cd0ff2962be5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:59.263826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-468ec9d9-5684-4137-bf54-cd0ff2962be5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:59.263826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-468ec9d9-5684-4137-bf54-cd0ff2962be5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:59.263826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-468ec9d9-5684-4137-bf54-cd0ff2962be5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:59.263826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-468ec9d9-5684-4137-bf54-cd0ff2962be5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:59.264199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-468ec9d9-5684-4137-bf54-cd0ff2962be5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:59.277083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-52d3bd50-e966-4f0a-936c-d4186114246a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048338 Aug 24 05:11:59.277658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 553/999] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:59 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:59.295620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-468ec9d9-5684-4137-bf54-cd0ff2962be5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049556 Aug 24 05:11:59.296168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 447/1000] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:11:59.467123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-093f7061-9025-4a7d-957e-fca35596fda6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:11:59.469300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-093f7061-9025-4a7d-957e-fca35596fda6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:11:59.476429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-093f7061-9025-4a7d-957e-fca35596fda6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:59.477239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-093f7061-9025-4a7d-957e-fca35596fda6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:59.477797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-093f7061-9025-4a7d-957e-fca35596fda6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:59.478394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-093f7061-9025-4a7d-957e-fca35596fda6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:11:59.480872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-093f7061-9025-4a7d-957e-fca35596fda6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:11:59.480872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-093f7061-9025-4a7d-957e-fca35596fda6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:11:59.514400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-093f7061-9025-4a7d-957e-fca35596fda6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051277 Aug 24 05:11:59.515025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 554/1001] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:11:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:00.291066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fb35a7ee-fd03-47b3-bef8-4a33da537d7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:00.293113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fb35a7ee-fd03-47b3-bef8-4a33da537d7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:00.295496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=86 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:00.300957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-fd03-47b3-bef8-4a33da537d7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:00.301460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-fd03-47b3-bef8-4a33da537d7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:00.301888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-fd03-47b3-bef8-4a33da537d7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:00.302578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-fd03-47b3-bef8-4a33da537d7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:00.303047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-fd03-47b3-bef8-4a33da537d7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:00.303463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb35a7ee-fd03-47b3-bef8-4a33da537d7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:00.308516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-238ad33a-9c7e-42ef-a2f2-34034154fed7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:00.310636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-238ad33a-9c7e-42ef-a2f2-34034154fed7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:00.317156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-238ad33a-9c7e-42ef-a2f2-34034154fed7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:00.317625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-238ad33a-9c7e-42ef-a2f2-34034154fed7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:00.318057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-238ad33a-9c7e-42ef-a2f2-34034154fed7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:00.319625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-238ad33a-9c7e-42ef-a2f2-34034154fed7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:00.319625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-238ad33a-9c7e-42ef-a2f2-34034154fed7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:00.319952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-238ad33a-9c7e-42ef-a2f2-34034154fed7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:00.336866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fb35a7ee-fd03-47b3-bef8-4a33da537d7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051020 Aug 24 05:12:00.337453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 448/1002] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:00.351635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-238ad33a-9c7e-42ef-a2f2-34034154fed7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047648 Aug 24 05:12:00.352190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 555/1003] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:00.527913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7247a16a-534c-45e9-91b9-e7bccadf25fd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:00.530023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7247a16a-534c-45e9-91b9-e7bccadf25fd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:00.536102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7247a16a-534c-45e9-91b9-e7bccadf25fd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:00.536578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7247a16a-534c-45e9-91b9-e7bccadf25fd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:00.537006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7247a16a-534c-45e9-91b9-e7bccadf25fd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:00.537688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7247a16a-534c-45e9-91b9-e7bccadf25fd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:00.538649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7247a16a-534c-45e9-91b9-e7bccadf25fd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:00.539198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7247a16a-534c-45e9-91b9-e7bccadf25fd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:00.575405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7247a16a-534c-45e9-91b9-e7bccadf25fd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051398 Aug 24 05:12:00.576263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 449/1004] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:01.349682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9b688ed2-75ff-4990-bb2d-04550bf9bd0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:01.352903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9b688ed2-75ff-4990-bb2d-04550bf9bd0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:01.359607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b688ed2-75ff-4990-bb2d-04550bf9bd0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:01.360085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b688ed2-75ff-4990-bb2d-04550bf9bd0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:01.360532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b688ed2-75ff-4990-bb2d-04550bf9bd0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:01.361228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b688ed2-75ff-4990-bb2d-04550bf9bd0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:01.361681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b688ed2-75ff-4990-bb2d-04550bf9bd0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:01.362103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9b688ed2-75ff-4990-bb2d-04550bf9bd0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:01.363998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4a3f5837-1248-4f46-ba34-fbf2c3c1dd63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:01.366222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4a3f5837-1248-4f46-ba34-fbf2c3c1dd63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:01.373055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a3f5837-1248-4f46-ba34-fbf2c3c1dd63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:01.373564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a3f5837-1248-4f46-ba34-fbf2c3c1dd63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:01.373993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a3f5837-1248-4f46-ba34-fbf2c3c1dd63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:01.374703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a3f5837-1248-4f46-ba34-fbf2c3c1dd63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:01.375159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a3f5837-1248-4f46-ba34-fbf2c3c1dd63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:01.375572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a3f5837-1248-4f46-ba34-fbf2c3c1dd63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:01.393138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9b688ed2-75ff-4990-bb2d-04550bf9bd0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047401 Aug 24 05:12:01.393699 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 556/1005] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:01.407444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4a3f5837-1248-4f46-ba34-fbf2c3c1dd63 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047487 Aug 24 05:12:01.408004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 450/1006] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:01.588897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b82b8c2e-8d2e-4edd-9829-9f7774a87938 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:01.591122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b82b8c2e-8d2e-4edd-9829-9f7774a87938 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:01.597216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b82b8c2e-8d2e-4edd-9829-9f7774a87938 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:01.597709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b82b8c2e-8d2e-4edd-9829-9f7774a87938 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:01.598121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b82b8c2e-8d2e-4edd-9829-9f7774a87938 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:01.598845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b82b8c2e-8d2e-4edd-9829-9f7774a87938 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:01.599300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b82b8c2e-8d2e-4edd-9829-9f7774a87938 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:01.599768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b82b8c2e-8d2e-4edd-9829-9f7774a87938 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:01.631569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b82b8c2e-8d2e-4edd-9829-9f7774a87938 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047526 Aug 24 05:12:01.632169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 557/1007] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:02.407951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1ac9ce9f-d6a8-46ae-9a47-0d301df31cf1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:02.410010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1ac9ce9f-d6a8-46ae-9a47-0d301df31cf1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:02.417530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ac9ce9f-d6a8-46ae-9a47-0d301df31cf1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:02.418025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ac9ce9f-d6a8-46ae-9a47-0d301df31cf1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:02.418460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ac9ce9f-d6a8-46ae-9a47-0d301df31cf1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:02.419182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ac9ce9f-d6a8-46ae-9a47-0d301df31cf1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:02.419637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ac9ce9f-d6a8-46ae-9a47-0d301df31cf1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:02.420069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ac9ce9f-d6a8-46ae-9a47-0d301df31cf1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:02.420351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3a92c121-659b-4233-b9aa-c35b88893f17 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:02.422371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3a92c121-659b-4233-b9aa-c35b88893f17 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:02.429024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a92c121-659b-4233-b9aa-c35b88893f17 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:02.429588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a92c121-659b-4233-b9aa-c35b88893f17 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:02.430022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a92c121-659b-4233-b9aa-c35b88893f17 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:02.430738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a92c121-659b-4233-b9aa-c35b88893f17 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:02.431193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a92c121-659b-4233-b9aa-c35b88893f17 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:02.431612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a92c121-659b-4233-b9aa-c35b88893f17 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:02.450552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1ac9ce9f-d6a8-46ae-9a47-0d301df31cf1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046683 Aug 24 05:12:02.451163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 451/1008] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:02.467355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3a92c121-659b-4233-b9aa-c35b88893f17 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050974 Aug 24 05:12:02.467883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 558/1009] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:02.644371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e6b3201f-4ca6-4374-9080-3bd55022f4a1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:02.646602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e6b3201f-4ca6-4374-9080-3bd55022f4a1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:02.653819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6b3201f-4ca6-4374-9080-3bd55022f4a1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:02.654310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6b3201f-4ca6-4374-9080-3bd55022f4a1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:02.654768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6b3201f-4ca6-4374-9080-3bd55022f4a1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:02.655466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6b3201f-4ca6-4374-9080-3bd55022f4a1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:02.655918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6b3201f-4ca6-4374-9080-3bd55022f4a1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:02.656334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6b3201f-4ca6-4374-9080-3bd55022f4a1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:02.677563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:02.693194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e6b3201f-4ca6-4374-9080-3bd55022f4a1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052773 Aug 24 05:12:02.693770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 452/1010] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:03.464221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4416d67a-8329-4cd5-80b7-465461426fb1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:03.466845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4416d67a-8329-4cd5-80b7-465461426fb1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:03.475734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4416d67a-8329-4cd5-80b7-465461426fb1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:03.476455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4416d67a-8329-4cd5-80b7-465461426fb1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:03.476906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4416d67a-8329-4cd5-80b7-465461426fb1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:03.477655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4416d67a-8329-4cd5-80b7-465461426fb1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:03.478112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4416d67a-8329-4cd5-80b7-465461426fb1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:03.478576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4416d67a-8329-4cd5-80b7-465461426fb1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:03.481054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-68e9716e-a338-4b8a-90a7-b34e7f301024 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:03.483275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-68e9716e-a338-4b8a-90a7-b34e7f301024 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:03.490007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68e9716e-a338-4b8a-90a7-b34e7f301024 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:03.490496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68e9716e-a338-4b8a-90a7-b34e7f301024 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:03.490960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68e9716e-a338-4b8a-90a7-b34e7f301024 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:03.491835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68e9716e-a338-4b8a-90a7-b34e7f301024 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:03.492986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68e9716e-a338-4b8a-90a7-b34e7f301024 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:03.492986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68e9716e-a338-4b8a-90a7-b34e7f301024 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:03.506350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:03.512800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4416d67a-8329-4cd5-80b7-465461426fb1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053176 Aug 24 05:12:03.513367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 559/1011] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:03 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:03.527084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-68e9716e-a338-4b8a-90a7-b34e7f301024 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050849 Aug 24 05:12:03.528101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 453/1012] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:03 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:03.708083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1353ae15-2d7a-485c-a19b-cef872b60236 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:03.710761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1353ae15-2d7a-485c-a19b-cef872b60236 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:03.717188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1353ae15-2d7a-485c-a19b-cef872b60236 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:03.717652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1353ae15-2d7a-485c-a19b-cef872b60236 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:03.718078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1353ae15-2d7a-485c-a19b-cef872b60236 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:03.718803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1353ae15-2d7a-485c-a19b-cef872b60236 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:03.719877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1353ae15-2d7a-485c-a19b-cef872b60236 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:03.720302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1353ae15-2d7a-485c-a19b-cef872b60236 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:03.752527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1353ae15-2d7a-485c-a19b-cef872b60236 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049605 Aug 24 05:12:03.753105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 560/1013] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:04.525258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-04f5f1a5-e2a1-4b53-bced-e353148c85ea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:04.527538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-04f5f1a5-e2a1-4b53-bced-e353148c85ea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:04.534083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04f5f1a5-e2a1-4b53-bced-e353148c85ea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:04.534570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04f5f1a5-e2a1-4b53-bced-e353148c85ea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:04.535025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04f5f1a5-e2a1-4b53-bced-e353148c85ea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:04.535713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04f5f1a5-e2a1-4b53-bced-e353148c85ea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:04.536163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04f5f1a5-e2a1-4b53-bced-e353148c85ea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:04.536579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04f5f1a5-e2a1-4b53-bced-e353148c85ea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:04.541681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fe24c7ae-b30a-4b4e-aa7e-c415a0b00ed6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:04.542231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fe24c7ae-b30a-4b4e-aa7e-c415a0b00ed6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:04.549483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe24c7ae-b30a-4b4e-aa7e-c415a0b00ed6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:04.550015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe24c7ae-b30a-4b4e-aa7e-c415a0b00ed6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:04.550789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe24c7ae-b30a-4b4e-aa7e-c415a0b00ed6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:04.551561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe24c7ae-b30a-4b4e-aa7e-c415a0b00ed6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:04.552120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe24c7ae-b30a-4b4e-aa7e-c415a0b00ed6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:04.552582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe24c7ae-b30a-4b4e-aa7e-c415a0b00ed6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:04.581901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-04f5f1a5-e2a1-4b53-bced-e353148c85ea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061274 Aug 24 05:12:04.582500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 454/1014] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:04.594354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fe24c7ae-b30a-4b4e-aa7e-c415a0b00ed6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058604 Aug 24 05:12:04.594947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 561/1015] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:04.765249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f7b0efc9-39d6-4acd-a486-86f3cc63e99a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:04.767737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f7b0efc9-39d6-4acd-a486-86f3cc63e99a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:04.774234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7b0efc9-39d6-4acd-a486-86f3cc63e99a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:04.774735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7b0efc9-39d6-4acd-a486-86f3cc63e99a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:04.775166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7b0efc9-39d6-4acd-a486-86f3cc63e99a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:04.775906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7b0efc9-39d6-4acd-a486-86f3cc63e99a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:04.776292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7b0efc9-39d6-4acd-a486-86f3cc63e99a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:04.776708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7b0efc9-39d6-4acd-a486-86f3cc63e99a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:04.810707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f7b0efc9-39d6-4acd-a486-86f3cc63e99a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049657 Aug 24 05:12:04.812314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 455/1016] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:05.596671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bcc45c4c-43e3-4cdc-a544-25077d01fefd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:05.598922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bcc45c4c-43e3-4cdc-a544-25077d01fefd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:05.601873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=88 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:05.608281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcc45c4c-43e3-4cdc-a544-25077d01fefd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:05.608666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8c0160da-fda4-403c-8f5f-aee6277edb8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:05.609141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcc45c4c-43e3-4cdc-a544-25077d01fefd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:05.609265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcc45c4c-43e3-4cdc-a544-25077d01fefd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:05.609859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcc45c4c-43e3-4cdc-a544-25077d01fefd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:05.610302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcc45c4c-43e3-4cdc-a544-25077d01fefd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:05.610738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcc45c4c-43e3-4cdc-a544-25077d01fefd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:05.610846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8c0160da-fda4-403c-8f5f-aee6277edb8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:05.618721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c0160da-fda4-403c-8f5f-aee6277edb8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:05.619215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c0160da-fda4-403c-8f5f-aee6277edb8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:05.619651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c0160da-fda4-403c-8f5f-aee6277edb8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:05.620546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c0160da-fda4-403c-8f5f-aee6277edb8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:05.620907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c0160da-fda4-403c-8f5f-aee6277edb8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:05.621324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c0160da-fda4-403c-8f5f-aee6277edb8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:05.641639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bcc45c4c-43e3-4cdc-a544-25077d01fefd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049525 Aug 24 05:12:05.646262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 562/1017] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:05.653956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8c0160da-fda4-403c-8f5f-aee6277edb8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049359 Aug 24 05:12:05.654566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 456/1018] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:05.823616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-849097d6-109f-4a79-a69e-b2ad049e99b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:05.825808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-849097d6-109f-4a79-a69e-b2ad049e99b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:05.831732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849097d6-109f-4a79-a69e-b2ad049e99b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:05.832200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849097d6-109f-4a79-a69e-b2ad049e99b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:05.832625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849097d6-109f-4a79-a69e-b2ad049e99b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:05.833295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849097d6-109f-4a79-a69e-b2ad049e99b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:05.833731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849097d6-109f-4a79-a69e-b2ad049e99b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:05.834168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849097d6-109f-4a79-a69e-b2ad049e99b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:05.863889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-849097d6-109f-4a79-a69e-b2ad049e99b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044735 Aug 24 05:12:05.864349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 563/1019] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:06.655356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5fbadf07-1f1c-475a-80c2-bc971601839d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:06.657429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5fbadf07-1f1c-475a-80c2-bc971601839d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:06.664911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fbadf07-1f1c-475a-80c2-bc971601839d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:06.665393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fbadf07-1f1c-475a-80c2-bc971601839d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:06.665823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fbadf07-1f1c-475a-80c2-bc971601839d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:06.666284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5241c452-9dc8-405b-ba46-f864a4c7a3f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:06.666762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fbadf07-1f1c-475a-80c2-bc971601839d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:06.666979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fbadf07-1f1c-475a-80c2-bc971601839d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:06.667401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fbadf07-1f1c-475a-80c2-bc971601839d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:06.668585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5241c452-9dc8-405b-ba46-f864a4c7a3f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:06.674970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5241c452-9dc8-405b-ba46-f864a4c7a3f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:06.675724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5241c452-9dc8-405b-ba46-f864a4c7a3f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:06.676160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5241c452-9dc8-405b-ba46-f864a4c7a3f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:06.676853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5241c452-9dc8-405b-ba46-f864a4c7a3f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:06.677305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5241c452-9dc8-405b-ba46-f864a4c7a3f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:06.677727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5241c452-9dc8-405b-ba46-f864a4c7a3f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:06.697516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5fbadf07-1f1c-475a-80c2-bc971601839d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046590 Aug 24 05:12:06.698085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 457/1020] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:06.710487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5241c452-9dc8-405b-ba46-f864a4c7a3f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048343 Aug 24 05:12:06.711461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 564/1021] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:06.877302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-59ad3f1e-478f-427f-b950-774e65575017 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:06.879492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-59ad3f1e-478f-427f-b950-774e65575017 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:06.886537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ad3f1e-478f-427f-b950-774e65575017 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:06.887043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ad3f1e-478f-427f-b950-774e65575017 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:06.887479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ad3f1e-478f-427f-b950-774e65575017 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:06.888170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ad3f1e-478f-427f-b950-774e65575017 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:06.888614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ad3f1e-478f-427f-b950-774e65575017 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:06.889032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59ad3f1e-478f-427f-b950-774e65575017 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:06.920260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-59ad3f1e-478f-427f-b950-774e65575017 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046928 Aug 24 05:12:06.920760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 458/1022] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:07.709586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-504e4bd7-4816-42f0-a8a1-a6917c0e1bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:07.712761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-504e4bd7-4816-42f0-a8a1-a6917c0e1bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:07.719461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504e4bd7-4816-42f0-a8a1-a6917c0e1bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:07.719976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504e4bd7-4816-42f0-a8a1-a6917c0e1bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:07.720411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504e4bd7-4816-42f0-a8a1-a6917c0e1bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:07.721109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504e4bd7-4816-42f0-a8a1-a6917c0e1bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:07.721560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504e4bd7-4816-42f0-a8a1-a6917c0e1bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:07.721982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-504e4bd7-4816-42f0-a8a1-a6917c0e1bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:07.723586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5bcd95c2-fbaa-4896-9efa-7d2226bcbe21 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:07.726134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5bcd95c2-fbaa-4896-9efa-7d2226bcbe21 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:07.732309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcd95c2-fbaa-4896-9efa-7d2226bcbe21 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:07.732790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcd95c2-fbaa-4896-9efa-7d2226bcbe21 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:07.733215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcd95c2-fbaa-4896-9efa-7d2226bcbe21 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:07.733902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcd95c2-fbaa-4896-9efa-7d2226bcbe21 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:07.734348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcd95c2-fbaa-4896-9efa-7d2226bcbe21 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:07.734796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcd95c2-fbaa-4896-9efa-7d2226bcbe21 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:07.753078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-504e4bd7-4816-42f0-a8a1-a6917c0e1bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047407 Aug 24 05:12:07.753652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 565/1023] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:07.770528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5bcd95c2-fbaa-4896-9efa-7d2226bcbe21 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050907 Aug 24 05:12:07.771113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 459/1024] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:07.932719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-16fba84b-99fe-4808-bbfd-fa737fb245e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:07.934858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-16fba84b-99fe-4808-bbfd-fa737fb245e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:07.940806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16fba84b-99fe-4808-bbfd-fa737fb245e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:07.941272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16fba84b-99fe-4808-bbfd-fa737fb245e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:07.941693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16fba84b-99fe-4808-bbfd-fa737fb245e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:07.942368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16fba84b-99fe-4808-bbfd-fa737fb245e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:07.942842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16fba84b-99fe-4808-bbfd-fa737fb245e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:07.943256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16fba84b-99fe-4808-bbfd-fa737fb245e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:07.973788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-16fba84b-99fe-4808-bbfd-fa737fb245e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044882 Aug 24 05:12:07.974257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 566/1025] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:08.767057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d8fad584-184f-4cd7-879f-7b0058915aa4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:08.769113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d8fad584-184f-4cd7-879f-7b0058915aa4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:08.776165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8fad584-184f-4cd7-879f-7b0058915aa4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:08.776642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8fad584-184f-4cd7-879f-7b0058915aa4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:08.777072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8fad584-184f-4cd7-879f-7b0058915aa4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:08.777752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8fad584-184f-4cd7-879f-7b0058915aa4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:08.778192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8fad584-184f-4cd7-879f-7b0058915aa4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:08.778606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8fad584-184f-4cd7-879f-7b0058915aa4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:08.783233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-58773810-e37a-4017-8d5b-576623502ed5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:08.785558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-58773810-e37a-4017-8d5b-576623502ed5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:08.795703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58773810-e37a-4017-8d5b-576623502ed5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:08.796499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58773810-e37a-4017-8d5b-576623502ed5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:08.797057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58773810-e37a-4017-8d5b-576623502ed5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:08.798328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58773810-e37a-4017-8d5b-576623502ed5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:08.798920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58773810-e37a-4017-8d5b-576623502ed5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:08.799839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58773810-e37a-4017-8d5b-576623502ed5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:08.815127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d8fad584-184f-4cd7-879f-7b0058915aa4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052222 Aug 24 05:12:08.816002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 460/1026] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:08.833350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-58773810-e37a-4017-8d5b-576623502ed5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053984 Aug 24 05:12:08.833898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 567/1027] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:08.985893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c33549fe-a014-43c6-ba41-188097e83026 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:08.988058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c33549fe-a014-43c6-ba41-188097e83026 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:08.994103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c33549fe-a014-43c6-ba41-188097e83026 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:08.994583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c33549fe-a014-43c6-ba41-188097e83026 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:08.995143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c33549fe-a014-43c6-ba41-188097e83026 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:08.995829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c33549fe-a014-43c6-ba41-188097e83026 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:08.996278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c33549fe-a014-43c6-ba41-188097e83026 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:08.996697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c33549fe-a014-43c6-ba41-188097e83026 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:09.027386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c33549fe-a014-43c6-ba41-188097e83026 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 Aug 24 05:12:09.027861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 461/1028] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:09.829225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-abd69563-38e6-4119-972c-06f752c39e6a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:09.831330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-abd69563-38e6-4119-972c-06f752c39e6a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:09.837978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-abd69563-38e6-4119-972c-06f752c39e6a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:09.838451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-abd69563-38e6-4119-972c-06f752c39e6a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:09.838918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-abd69563-38e6-4119-972c-06f752c39e6a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:09.839617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-abd69563-38e6-4119-972c-06f752c39e6a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:09.840058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-abd69563-38e6-4119-972c-06f752c39e6a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:09.840483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-abd69563-38e6-4119-972c-06f752c39e6a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:09.846397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b9575a1f-cae9-4679-bbe5-fef06d72507e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:09.848901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b9575a1f-cae9-4679-bbe5-fef06d72507e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:09.856867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9575a1f-cae9-4679-bbe5-fef06d72507e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:09.857355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9575a1f-cae9-4679-bbe5-fef06d72507e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:09.857788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9575a1f-cae9-4679-bbe5-fef06d72507e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:09.858485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9575a1f-cae9-4679-bbe5-fef06d72507e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:09.858967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9575a1f-cae9-4679-bbe5-fef06d72507e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:09.859383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9575a1f-cae9-4679-bbe5-fef06d72507e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:09.876125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-abd69563-38e6-4119-972c-06f752c39e6a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051167 Aug 24 05:12:09.876708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 568/1029] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:09.890919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b9575a1f-cae9-4679-bbe5-fef06d72507e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048642 Aug 24 05:12:09.891493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 462/1030] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:10.040464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-628a32d8-bf1c-4d17-921d-b7b5bc7e4355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:10.042578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-628a32d8-bf1c-4d17-921d-b7b5bc7e4355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:10.048553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-628a32d8-bf1c-4d17-921d-b7b5bc7e4355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:10.049025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-628a32d8-bf1c-4d17-921d-b7b5bc7e4355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:10.049454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-628a32d8-bf1c-4d17-921d-b7b5bc7e4355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:10.050132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-628a32d8-bf1c-4d17-921d-b7b5bc7e4355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:10.050868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-628a32d8-bf1c-4d17-921d-b7b5bc7e4355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:10.051290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-628a32d8-bf1c-4d17-921d-b7b5bc7e4355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:10.080186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-628a32d8-bf1c-4d17-921d-b7b5bc7e4355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044259 Aug 24 05:12:10.080639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 569/1031] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:10.889195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8b15bfa6-948e-4e59-be6e-0d1b53b9168a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:10.891340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8b15bfa6-948e-4e59-be6e-0d1b53b9168a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:10.898179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b15bfa6-948e-4e59-be6e-0d1b53b9168a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:10.898541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b15bfa6-948e-4e59-be6e-0d1b53b9168a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:10.899013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b15bfa6-948e-4e59-be6e-0d1b53b9168a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:10.899791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b15bfa6-948e-4e59-be6e-0d1b53b9168a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:10.900175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b15bfa6-948e-4e59-be6e-0d1b53b9168a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:10.900600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b15bfa6-948e-4e59-be6e-0d1b53b9168a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:10.903561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cfa41d7a-8bb3-4a48-bf05-8c220837e1f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:10.905943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cfa41d7a-8bb3-4a48-bf05-8c220837e1f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:10.912500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfa41d7a-8bb3-4a48-bf05-8c220837e1f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:10.913117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfa41d7a-8bb3-4a48-bf05-8c220837e1f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:10.913550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfa41d7a-8bb3-4a48-bf05-8c220837e1f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:10.914289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfa41d7a-8bb3-4a48-bf05-8c220837e1f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:10.914834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfa41d7a-8bb3-4a48-bf05-8c220837e1f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:10.915271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfa41d7a-8bb3-4a48-bf05-8c220837e1f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:10.932812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8b15bfa6-948e-4e59-be6e-0d1b53b9168a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047678 Aug 24 05:12:10.933579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 463/1032] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:10.947650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cfa41d7a-8bb3-4a48-bf05-8c220837e1f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048014 Aug 24 05:12:10.948214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 570/1033] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:11.092524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2d71691b-1901-4a0e-a1ca-cbad719a0a2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:11.094658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2d71691b-1901-4a0e-a1ca-cbad719a0a2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:11.101492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d71691b-1901-4a0e-a1ca-cbad719a0a2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:11.101973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d71691b-1901-4a0e-a1ca-cbad719a0a2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:11.102411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d71691b-1901-4a0e-a1ca-cbad719a0a2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:11.103164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d71691b-1901-4a0e-a1ca-cbad719a0a2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:11.103622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d71691b-1901-4a0e-a1ca-cbad719a0a2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:11.104053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d71691b-1901-4a0e-a1ca-cbad719a0a2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:11.136019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2d71691b-1901-4a0e-a1ca-cbad719a0a2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047419 Aug 24 05:12:11.136602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 464/1034] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:11.945341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-068a71f0-087b-4f7d-a494-6b609aa0a2c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:11.947522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-068a71f0-087b-4f7d-a494-6b609aa0a2c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:11.954016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068a71f0-087b-4f7d-a494-6b609aa0a2c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:11.954423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068a71f0-087b-4f7d-a494-6b609aa0a2c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:11.954906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068a71f0-087b-4f7d-a494-6b609aa0a2c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:11.955598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068a71f0-087b-4f7d-a494-6b609aa0a2c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:11.956114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068a71f0-087b-4f7d-a494-6b609aa0a2c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:11.956543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068a71f0-087b-4f7d-a494-6b609aa0a2c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:11.961709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-853a4c73-24c0-4987-9655-033379801868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:11.964214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-853a4c73-24c0-4987-9655-033379801868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:11.972060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-853a4c73-24c0-4987-9655-033379801868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:11.972556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-853a4c73-24c0-4987-9655-033379801868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:11.972991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-853a4c73-24c0-4987-9655-033379801868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:11.973697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-853a4c73-24c0-4987-9655-033379801868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:11.974282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-853a4c73-24c0-4987-9655-033379801868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:11.974715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-853a4c73-24c0-4987-9655-033379801868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:11.988510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-068a71f0-087b-4f7d-a494-6b609aa0a2c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047193 Aug 24 05:12:11.989434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 571/1035] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:12.008768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-853a4c73-24c0-4987-9655-033379801868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051119 Aug 24 05:12:12.009632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 465/1036] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:12.149401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c4848710-2950-413f-9018-67a5ed0b6df9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:12.151570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c4848710-2950-413f-9018-67a5ed0b6df9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:12.159461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4848710-2950-413f-9018-67a5ed0b6df9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:12.160177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4848710-2950-413f-9018-67a5ed0b6df9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:12.160794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4848710-2950-413f-9018-67a5ed0b6df9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:12.161827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4848710-2950-413f-9018-67a5ed0b6df9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:12.162475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4848710-2950-413f-9018-67a5ed0b6df9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:12.163462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4848710-2950-413f-9018-67a5ed0b6df9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:12.195429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c4848710-2950-413f-9018-67a5ed0b6df9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050729 Aug 24 05:12:12.195879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 572/1037] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:13.001889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a4a94c0d-c10f-45d0-a8d0-70e143cb9d5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:13.003952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a4a94c0d-c10f-45d0-a8d0-70e143cb9d5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:13.011769 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a94c0d-c10f-45d0-a8d0-70e143cb9d5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:13.012247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a94c0d-c10f-45d0-a8d0-70e143cb9d5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:13.012681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a94c0d-c10f-45d0-a8d0-70e143cb9d5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:13.013385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a94c0d-c10f-45d0-a8d0-70e143cb9d5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:13.013827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a94c0d-c10f-45d0-a8d0-70e143cb9d5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:13.014243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a94c0d-c10f-45d0-a8d0-70e143cb9d5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:13.021637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b48a8761-6350-41c9-9577-4b8198c09c0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:13.024704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b48a8761-6350-41c9-9577-4b8198c09c0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:13.031282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b48a8761-6350-41c9-9577-4b8198c09c0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:13.031763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b48a8761-6350-41c9-9577-4b8198c09c0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:13.032195 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b48a8761-6350-41c9-9577-4b8198c09c0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:13.032880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b48a8761-6350-41c9-9577-4b8198c09c0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:13.033319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b48a8761-6350-41c9-9577-4b8198c09c0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:13.033737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b48a8761-6350-41c9-9577-4b8198c09c0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:13.045713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a4a94c0d-c10f-45d0-a8d0-70e143cb9d5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047898 Aug 24 05:12:13.046279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 466/1038] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:13.066568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b48a8761-6350-41c9-9577-4b8198c09c0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048837 Aug 24 05:12:13.067161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 573/1039] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:13.211975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1234694c-9839-49de-ae69-10d4f9c0ad80 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:13.214352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1234694c-9839-49de-ae69-10d4f9c0ad80 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:13.220390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1234694c-9839-49de-ae69-10d4f9c0ad80 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:13.220864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1234694c-9839-49de-ae69-10d4f9c0ad80 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:13.221284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1234694c-9839-49de-ae69-10d4f9c0ad80 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:13.221963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1234694c-9839-49de-ae69-10d4f9c0ad80 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:13.222404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1234694c-9839-49de-ae69-10d4f9c0ad80 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:13.222852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1234694c-9839-49de-ae69-10d4f9c0ad80 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:13.254433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1234694c-9839-49de-ae69-10d4f9c0ad80 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Aug 24 05:12:13.254934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 467/1040] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:14.059061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cd0b1031-3b99-46a1-be21-aab99c2944da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:14.061093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cd0b1031-3b99-46a1-be21-aab99c2944da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:14.067594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd0b1031-3b99-46a1-be21-aab99c2944da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:14.068094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd0b1031-3b99-46a1-be21-aab99c2944da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:14.068527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd0b1031-3b99-46a1-be21-aab99c2944da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:14.069215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd0b1031-3b99-46a1-be21-aab99c2944da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:14.070278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd0b1031-3b99-46a1-be21-aab99c2944da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:14.070716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd0b1031-3b99-46a1-be21-aab99c2944da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:14.082115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a0a48297-3870-4897-84b9-7e0ffbf3516e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:14.085298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a0a48297-3870-4897-84b9-7e0ffbf3516e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:14.092965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0a48297-3870-4897-84b9-7e0ffbf3516e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:14.093521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0a48297-3870-4897-84b9-7e0ffbf3516e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:14.094038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0a48297-3870-4897-84b9-7e0ffbf3516e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:14.094902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0a48297-3870-4897-84b9-7e0ffbf3516e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:14.095453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0a48297-3870-4897-84b9-7e0ffbf3516e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:14.095881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0a48297-3870-4897-84b9-7e0ffbf3516e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:14.103741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cd0b1031-3b99-46a1-be21-aab99c2944da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049485 Aug 24 05:12:14.104430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 574/1041] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:14 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:14.128780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a0a48297-3870-4897-84b9-7e0ffbf3516e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052130 Aug 24 05:12:14.129338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 468/1042] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:14.266952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c75aa77a-5f4c-4b77-8408-e23d89134ce4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:14.269070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c75aa77a-5f4c-4b77-8408-e23d89134ce4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:14.275863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75aa77a-5f4c-4b77-8408-e23d89134ce4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:14.276335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75aa77a-5f4c-4b77-8408-e23d89134ce4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:14.276760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75aa77a-5f4c-4b77-8408-e23d89134ce4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:14.277446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75aa77a-5f4c-4b77-8408-e23d89134ce4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:14.277890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75aa77a-5f4c-4b77-8408-e23d89134ce4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:14.278296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75aa77a-5f4c-4b77-8408-e23d89134ce4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:14.311464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c75aa77a-5f4c-4b77-8408-e23d89134ce4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048412 Aug 24 05:12:14.311935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 575/1043] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:15.119371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-51276678-03d9-4e66-85d1-c3d2f60bfe43 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:15.123024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-51276678-03d9-4e66-85d1-c3d2f60bfe43 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:15.132431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51276678-03d9-4e66-85d1-c3d2f60bfe43 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:15.132929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51276678-03d9-4e66-85d1-c3d2f60bfe43 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:15.133400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51276678-03d9-4e66-85d1-c3d2f60bfe43 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:15.134077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51276678-03d9-4e66-85d1-c3d2f60bfe43 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:15.136130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51276678-03d9-4e66-85d1-c3d2f60bfe43 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:15.136130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51276678-03d9-4e66-85d1-c3d2f60bfe43 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:15.140108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:15.141746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8406208e-134f-4431-9743-437d6b6df27f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:15.144210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8406208e-134f-4431-9743-437d6b6df27f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:15.151385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8406208e-134f-4431-9743-437d6b6df27f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:15.151873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8406208e-134f-4431-9743-437d6b6df27f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:15.152309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8406208e-134f-4431-9743-437d6b6df27f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:15.153018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8406208e-134f-4431-9743-437d6b6df27f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:15.153499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8406208e-134f-4431-9743-437d6b6df27f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:15.153994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8406208e-134f-4431-9743-437d6b6df27f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:15.168972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-51276678-03d9-4e66-85d1-c3d2f60bfe43 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055829 Aug 24 05:12:15.173339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 469/1044] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:15.173546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:15.187659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8406208e-134f-4431-9743-437d6b6df27f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050034 Aug 24 05:12:15.188235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 576/1045] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:15.325319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b5bdba22-cb7d-441d-a7c5-15b8727e1829 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:15.327553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b5bdba22-cb7d-441d-a7c5-15b8727e1829 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:15.336485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5bdba22-cb7d-441d-a7c5-15b8727e1829 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:15.337268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5bdba22-cb7d-441d-a7c5-15b8727e1829 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:15.337775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5bdba22-cb7d-441d-a7c5-15b8727e1829 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:15.338483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5bdba22-cb7d-441d-a7c5-15b8727e1829 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:15.338969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5bdba22-cb7d-441d-a7c5-15b8727e1829 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:15.339391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5bdba22-cb7d-441d-a7c5-15b8727e1829 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:15.370492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b5bdba22-cb7d-441d-a7c5-15b8727e1829 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049428 Aug 24 05:12:15.371092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 470/1046] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:16.182224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dd3df1c3-d0cd-4e49-a9a7-c49890e7476a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:16.184429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dd3df1c3-d0cd-4e49-a9a7-c49890e7476a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:16.191135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd3df1c3-d0cd-4e49-a9a7-c49890e7476a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:16.191607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd3df1c3-d0cd-4e49-a9a7-c49890e7476a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:16.192035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd3df1c3-d0cd-4e49-a9a7-c49890e7476a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:16.192722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd3df1c3-d0cd-4e49-a9a7-c49890e7476a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:16.193165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd3df1c3-d0cd-4e49-a9a7-c49890e7476a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:16.193583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd3df1c3-d0cd-4e49-a9a7-c49890e7476a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:16.201815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7edf0d82-45ba-46a7-b60f-eb6694699007 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:16.203987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7edf0d82-45ba-46a7-b60f-eb6694699007 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:16.210938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7edf0d82-45ba-46a7-b60f-eb6694699007 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:16.211436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7edf0d82-45ba-46a7-b60f-eb6694699007 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:16.211869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7edf0d82-45ba-46a7-b60f-eb6694699007 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:16.212569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7edf0d82-45ba-46a7-b60f-eb6694699007 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:16.213022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7edf0d82-45ba-46a7-b60f-eb6694699007 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:16.213441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7edf0d82-45ba-46a7-b60f-eb6694699007 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:16.225305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dd3df1c3-d0cd-4e49-a9a7-c49890e7476a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047539 Aug 24 05:12:16.226012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 577/1047] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:16.244881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7edf0d82-45ba-46a7-b60f-eb6694699007 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047649 Aug 24 05:12:16.245356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 471/1048] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:16 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:16.383298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4066fd1a-3890-4781-a319-23b327d600da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:16.385434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4066fd1a-3890-4781-a319-23b327d600da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:16.391621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4066fd1a-3890-4781-a319-23b327d600da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:16.392159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4066fd1a-3890-4781-a319-23b327d600da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:16.392732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4066fd1a-3890-4781-a319-23b327d600da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:16.394235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4066fd1a-3890-4781-a319-23b327d600da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:16.394808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4066fd1a-3890-4781-a319-23b327d600da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:16.395238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4066fd1a-3890-4781-a319-23b327d600da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:16.425867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4066fd1a-3890-4781-a319-23b327d600da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046444 Aug 24 05:12:16.426405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 578/1049] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:16 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:17.238034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f8ed1788-1781-4592-801e-0996e9e3c17d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:17.240213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f8ed1788-1781-4592-801e-0996e9e3c17d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:17.247107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ed1788-1781-4592-801e-0996e9e3c17d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:17.247592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ed1788-1781-4592-801e-0996e9e3c17d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:17.248024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ed1788-1781-4592-801e-0996e9e3c17d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:17.248727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ed1788-1781-4592-801e-0996e9e3c17d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:17.249177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ed1788-1781-4592-801e-0996e9e3c17d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:17.249591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8ed1788-1781-4592-801e-0996e9e3c17d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:17.258447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-56fa9bd9-6278-46d5-aff3-788541e4a31a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:17.260708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-56fa9bd9-6278-46d5-aff3-788541e4a31a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:17.267900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fa9bd9-6278-46d5-aff3-788541e4a31a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:17.268385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fa9bd9-6278-46d5-aff3-788541e4a31a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:17.268824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fa9bd9-6278-46d5-aff3-788541e4a31a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:17.269556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fa9bd9-6278-46d5-aff3-788541e4a31a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:17.270008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fa9bd9-6278-46d5-aff3-788541e4a31a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:17.270432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fa9bd9-6278-46d5-aff3-788541e4a31a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:17.309123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-56fa9bd9-6278-46d5-aff3-788541e4a31a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055125 Aug 24 05:12:17.309716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 579/1050] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:17.438603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bd616f9c-027c-4b2a-a48c-d092803c2cfe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:17.439731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f8ed1788-1781-4592-801e-0996e9e3c17d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205629 Aug 24 05:12:17.440594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 472/1051] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:17 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:17.440923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bd616f9c-027c-4b2a-a48c-d092803c2cfe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:17.447891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd616f9c-027c-4b2a-a48c-d092803c2cfe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:17.448370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd616f9c-027c-4b2a-a48c-d092803c2cfe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:17.448806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd616f9c-027c-4b2a-a48c-d092803c2cfe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:17.449512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd616f9c-027c-4b2a-a48c-d092803c2cfe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:17.449957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd616f9c-027c-4b2a-a48c-d092803c2cfe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:17.450375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd616f9c-027c-4b2a-a48c-d092803c2cfe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:17.483437 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bd616f9c-027c-4b2a-a48c-d092803c2cfe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048404 Aug 24 05:12:17.484179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 580/1052] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:18.322102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3011fbdc-a3e5-4f99-8c43-de5cbb7d1159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:18.324226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3011fbdc-a3e5-4f99-8c43-de5cbb7d1159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:18.330925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3011fbdc-a3e5-4f99-8c43-de5cbb7d1159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:18.331406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3011fbdc-a3e5-4f99-8c43-de5cbb7d1159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:18.331849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3011fbdc-a3e5-4f99-8c43-de5cbb7d1159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:18.332537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3011fbdc-a3e5-4f99-8c43-de5cbb7d1159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:18.332987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3011fbdc-a3e5-4f99-8c43-de5cbb7d1159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:18.333409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3011fbdc-a3e5-4f99-8c43-de5cbb7d1159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:18.363520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3011fbdc-a3e5-4f99-8c43-de5cbb7d1159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Aug 24 05:12:18.363977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 473/1053] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:18.452647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e8b6c8e0-dab4-47dc-913a-a19efb825b00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:18.454837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e8b6c8e0-dab4-47dc-913a-a19efb825b00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:18.461729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b6c8e0-dab4-47dc-913a-a19efb825b00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:18.462205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b6c8e0-dab4-47dc-913a-a19efb825b00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:18.462644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b6c8e0-dab4-47dc-913a-a19efb825b00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:18.463364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b6c8e0-dab4-47dc-913a-a19efb825b00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:18.463810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b6c8e0-dab4-47dc-913a-a19efb825b00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:18.464236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b6c8e0-dab4-47dc-913a-a19efb825b00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:18.495581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e8b6c8e0-dab4-47dc-913a-a19efb825b00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047166 Aug 24 05:12:18.496156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 581/1054] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:18.496541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d2f68b72-da21-45a1-a27d-3cd726e6ec2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:18.498916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d2f68b72-da21-45a1-a27d-3cd726e6ec2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:18.505320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2f68b72-da21-45a1-a27d-3cd726e6ec2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:18.505802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2f68b72-da21-45a1-a27d-3cd726e6ec2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:18.506240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2f68b72-da21-45a1-a27d-3cd726e6ec2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:18.507739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2f68b72-da21-45a1-a27d-3cd726e6ec2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:18.508203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2f68b72-da21-45a1-a27d-3cd726e6ec2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:18.508628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d2f68b72-da21-45a1-a27d-3cd726e6ec2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:18.540940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d2f68b72-da21-45a1-a27d-3cd726e6ec2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048318 Aug 24 05:12:18.541495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 474/1055] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:19.378994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0c3f6175-ea0a-4dfd-92ee-ee888ed56e3a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:19.381042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0c3f6175-ea0a-4dfd-92ee-ee888ed56e3a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:19.387519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c3f6175-ea0a-4dfd-92ee-ee888ed56e3a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:19.387991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c3f6175-ea0a-4dfd-92ee-ee888ed56e3a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:19.388426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c3f6175-ea0a-4dfd-92ee-ee888ed56e3a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:19.389113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c3f6175-ea0a-4dfd-92ee-ee888ed56e3a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:19.389554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c3f6175-ea0a-4dfd-92ee-ee888ed56e3a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:19.389966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c3f6175-ea0a-4dfd-92ee-ee888ed56e3a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:19.420578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0c3f6175-ea0a-4dfd-92ee-ee888ed56e3a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046727 Aug 24 05:12:19.421145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 582/1056] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:19.507380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e5dbbcd3-b811-412b-8a78-be15c9239501 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:19.509486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e5dbbcd3-b811-412b-8a78-be15c9239501 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:19.516092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5dbbcd3-b811-412b-8a78-be15c9239501 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:19.516569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5dbbcd3-b811-412b-8a78-be15c9239501 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:19.517005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5dbbcd3-b811-412b-8a78-be15c9239501 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:19.517898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5dbbcd3-b811-412b-8a78-be15c9239501 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:19.518122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5dbbcd3-b811-412b-8a78-be15c9239501 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:19.518538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5dbbcd3-b811-412b-8a78-be15c9239501 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:19.549854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e5dbbcd3-b811-412b-8a78-be15c9239501 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046547 Aug 24 05:12:19.550668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 475/1057] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:19.552781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d8e642b4-513f-4908-b9ca-0fe8c05a601e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:19.555741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d8e642b4-513f-4908-b9ca-0fe8c05a601e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:19.563097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e642b4-513f-4908-b9ca-0fe8c05a601e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:19.563576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e642b4-513f-4908-b9ca-0fe8c05a601e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:19.564033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e642b4-513f-4908-b9ca-0fe8c05a601e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:19.564718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e642b4-513f-4908-b9ca-0fe8c05a601e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:19.565156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e642b4-513f-4908-b9ca-0fe8c05a601e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:19.565568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e642b4-513f-4908-b9ca-0fe8c05a601e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:19.597046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d8e642b4-513f-4908-b9ca-0fe8c05a601e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048488 Aug 24 05:12:19.597600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 583/1058] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:20.434038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a520495c-c762-495b-95a0-55018331e08b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:20.437770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a520495c-c762-495b-95a0-55018331e08b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:20.448734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a520495c-c762-495b-95a0-55018331e08b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:20.449256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a520495c-c762-495b-95a0-55018331e08b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:20.449736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a520495c-c762-495b-95a0-55018331e08b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:20.450446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a520495c-c762-495b-95a0-55018331e08b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:20.450932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a520495c-c762-495b-95a0-55018331e08b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:20.451360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a520495c-c762-495b-95a0-55018331e08b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:20.486580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a520495c-c762-495b-95a0-55018331e08b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057568 Aug 24 05:12:20.487168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 476/1059] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:20.563665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2967cc71-17a8-4481-8ccf-62ea49f8bd00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:20.565715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2967cc71-17a8-4481-8ccf-62ea49f8bd00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:20.572431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2967cc71-17a8-4481-8ccf-62ea49f8bd00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:20.572914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2967cc71-17a8-4481-8ccf-62ea49f8bd00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:20.573345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2967cc71-17a8-4481-8ccf-62ea49f8bd00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:20.574033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2967cc71-17a8-4481-8ccf-62ea49f8bd00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:20.574477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2967cc71-17a8-4481-8ccf-62ea49f8bd00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:20.574916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2967cc71-17a8-4481-8ccf-62ea49f8bd00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:20.606248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2967cc71-17a8-4481-8ccf-62ea49f8bd00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046671 Aug 24 05:12:20.606837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 584/1060] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:20.609876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e731dd82-ba57-4eb6-8f3a-bcddead3da89 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:20.612033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e731dd82-ba57-4eb6-8f3a-bcddead3da89 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:20.619256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e731dd82-ba57-4eb6-8f3a-bcddead3da89 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:20.619736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e731dd82-ba57-4eb6-8f3a-bcddead3da89 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:20.620417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e731dd82-ba57-4eb6-8f3a-bcddead3da89 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:20.621111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e731dd82-ba57-4eb6-8f3a-bcddead3da89 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:20.621582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e731dd82-ba57-4eb6-8f3a-bcddead3da89 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:20.622004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e731dd82-ba57-4eb6-8f3a-bcddead3da89 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:20.655300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e731dd82-ba57-4eb6-8f3a-bcddead3da89 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049305 Aug 24 05:12:20.655896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 477/1061] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:21.502368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5fdf25de-e8fc-4b38-8abd-9d7d572bba3f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:21.504808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5fdf25de-e8fc-4b38-8abd-9d7d572bba3f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:21.512689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fdf25de-e8fc-4b38-8abd-9d7d572bba3f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:21.513162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fdf25de-e8fc-4b38-8abd-9d7d572bba3f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:21.513593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fdf25de-e8fc-4b38-8abd-9d7d572bba3f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:21.514292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fdf25de-e8fc-4b38-8abd-9d7d572bba3f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:21.514754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fdf25de-e8fc-4b38-8abd-9d7d572bba3f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:21.515171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fdf25de-e8fc-4b38-8abd-9d7d572bba3f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:21.553482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5fdf25de-e8fc-4b38-8abd-9d7d572bba3f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057256 Aug 24 05:12:21.554180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 585/1062] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:21.620613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c9d57bf3-6ba3-470f-8bcd-dd376ef4a123 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:21.622825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c9d57bf3-6ba3-470f-8bcd-dd376ef4a123 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:21.629706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9d57bf3-6ba3-470f-8bcd-dd376ef4a123 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:21.630228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9d57bf3-6ba3-470f-8bcd-dd376ef4a123 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:21.630799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9d57bf3-6ba3-470f-8bcd-dd376ef4a123 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:21.631525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9d57bf3-6ba3-470f-8bcd-dd376ef4a123 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:21.632548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9d57bf3-6ba3-470f-8bcd-dd376ef4a123 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:21.633317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9d57bf3-6ba3-470f-8bcd-dd376ef4a123 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:21.669802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c3302aa0-703b-444b-91b1-27c56bef9d4c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:21.671971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c3302aa0-703b-444b-91b1-27c56bef9d4c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:21.672405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c9d57bf3-6ba3-470f-8bcd-dd376ef4a123 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056043 Aug 24 05:12:21.673629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 478/1063] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:21.678814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3302aa0-703b-444b-91b1-27c56bef9d4c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:21.679275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3302aa0-703b-444b-91b1-27c56bef9d4c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:21.679904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3302aa0-703b-444b-91b1-27c56bef9d4c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:21.680609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3302aa0-703b-444b-91b1-27c56bef9d4c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:21.681056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3302aa0-703b-444b-91b1-27c56bef9d4c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:21.681476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3302aa0-703b-444b-91b1-27c56bef9d4c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:21.734910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c3302aa0-703b-444b-91b1-27c56bef9d4c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071355 Aug 24 05:12:21.735756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 586/1064] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:22.568461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fdd0b166-5df0-4f9c-a8f4-697b593efc7b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:22.570593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fdd0b166-5df0-4f9c-a8f4-697b593efc7b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:22.576711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdd0b166-5df0-4f9c-a8f4-697b593efc7b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:22.577195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdd0b166-5df0-4f9c-a8f4-697b593efc7b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:22.577636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdd0b166-5df0-4f9c-a8f4-697b593efc7b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:22.578328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdd0b166-5df0-4f9c-a8f4-697b593efc7b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:22.578813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdd0b166-5df0-4f9c-a8f4-697b593efc7b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:22.579236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdd0b166-5df0-4f9c-a8f4-697b593efc7b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:22.609715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fdd0b166-5df0-4f9c-a8f4-697b593efc7b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Aug 24 05:12:22.610188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 479/1065] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:22.686723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4bfa92a5-1dec-42f6-9036-2eb0a365e8c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:22.688906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4bfa92a5-1dec-42f6-9036-2eb0a365e8c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:22.695666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bfa92a5-1dec-42f6-9036-2eb0a365e8c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:22.696176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bfa92a5-1dec-42f6-9036-2eb0a365e8c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:22.696609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bfa92a5-1dec-42f6-9036-2eb0a365e8c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:22.697400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bfa92a5-1dec-42f6-9036-2eb0a365e8c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:22.697849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bfa92a5-1dec-42f6-9036-2eb0a365e8c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:22.698268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bfa92a5-1dec-42f6-9036-2eb0a365e8c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:22.729464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4bfa92a5-1dec-42f6-9036-2eb0a365e8c3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046700 Aug 24 05:12:22.730049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 587/1066] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:22 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:22.747792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-aaaea774-b170-4cd8-ad09-72b7b112a520 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:22.749925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-aaaea774-b170-4cd8-ad09-72b7b112a520 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:22.756728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaaea774-b170-4cd8-ad09-72b7b112a520 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:22.757215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaaea774-b170-4cd8-ad09-72b7b112a520 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:22.757654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaaea774-b170-4cd8-ad09-72b7b112a520 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:22.758407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaaea774-b170-4cd8-ad09-72b7b112a520 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:22.759054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaaea774-b170-4cd8-ad09-72b7b112a520 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:22.759486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaaea774-b170-4cd8-ad09-72b7b112a520 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:22.792917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-aaaea774-b170-4cd8-ad09-72b7b112a520 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049187 Aug 24 05:12:22.793716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 480/1067] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:23.622581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4ad7dfee-3e94-4fa8-b298-dce65512acb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:23.624758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4ad7dfee-3e94-4fa8-b298-dce65512acb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:23.630957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ad7dfee-3e94-4fa8-b298-dce65512acb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:23.631487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ad7dfee-3e94-4fa8-b298-dce65512acb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:23.631926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ad7dfee-3e94-4fa8-b298-dce65512acb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:23.632622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ad7dfee-3e94-4fa8-b298-dce65512acb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:23.633070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ad7dfee-3e94-4fa8-b298-dce65512acb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:23.634338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ad7dfee-3e94-4fa8-b298-dce65512acb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:23.669581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4ad7dfee-3e94-4fa8-b298-dce65512acb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051467 Aug 24 05:12:23.670075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 588/1068] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:23.743496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cbf255aa-e449-48c9-aecb-851872266f96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:23.746664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cbf255aa-e449-48c9-aecb-851872266f96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:23.758280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbf255aa-e449-48c9-aecb-851872266f96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:23.759867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbf255aa-e449-48c9-aecb-851872266f96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:23.760451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbf255aa-e449-48c9-aecb-851872266f96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:23.761618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbf255aa-e449-48c9-aecb-851872266f96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:23.762430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbf255aa-e449-48c9-aecb-851872266f96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:23.763274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbf255aa-e449-48c9-aecb-851872266f96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:23.810143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-87c0287b-fb40-417b-988e-cda46e6acec5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:23.813140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-87c0287b-fb40-417b-988e-cda46e6acec5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:23.817892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cbf255aa-e449-48c9-aecb-851872266f96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079592 Aug 24 05:12:23.819065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 481/1069] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:23.822368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c0287b-fb40-417b-988e-cda46e6acec5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:23.822885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c0287b-fb40-417b-988e-cda46e6acec5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:23.823356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c0287b-fb40-417b-988e-cda46e6acec5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:23.824066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c0287b-fb40-417b-988e-cda46e6acec5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:23.824518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c0287b-fb40-417b-988e-cda46e6acec5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:23.824939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c0287b-fb40-417b-988e-cda46e6acec5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:23.859549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-87c0287b-fb40-417b-988e-cda46e6acec5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055856 Aug 24 05:12:23.860126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 589/1070] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:24.681917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-633abeb5-e062-4376-b0a8-f704951c19f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:24.684068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-633abeb5-e062-4376-b0a8-f704951c19f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:24.690256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-633abeb5-e062-4376-b0a8-f704951c19f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:24.690752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-633abeb5-e062-4376-b0a8-f704951c19f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:24.691185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-633abeb5-e062-4376-b0a8-f704951c19f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:24.691902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-633abeb5-e062-4376-b0a8-f704951c19f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:24.692346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-633abeb5-e062-4376-b0a8-f704951c19f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:24.692765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-633abeb5-e062-4376-b0a8-f704951c19f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:24.725242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-633abeb5-e062-4376-b0a8-f704951c19f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047171 Aug 24 05:12:24.725729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 482/1071] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:24.831767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-07a63290-b33e-4537-82eb-d1d18aa6a087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:24.833922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-07a63290-b33e-4537-82eb-d1d18aa6a087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:24.841735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07a63290-b33e-4537-82eb-d1d18aa6a087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:24.842223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07a63290-b33e-4537-82eb-d1d18aa6a087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:24.842652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07a63290-b33e-4537-82eb-d1d18aa6a087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:24.843390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07a63290-b33e-4537-82eb-d1d18aa6a087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:24.843834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07a63290-b33e-4537-82eb-d1d18aa6a087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:24.844287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07a63290-b33e-4537-82eb-d1d18aa6a087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:24.873738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4e69201e-0868-47ff-a942-3c4b51c1d2bf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:24.876057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4e69201e-0868-47ff-a942-3c4b51c1d2bf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:24.881241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-07a63290-b33e-4537-82eb-d1d18aa6a087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053593 Aug 24 05:12:24.881810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 590/1072] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:24 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:24.882555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e69201e-0868-47ff-a942-3c4b51c1d2bf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:24.888587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e69201e-0868-47ff-a942-3c4b51c1d2bf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:24.888587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e69201e-0868-47ff-a942-3c4b51c1d2bf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:24.888587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e69201e-0868-47ff-a942-3c4b51c1d2bf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:24.888587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e69201e-0868-47ff-a942-3c4b51c1d2bf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:24.890093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e69201e-0868-47ff-a942-3c4b51c1d2bf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:24.917581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4e69201e-0868-47ff-a942-3c4b51c1d2bf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048048 Aug 24 05:12:24.918164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 483/1073] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:25.737774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4583036b-39cd-4703-99dd-028572b98b6c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:25.740005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4583036b-39cd-4703-99dd-028572b98b6c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:25.746275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4583036b-39cd-4703-99dd-028572b98b6c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:25.746781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4583036b-39cd-4703-99dd-028572b98b6c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:25.747216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4583036b-39cd-4703-99dd-028572b98b6c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:25.747902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4583036b-39cd-4703-99dd-028572b98b6c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:25.748384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4583036b-39cd-4703-99dd-028572b98b6c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:25.748814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4583036b-39cd-4703-99dd-028572b98b6c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:25.783523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4583036b-39cd-4703-99dd-028572b98b6c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049630 Aug 24 05:12:25.784004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 591/1074] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:25.895044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-76a01a2a-0506-4a37-8aa3-bad6930165e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:25.897211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-76a01a2a-0506-4a37-8aa3-bad6930165e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:25.906274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76a01a2a-0506-4a37-8aa3-bad6930165e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:25.906797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76a01a2a-0506-4a37-8aa3-bad6930165e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:25.907234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76a01a2a-0506-4a37-8aa3-bad6930165e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:25.907941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76a01a2a-0506-4a37-8aa3-bad6930165e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:25.908390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76a01a2a-0506-4a37-8aa3-bad6930165e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:25.908810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76a01a2a-0506-4a37-8aa3-bad6930165e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:25.932051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6823edce-9e1b-4418-a45b-92e3605ba9fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:25.934230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6823edce-9e1b-4418-a45b-92e3605ba9fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:25.941325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6823edce-9e1b-4418-a45b-92e3605ba9fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:25.941743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6823edce-9e1b-4418-a45b-92e3605ba9fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:25.942179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6823edce-9e1b-4418-a45b-92e3605ba9fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:25.943067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6823edce-9e1b-4418-a45b-92e3605ba9fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:25.943381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6823edce-9e1b-4418-a45b-92e3605ba9fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:25.943800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6823edce-9e1b-4418-a45b-92e3605ba9fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:25.944403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-76a01a2a-0506-4a37-8aa3-bad6930165e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053367 Aug 24 05:12:25.944995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 484/1075] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:25.977980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6823edce-9e1b-4418-a45b-92e3605ba9fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049243 Aug 24 05:12:25.978667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 592/1076] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:26.796665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-088d7844-0add-4b7a-9296-f5c005a2d78f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:26.798804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-088d7844-0add-4b7a-9296-f5c005a2d78f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:26.805097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-088d7844-0add-4b7a-9296-f5c005a2d78f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:26.806380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-088d7844-0add-4b7a-9296-f5c005a2d78f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:26.807412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-088d7844-0add-4b7a-9296-f5c005a2d78f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:26.807412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-088d7844-0add-4b7a-9296-f5c005a2d78f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:26.808042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-088d7844-0add-4b7a-9296-f5c005a2d78f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:26.808507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-088d7844-0add-4b7a-9296-f5c005a2d78f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:26.840255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:26.845709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-088d7844-0add-4b7a-9296-f5c005a2d78f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053003 Aug 24 05:12:26.846205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 485/1077] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:26 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:26.957945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-637722e9-91fd-4019-9d03-30250ec69a86 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:26.960102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-637722e9-91fd-4019-9d03-30250ec69a86 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:26.967071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637722e9-91fd-4019-9d03-30250ec69a86 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:26.967549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637722e9-91fd-4019-9d03-30250ec69a86 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:26.967984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637722e9-91fd-4019-9d03-30250ec69a86 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:26.968669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637722e9-91fd-4019-9d03-30250ec69a86 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:26.969113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637722e9-91fd-4019-9d03-30250ec69a86 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:26.969529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637722e9-91fd-4019-9d03-30250ec69a86 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:26.973334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:26.993854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-777417f6-3932-47a2-8d17-8d68e87cb652 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:26.996096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-777417f6-3932-47a2-8d17-8d68e87cb652 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:27.002636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-637722e9-91fd-4019-9d03-30250ec69a86 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048578 Aug 24 05:12:27.003251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 593/1078] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:27.003723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-777417f6-3932-47a2-8d17-8d68e87cb652 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:27.004398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-777417f6-3932-47a2-8d17-8d68e87cb652 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:27.005084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-777417f6-3932-47a2-8d17-8d68e87cb652 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:27.006114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-777417f6-3932-47a2-8d17-8d68e87cb652 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:27.006618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-777417f6-3932-47a2-8d17-8d68e87cb652 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:27.007162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-777417f6-3932-47a2-8d17-8d68e87cb652 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:27.041278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-777417f6-3932-47a2-8d17-8d68e87cb652 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051958 Aug 24 05:12:27.041838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 486/1079] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:27.858025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c3b73596-ccbc-4396-993c-92898cc1d63c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:27.860240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c3b73596-ccbc-4396-993c-92898cc1d63c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:27.866256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3b73596-ccbc-4396-993c-92898cc1d63c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:27.866766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3b73596-ccbc-4396-993c-92898cc1d63c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:27.867199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3b73596-ccbc-4396-993c-92898cc1d63c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:27.868824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3b73596-ccbc-4396-993c-92898cc1d63c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:27.868824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3b73596-ccbc-4396-993c-92898cc1d63c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:27.868824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c3b73596-ccbc-4396-993c-92898cc1d63c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:27.900260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c3b73596-ccbc-4396-993c-92898cc1d63c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046125 Aug 24 05:12:27.900818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 594/1080] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:28.016123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-81ca46b4-fb67-4e1c-a041-ee6aba72947d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:28.018233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-81ca46b4-fb67-4e1c-a041-ee6aba72947d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:28.024813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ca46b4-fb67-4e1c-a041-ee6aba72947d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:28.025296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ca46b4-fb67-4e1c-a041-ee6aba72947d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:28.025729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ca46b4-fb67-4e1c-a041-ee6aba72947d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:28.026425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ca46b4-fb67-4e1c-a041-ee6aba72947d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:28.026907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ca46b4-fb67-4e1c-a041-ee6aba72947d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:28.027331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81ca46b4-fb67-4e1c-a041-ee6aba72947d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:28.053898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-176247c4-5b49-41f5-ab8f-f3ab690eaf71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:28.056761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-176247c4-5b49-41f5-ab8f-f3ab690eaf71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:28.060734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-81ca46b4-fb67-4e1c-a041-ee6aba72947d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048566 Aug 24 05:12:28.061316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 487/1081] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:28.065161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-176247c4-5b49-41f5-ab8f-f3ab690eaf71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:28.066186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-176247c4-5b49-41f5-ab8f-f3ab690eaf71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:28.066873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-176247c4-5b49-41f5-ab8f-f3ab690eaf71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:28.069099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-176247c4-5b49-41f5-ab8f-f3ab690eaf71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:28.069099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-176247c4-5b49-41f5-ab8f-f3ab690eaf71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:28.069491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-176247c4-5b49-41f5-ab8f-f3ab690eaf71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:28.103404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-176247c4-5b49-41f5-ab8f-f3ab690eaf71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053712 Aug 24 05:12:28.103967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 595/1082] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:28.912778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0a9c8d6d-673d-4149-bd8b-9cc35846da7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:28.915680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0a9c8d6d-673d-4149-bd8b-9cc35846da7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:28.921792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d6d-673d-4149-bd8b-9cc35846da7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:28.922262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d6d-673d-4149-bd8b-9cc35846da7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:28.922717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d6d-673d-4149-bd8b-9cc35846da7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:28.923403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d6d-673d-4149-bd8b-9cc35846da7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:28.923847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d6d-673d-4149-bd8b-9cc35846da7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:28.924262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a9c8d6d-673d-4149-bd8b-9cc35846da7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:28.954133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0a9c8d6d-673d-4149-bd8b-9cc35846da7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Aug 24 05:12:28.954708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 488/1083] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:29.074296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fdcd834c-8764-4e2c-b640-ddd1438c3b81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:29.076466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fdcd834c-8764-4e2c-b640-ddd1438c3b81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:29.083311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fdcd834c-8764-4e2c-b640-ddd1438c3b81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:29.083811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fdcd834c-8764-4e2c-b640-ddd1438c3b81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:29.084226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fdcd834c-8764-4e2c-b640-ddd1438c3b81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:29.084923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fdcd834c-8764-4e2c-b640-ddd1438c3b81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:29.085405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fdcd834c-8764-4e2c-b640-ddd1438c3b81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:29.085819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fdcd834c-8764-4e2c-b640-ddd1438c3b81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:29.115942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-04ba5f19-12eb-430e-bf80-7fe1f44f99d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:29.118075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-04ba5f19-12eb-430e-bf80-7fe1f44f99d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:29.124133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fdcd834c-8764-4e2c-b640-ddd1438c3b81 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054895 Aug 24 05:12:29.124711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 596/1084] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:29.124834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04ba5f19-12eb-430e-bf80-7fe1f44f99d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:29.125292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04ba5f19-12eb-430e-bf80-7fe1f44f99d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:29.125730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04ba5f19-12eb-430e-bf80-7fe1f44f99d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:29.126433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04ba5f19-12eb-430e-bf80-7fe1f44f99d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:29.126924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04ba5f19-12eb-430e-bf80-7fe1f44f99d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:29.127351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04ba5f19-12eb-430e-bf80-7fe1f44f99d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:29.163564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-04ba5f19-12eb-430e-bf80-7fe1f44f99d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051467 Aug 24 05:12:29.164116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 489/1085] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:29.967147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9579467a-2e66-493f-9399-bb54d9e8c59d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:29.969274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9579467a-2e66-493f-9399-bb54d9e8c59d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:29.976101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9579467a-2e66-493f-9399-bb54d9e8c59d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:29.976582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9579467a-2e66-493f-9399-bb54d9e8c59d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:29.977576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9579467a-2e66-493f-9399-bb54d9e8c59d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:29.978446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9579467a-2e66-493f-9399-bb54d9e8c59d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:29.978928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9579467a-2e66-493f-9399-bb54d9e8c59d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:29.979350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9579467a-2e66-493f-9399-bb54d9e8c59d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:30.012504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9579467a-2e66-493f-9399-bb54d9e8c59d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049121 Aug 24 05:12:30.013015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 597/1086] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:30.137622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-47572fec-e2ab-4e2f-9504-cbf387619c23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:30.139878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-47572fec-e2ab-4e2f-9504-cbf387619c23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:30.146406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47572fec-e2ab-4e2f-9504-cbf387619c23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:30.147006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47572fec-e2ab-4e2f-9504-cbf387619c23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:30.147445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47572fec-e2ab-4e2f-9504-cbf387619c23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:30.148147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47572fec-e2ab-4e2f-9504-cbf387619c23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:30.148599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47572fec-e2ab-4e2f-9504-cbf387619c23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:30.149653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47572fec-e2ab-4e2f-9504-cbf387619c23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:30.179772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3fcb199c-4362-41ba-9623-c77f107683cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:30.182344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3fcb199c-4362-41ba-9623-c77f107683cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:30.188761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fcb199c-4362-41ba-9623-c77f107683cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:30.189239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fcb199c-4362-41ba-9623-c77f107683cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:30.189343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-47572fec-e2ab-4e2f-9504-cbf387619c23 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055445 Aug 24 05:12:30.189665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fcb199c-4362-41ba-9623-c77f107683cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:30.190138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 490/1087] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:30.190350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fcb199c-4362-41ba-9623-c77f107683cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:30.190815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fcb199c-4362-41ba-9623-c77f107683cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:30.191231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fcb199c-4362-41ba-9623-c77f107683cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:30.222616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3fcb199c-4362-41ba-9623-c77f107683cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049833 Aug 24 05:12:30.223206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 598/1088] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:31.028726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-41f41427-eaa9-4895-9bc3-602bc99d6179 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:31.030781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-41f41427-eaa9-4895-9bc3-602bc99d6179 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:31.032645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=86 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:31.037830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41f41427-eaa9-4895-9bc3-602bc99d6179 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:31.038309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41f41427-eaa9-4895-9bc3-602bc99d6179 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:31.038771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41f41427-eaa9-4895-9bc3-602bc99d6179 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:31.039508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41f41427-eaa9-4895-9bc3-602bc99d6179 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:31.040489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41f41427-eaa9-4895-9bc3-602bc99d6179 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:31.040931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41f41427-eaa9-4895-9bc3-602bc99d6179 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:31.070245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-41f41427-eaa9-4895-9bc3-602bc99d6179 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Aug 24 05:12:31.070845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 491/1089] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:31.204517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7d87a02b-eb51-4c14-a44c-a319c223e22d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:31.207646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7d87a02b-eb51-4c14-a44c-a319c223e22d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:31.217780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d87a02b-eb51-4c14-a44c-a319c223e22d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:31.219202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d87a02b-eb51-4c14-a44c-a319c223e22d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:31.220716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d87a02b-eb51-4c14-a44c-a319c223e22d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:31.222814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d87a02b-eb51-4c14-a44c-a319c223e22d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:31.225103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d87a02b-eb51-4c14-a44c-a319c223e22d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:31.226228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d87a02b-eb51-4c14-a44c-a319c223e22d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:31.236661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1faca37c-de6a-48eb-913a-fd2c4a210fbe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:31.239069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1faca37c-de6a-48eb-913a-fd2c4a210fbe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:31.245935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1faca37c-de6a-48eb-913a-fd2c4a210fbe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:31.246417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1faca37c-de6a-48eb-913a-fd2c4a210fbe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:31.246889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1faca37c-de6a-48eb-913a-fd2c4a210fbe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:31.247584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1faca37c-de6a-48eb-913a-fd2c4a210fbe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:31.248037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1faca37c-de6a-48eb-913a-fd2c4a210fbe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:31.248618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1faca37c-de6a-48eb-913a-fd2c4a210fbe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:31.263378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7d87a02b-eb51-4c14-a44c-a319c223e22d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065465 Aug 24 05:12:31.263940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 599/1090] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:31.279978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1faca37c-de6a-48eb-913a-fd2c4a210fbe tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047458 Aug 24 05:12:31.280452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 492/1091] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:32.082674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9c836a75-d85e-4cb6-8d33-733eb1eda6fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:32.084870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9c836a75-d85e-4cb6-8d33-733eb1eda6fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:32.094933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c836a75-d85e-4cb6-8d33-733eb1eda6fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:32.095779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c836a75-d85e-4cb6-8d33-733eb1eda6fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:32.096487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c836a75-d85e-4cb6-8d33-733eb1eda6fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:32.097648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c836a75-d85e-4cb6-8d33-733eb1eda6fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:32.098441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c836a75-d85e-4cb6-8d33-733eb1eda6fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:32.099135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c836a75-d85e-4cb6-8d33-733eb1eda6fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:32.153481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9c836a75-d85e-4cb6-8d33-733eb1eda6fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074538 Aug 24 05:12:32.154464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 600/1092] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:32.276462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dfd16f4a-4d90-488a-bbb0-fc5c1c8a9668 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:32.278533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dfd16f4a-4d90-488a-bbb0-fc5c1c8a9668 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:32.285012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd16f4a-4d90-488a-bbb0-fc5c1c8a9668 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:32.285495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd16f4a-4d90-488a-bbb0-fc5c1c8a9668 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:32.285929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd16f4a-4d90-488a-bbb0-fc5c1c8a9668 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:32.286734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd16f4a-4d90-488a-bbb0-fc5c1c8a9668 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:32.287191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd16f4a-4d90-488a-bbb0-fc5c1c8a9668 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:32.287616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfd16f4a-4d90-488a-bbb0-fc5c1c8a9668 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:32.292079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6bde1a9e-79b6-428f-98cd-cf721bd0ddad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:32.294239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6bde1a9e-79b6-428f-98cd-cf721bd0ddad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:32.301054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6bde1a9e-79b6-428f-98cd-cf721bd0ddad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:32.301532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6bde1a9e-79b6-428f-98cd-cf721bd0ddad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:32.301968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6bde1a9e-79b6-428f-98cd-cf721bd0ddad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:32.302665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6bde1a9e-79b6-428f-98cd-cf721bd0ddad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:32.303241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6bde1a9e-79b6-428f-98cd-cf721bd0ddad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:32.303668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6bde1a9e-79b6-428f-98cd-cf721bd0ddad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:32.317975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dfd16f4a-4d90-488a-bbb0-fc5c1c8a9668 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046192 Aug 24 05:12:32.318549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 493/1093] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:32.334378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6bde1a9e-79b6-428f-98cd-cf721bd0ddad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046309 Aug 24 05:12:32.334924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 601/1094] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:33.168578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fcd18b7a-6373-462d-8e2f-9cdf393eda56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:33.170739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fcd18b7a-6373-462d-8e2f-9cdf393eda56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:33.176984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcd18b7a-6373-462d-8e2f-9cdf393eda56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:33.177475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcd18b7a-6373-462d-8e2f-9cdf393eda56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:33.177897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcd18b7a-6373-462d-8e2f-9cdf393eda56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:33.178576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcd18b7a-6373-462d-8e2f-9cdf393eda56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:33.179058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcd18b7a-6373-462d-8e2f-9cdf393eda56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:33.179477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fcd18b7a-6373-462d-8e2f-9cdf393eda56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:33.208795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fcd18b7a-6373-462d-8e2f-9cdf393eda56 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044750 Aug 24 05:12:33.209549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 494/1095] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:33.330996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b429fab9-d73a-46b6-b29e-d7be6a992d11 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:33.333074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b429fab9-d73a-46b6-b29e-d7be6a992d11 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:33.340858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b429fab9-d73a-46b6-b29e-d7be6a992d11 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:33.341343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b429fab9-d73a-46b6-b29e-d7be6a992d11 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:33.341772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b429fab9-d73a-46b6-b29e-d7be6a992d11 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:33.342474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b429fab9-d73a-46b6-b29e-d7be6a992d11 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:33.342958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b429fab9-d73a-46b6-b29e-d7be6a992d11 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:33.343413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b429fab9-d73a-46b6-b29e-d7be6a992d11 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:33.348100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c13a2745-9f70-47fe-93ee-47f689a9a97d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:33.350407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c13a2745-9f70-47fe-93ee-47f689a9a97d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:33.357720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c13a2745-9f70-47fe-93ee-47f689a9a97d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:33.358211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c13a2745-9f70-47fe-93ee-47f689a9a97d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:33.358656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c13a2745-9f70-47fe-93ee-47f689a9a97d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:33.359396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c13a2745-9f70-47fe-93ee-47f689a9a97d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:33.359849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c13a2745-9f70-47fe-93ee-47f689a9a97d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:33.360272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c13a2745-9f70-47fe-93ee-47f689a9a97d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:33.374907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b429fab9-d73a-46b6-b29e-d7be6a992d11 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047936 Aug 24 05:12:33.375475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 602/1096] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:33 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:33.393178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c13a2745-9f70-47fe-93ee-47f689a9a97d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049116 Aug 24 05:12:33.393727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 495/1097] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:34.221594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b05cc562-acff-423c-b44e-8fbf3e2e96ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:34.223779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b05cc562-acff-423c-b44e-8fbf3e2e96ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:34.230975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b05cc562-acff-423c-b44e-8fbf3e2e96ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:34.231447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b05cc562-acff-423c-b44e-8fbf3e2e96ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:34.231872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b05cc562-acff-423c-b44e-8fbf3e2e96ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:34.232547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b05cc562-acff-423c-b44e-8fbf3e2e96ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:34.232983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b05cc562-acff-423c-b44e-8fbf3e2e96ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:34.233399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b05cc562-acff-423c-b44e-8fbf3e2e96ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:34.262607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b05cc562-acff-423c-b44e-8fbf3e2e96ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045021 Aug 24 05:12:34.263170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 603/1098] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:34.388148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3f371ed9-6a3e-4fd9-8481-5a83a98238d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:34.390189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3f371ed9-6a3e-4fd9-8481-5a83a98238d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:34.396569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f371ed9-6a3e-4fd9-8481-5a83a98238d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:34.397039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f371ed9-6a3e-4fd9-8481-5a83a98238d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:34.397466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f371ed9-6a3e-4fd9-8481-5a83a98238d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:34.398136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f371ed9-6a3e-4fd9-8481-5a83a98238d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:34.398584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f371ed9-6a3e-4fd9-8481-5a83a98238d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:34.399026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f371ed9-6a3e-4fd9-8481-5a83a98238d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:34.405934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3c9f6f34-3a8e-496a-8a7e-e344548d06ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:34.408104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3c9f6f34-3a8e-496a-8a7e-e344548d06ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:34.414466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9f6f34-3a8e-496a-8a7e-e344548d06ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:34.414978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9f6f34-3a8e-496a-8a7e-e344548d06ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:34.415425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9f6f34-3a8e-496a-8a7e-e344548d06ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:34.416116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9f6f34-3a8e-496a-8a7e-e344548d06ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:34.416668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9f6f34-3a8e-496a-8a7e-e344548d06ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:34.417100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9f6f34-3a8e-496a-8a7e-e344548d06ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:34.429135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3f371ed9-6a3e-4fd9-8481-5a83a98238d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 Aug 24 05:12:34.429672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 496/1099] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:34.446874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3c9f6f34-3a8e-496a-8a7e-e344548d06ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Aug 24 05:12:34.447977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 604/1100] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:34 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:35.274705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e62dbcd7-fa68-42a2-82fd-052360d96e33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:35.277086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e62dbcd7-fa68-42a2-82fd-052360d96e33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:35.283260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e62dbcd7-fa68-42a2-82fd-052360d96e33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:35.283737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e62dbcd7-fa68-42a2-82fd-052360d96e33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:35.284165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e62dbcd7-fa68-42a2-82fd-052360d96e33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:35.284855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e62dbcd7-fa68-42a2-82fd-052360d96e33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:35.285298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e62dbcd7-fa68-42a2-82fd-052360d96e33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:35.285713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e62dbcd7-fa68-42a2-82fd-052360d96e33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:35.317081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e62dbcd7-fa68-42a2-82fd-052360d96e33 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046320 Aug 24 05:12:35.317616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 497/1101] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:35.441614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-29624c90-62b3-496a-8352-930e7d03ef32 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:35.443771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-29624c90-62b3-496a-8352-930e7d03ef32 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:35.450344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29624c90-62b3-496a-8352-930e7d03ef32 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:35.450855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29624c90-62b3-496a-8352-930e7d03ef32 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:35.451286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29624c90-62b3-496a-8352-930e7d03ef32 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:35.452050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29624c90-62b3-496a-8352-930e7d03ef32 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:35.452496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29624c90-62b3-496a-8352-930e7d03ef32 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:35.452911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29624c90-62b3-496a-8352-930e7d03ef32 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:35.459506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-da5ce41d-9204-4f24-87dc-7e49e436dbcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:35.461608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-da5ce41d-9204-4f24-87dc-7e49e436dbcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:35.468740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da5ce41d-9204-4f24-87dc-7e49e436dbcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:35.469226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da5ce41d-9204-4f24-87dc-7e49e436dbcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:35.469665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da5ce41d-9204-4f24-87dc-7e49e436dbcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:35.470363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da5ce41d-9204-4f24-87dc-7e49e436dbcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:35.470845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da5ce41d-9204-4f24-87dc-7e49e436dbcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:35.471270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da5ce41d-9204-4f24-87dc-7e49e436dbcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:35.483659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-29624c90-62b3-496a-8352-930e7d03ef32 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Aug 24 05:12:35.484255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 605/1102] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:35 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:35.500866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-da5ce41d-9204-4f24-87dc-7e49e436dbcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Aug 24 05:12:35.501407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 498/1103] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:36.329354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-20535b83-8ede-4ed5-accb-7a2bf4bf9cba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:36.331480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-20535b83-8ede-4ed5-accb-7a2bf4bf9cba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:36.333330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=88 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:36.339570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20535b83-8ede-4ed5-accb-7a2bf4bf9cba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:36.340043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20535b83-8ede-4ed5-accb-7a2bf4bf9cba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:36.340468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20535b83-8ede-4ed5-accb-7a2bf4bf9cba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:36.341156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20535b83-8ede-4ed5-accb-7a2bf4bf9cba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:36.341594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20535b83-8ede-4ed5-accb-7a2bf4bf9cba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:36.342005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20535b83-8ede-4ed5-accb-7a2bf4bf9cba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:36.372137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-20535b83-8ede-4ed5-accb-7a2bf4bf9cba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046716 Aug 24 05:12:36.372678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 606/1104] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:36.496307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ae285106-a6e1-4525-aff6-976e0be683ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:36.498532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ae285106-a6e1-4525-aff6-976e0be683ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:36.505383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae285106-a6e1-4525-aff6-976e0be683ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:36.505872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae285106-a6e1-4525-aff6-976e0be683ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:36.506338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae285106-a6e1-4525-aff6-976e0be683ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:36.507065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae285106-a6e1-4525-aff6-976e0be683ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:36.507517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae285106-a6e1-4525-aff6-976e0be683ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:36.507941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae285106-a6e1-4525-aff6-976e0be683ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:36.514857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6875abb9-3429-45fa-a3ec-7a25676f8a26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:36.517057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6875abb9-3429-45fa-a3ec-7a25676f8a26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:36.524157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6875abb9-3429-45fa-a3ec-7a25676f8a26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:36.524633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6875abb9-3429-45fa-a3ec-7a25676f8a26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:36.525058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6875abb9-3429-45fa-a3ec-7a25676f8a26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:36.526571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6875abb9-3429-45fa-a3ec-7a25676f8a26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:36.527063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6875abb9-3429-45fa-a3ec-7a25676f8a26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:36.527479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6875abb9-3429-45fa-a3ec-7a25676f8a26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:36.543059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ae285106-a6e1-4525-aff6-976e0be683ef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050817 Aug 24 05:12:36.543959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 499/1105] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:36 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:36.560902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6875abb9-3429-45fa-a3ec-7a25676f8a26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051664 Aug 24 05:12:36.561458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 607/1106] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:37.384952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-29d94863-9109-476d-a44f-a83272ccbf49 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:37.387168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-29d94863-9109-476d-a44f-a83272ccbf49 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:37.393448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29d94863-9109-476d-a44f-a83272ccbf49 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:37.393932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29d94863-9109-476d-a44f-a83272ccbf49 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:37.394368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29d94863-9109-476d-a44f-a83272ccbf49 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:37.395125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29d94863-9109-476d-a44f-a83272ccbf49 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:37.395667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29d94863-9109-476d-a44f-a83272ccbf49 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:37.396090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29d94863-9109-476d-a44f-a83272ccbf49 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:37.428674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-29d94863-9109-476d-a44f-a83272ccbf49 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047768 Aug 24 05:12:37.429660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 500/1107] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:37.555626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8700d788-8d5d-49b9-aa5d-a184554076e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:37.558464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8700d788-8d5d-49b9-aa5d-a184554076e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:37.565083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8700d788-8d5d-49b9-aa5d-a184554076e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:37.565559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8700d788-8d5d-49b9-aa5d-a184554076e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:37.565988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8700d788-8d5d-49b9-aa5d-a184554076e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:37.566680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8700d788-8d5d-49b9-aa5d-a184554076e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:37.567144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8700d788-8d5d-49b9-aa5d-a184554076e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:37.567559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8700d788-8d5d-49b9-aa5d-a184554076e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:37.572953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8dfc8f8a-2471-4c5a-9539-bac934391b58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:37.575442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8dfc8f8a-2471-4c5a-9539-bac934391b58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:37.581530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dfc8f8a-2471-4c5a-9539-bac934391b58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:37.582004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dfc8f8a-2471-4c5a-9539-bac934391b58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:37.582435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dfc8f8a-2471-4c5a-9539-bac934391b58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:37.583186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dfc8f8a-2471-4c5a-9539-bac934391b58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:37.583634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dfc8f8a-2471-4c5a-9539-bac934391b58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:37.584045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dfc8f8a-2471-4c5a-9539-bac934391b58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:37.606725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8700d788-8d5d-49b9-aa5d-a184554076e9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048271 Aug 24 05:12:37.606725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 608/1108] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:37.616266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8dfc8f8a-2471-4c5a-9539-bac934391b58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048095 Aug 24 05:12:37.616821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 501/1109] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:38.444324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ee214d3b-c3f2-4229-97e6-290f6c7edc40 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:38.446438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ee214d3b-c3f2-4229-97e6-290f6c7edc40 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:38.453678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee214d3b-c3f2-4229-97e6-290f6c7edc40 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:38.454153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee214d3b-c3f2-4229-97e6-290f6c7edc40 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:38.454584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee214d3b-c3f2-4229-97e6-290f6c7edc40 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:38.455295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee214d3b-c3f2-4229-97e6-290f6c7edc40 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:38.455737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee214d3b-c3f2-4229-97e6-290f6c7edc40 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:38.456149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee214d3b-c3f2-4229-97e6-290f6c7edc40 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:38.482378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:38.487673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ee214d3b-c3f2-4229-97e6-290f6c7edc40 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047419 Aug 24 05:12:38.488239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 609/1110] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:38.613217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e025eebc-6522-486a-b326-d1f8ffb9fd91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:38.615367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e025eebc-6522-486a-b326-d1f8ffb9fd91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:38.622715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e025eebc-6522-486a-b326-d1f8ffb9fd91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:38.623204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e025eebc-6522-486a-b326-d1f8ffb9fd91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:38.623646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e025eebc-6522-486a-b326-d1f8ffb9fd91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:38.624354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e025eebc-6522-486a-b326-d1f8ffb9fd91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:38.624812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e025eebc-6522-486a-b326-d1f8ffb9fd91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:38.625234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e025eebc-6522-486a-b326-d1f8ffb9fd91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:38.629695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-644a2af8-4ed5-44db-878c-457923ae3132 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:38.631917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-644a2af8-4ed5-44db-878c-457923ae3132 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:38.639343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-644a2af8-4ed5-44db-878c-457923ae3132 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:38.639827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-644a2af8-4ed5-44db-878c-457923ae3132 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:38.640251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-644a2af8-4ed5-44db-878c-457923ae3132 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:38.640950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-644a2af8-4ed5-44db-878c-457923ae3132 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:38.641393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-644a2af8-4ed5-44db-878c-457923ae3132 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:38.641811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-644a2af8-4ed5-44db-878c-457923ae3132 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:38.644713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:38.659755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e025eebc-6522-486a-b326-d1f8ffb9fd91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050547 Aug 24 05:12:38.660330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 502/1111] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:38.675192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-644a2af8-4ed5-44db-878c-457923ae3132 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049434 Aug 24 05:12:38.676026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 610/1112] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:39.499565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c1638a35-d2c3-429a-b26e-35c8aa033fdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:39.501719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c1638a35-d2c3-429a-b26e-35c8aa033fdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:39.508041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1638a35-d2c3-429a-b26e-35c8aa033fdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:39.508520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1638a35-d2c3-429a-b26e-35c8aa033fdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:39.508958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1638a35-d2c3-429a-b26e-35c8aa033fdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:39.510385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1638a35-d2c3-429a-b26e-35c8aa033fdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:39.511058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1638a35-d2c3-429a-b26e-35c8aa033fdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:39.511456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1638a35-d2c3-429a-b26e-35c8aa033fdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:39.548157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c1638a35-d2c3-429a-b26e-35c8aa033fdb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052501 Aug 24 05:12:39.548722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 503/1113] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:39.672188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5c2d8d81-91d6-422d-9994-0c50c426213a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:39.674262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5c2d8d81-91d6-422d-9994-0c50c426213a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:39.681048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c2d8d81-91d6-422d-9994-0c50c426213a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:39.682228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c2d8d81-91d6-422d-9994-0c50c426213a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:39.682946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c2d8d81-91d6-422d-9994-0c50c426213a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:39.683653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c2d8d81-91d6-422d-9994-0c50c426213a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:39.684106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c2d8d81-91d6-422d-9994-0c50c426213a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:39.684525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c2d8d81-91d6-422d-9994-0c50c426213a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:39.688548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-61e36da8-0397-446a-bf96-cb28d2f0c0b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:39.690720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-61e36da8-0397-446a-bf96-cb28d2f0c0b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:39.697728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61e36da8-0397-446a-bf96-cb28d2f0c0b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:39.698210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61e36da8-0397-446a-bf96-cb28d2f0c0b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:39.698645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61e36da8-0397-446a-bf96-cb28d2f0c0b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:39.699365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61e36da8-0397-446a-bf96-cb28d2f0c0b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:39.699807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61e36da8-0397-446a-bf96-cb28d2f0c0b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:39.700219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61e36da8-0397-446a-bf96-cb28d2f0c0b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:39.714992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5c2d8d81-91d6-422d-9994-0c50c426213a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046744 Aug 24 05:12:39.715576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 611/1114] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:39.731361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-61e36da8-0397-446a-bf96-cb28d2f0c0b1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046700 Aug 24 05:12:39.731935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 504/1115] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:40.561550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2f760a1a-2b7b-4bec-82fd-040062b90db5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:40.563700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2f760a1a-2b7b-4bec-82fd-040062b90db5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:40.569768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f760a1a-2b7b-4bec-82fd-040062b90db5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:40.570253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f760a1a-2b7b-4bec-82fd-040062b90db5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:40.570705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f760a1a-2b7b-4bec-82fd-040062b90db5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:40.571411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f760a1a-2b7b-4bec-82fd-040062b90db5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:40.571921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f760a1a-2b7b-4bec-82fd-040062b90db5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:40.572439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f760a1a-2b7b-4bec-82fd-040062b90db5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:40.603810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2f760a1a-2b7b-4bec-82fd-040062b90db5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045680 Aug 24 05:12:40.604433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 612/1116] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:40.732710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2bc8ffbf-408d-4b29-aaad-8b24a3e547d4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:40.735073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2bc8ffbf-408d-4b29-aaad-8b24a3e547d4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:40.741884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bc8ffbf-408d-4b29-aaad-8b24a3e547d4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:40.742373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bc8ffbf-408d-4b29-aaad-8b24a3e547d4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:40.742899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bc8ffbf-408d-4b29-aaad-8b24a3e547d4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:40.743476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6da3234f-47d7-4572-883b-2839e6489e5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:40.744033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bc8ffbf-408d-4b29-aaad-8b24a3e547d4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:40.744140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bc8ffbf-408d-4b29-aaad-8b24a3e547d4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:40.744500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bc8ffbf-408d-4b29-aaad-8b24a3e547d4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:40.745949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6da3234f-47d7-4572-883b-2839e6489e5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:40.752621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da3234f-47d7-4572-883b-2839e6489e5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:40.753096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da3234f-47d7-4572-883b-2839e6489e5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:40.753525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da3234f-47d7-4572-883b-2839e6489e5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:40.754211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da3234f-47d7-4572-883b-2839e6489e5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:40.754655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da3234f-47d7-4572-883b-2839e6489e5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:40.755112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da3234f-47d7-4572-883b-2839e6489e5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:40.777622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2bc8ffbf-408d-4b29-aaad-8b24a3e547d4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049448 Aug 24 05:12:40.778190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 505/1117] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:40.786595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6da3234f-47d7-4572-883b-2839e6489e5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046973 Aug 24 05:12:40.787175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 613/1118] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:41.128966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:12:41.129222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:12:41.615482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9fd68659-4beb-476c-a2aa-a1abd46e5075 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:41.617610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9fd68659-4beb-476c-a2aa-a1abd46e5075 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:41.624611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fd68659-4beb-476c-a2aa-a1abd46e5075 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:41.625091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fd68659-4beb-476c-a2aa-a1abd46e5075 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:41.625524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fd68659-4beb-476c-a2aa-a1abd46e5075 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:41.626214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fd68659-4beb-476c-a2aa-a1abd46e5075 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:41.626661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fd68659-4beb-476c-a2aa-a1abd46e5075 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:41.627114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fd68659-4beb-476c-a2aa-a1abd46e5075 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:41.657921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9fd68659-4beb-476c-a2aa-a1abd46e5075 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 Aug 24 05:12:41.658464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 506/1119] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:41.789938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1929097a-d398-49cd-9f3b-8f414731a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:41.792794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1929097a-d398-49cd-9f3b-8f414731a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:41.799629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bd7e4a0a-edcd-44d2-9502-47a8041493f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:41.800169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1929097a-d398-49cd-9f3b-8f414731a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:41.800169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1929097a-d398-49cd-9f3b-8f414731a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:41.800881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1929097a-d398-49cd-9f3b-8f414731a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:41.801605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1929097a-d398-49cd-9f3b-8f414731a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:41.802003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bd7e4a0a-edcd-44d2-9502-47a8041493f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:41.802127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1929097a-d398-49cd-9f3b-8f414731a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:41.802452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1929097a-d398-49cd-9f3b-8f414731a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:41.810129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd7e4a0a-edcd-44d2-9502-47a8041493f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:41.810633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd7e4a0a-edcd-44d2-9502-47a8041493f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:41.811307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd7e4a0a-edcd-44d2-9502-47a8041493f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:41.812162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd7e4a0a-edcd-44d2-9502-47a8041493f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:41.812641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd7e4a0a-edcd-44d2-9502-47a8041493f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:41.813072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd7e4a0a-edcd-44d2-9502-47a8041493f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:41.835770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1929097a-d398-49cd-9f3b-8f414731a680 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049760 Aug 24 05:12:41.836339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 614/1120] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:41.843486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bd7e4a0a-edcd-44d2-9502-47a8041493f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047740 Aug 24 05:12:41.844041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 507/1121] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:41 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:42.671893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e67332f0-3d2b-47c0-bb2e-603b003f2b0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:42.674042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e67332f0-3d2b-47c0-bb2e-603b003f2b0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:42.680415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e67332f0-3d2b-47c0-bb2e-603b003f2b0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:42.680892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e67332f0-3d2b-47c0-bb2e-603b003f2b0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:42.681911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e67332f0-3d2b-47c0-bb2e-603b003f2b0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:42.682977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e67332f0-3d2b-47c0-bb2e-603b003f2b0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:42.683430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e67332f0-3d2b-47c0-bb2e-603b003f2b0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:42.683848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e67332f0-3d2b-47c0-bb2e-603b003f2b0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:42.723507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e67332f0-3d2b-47c0-bb2e-603b003f2b0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056259 Aug 24 05:12:42.727843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 615/1122] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:42.849224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1f8534a7-fd6b-4c59-819e-7435bd154cf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:42.851402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1f8534a7-fd6b-4c59-819e-7435bd154cf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:42.857318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-377204f3-ae22-46e2-b8e4-2cf5a2033c38 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:42.859800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-377204f3-ae22-46e2-b8e4-2cf5a2033c38 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:42.859933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f8534a7-fd6b-4c59-819e-7435bd154cf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:42.860469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f8534a7-fd6b-4c59-819e-7435bd154cf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:42.860935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f8534a7-fd6b-4c59-819e-7435bd154cf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:42.861646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f8534a7-fd6b-4c59-819e-7435bd154cf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:42.862103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f8534a7-fd6b-4c59-819e-7435bd154cf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:42.862529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f8534a7-fd6b-4c59-819e-7435bd154cf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:42.866325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-377204f3-ae22-46e2-b8e4-2cf5a2033c38 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:42.866834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-377204f3-ae22-46e2-b8e4-2cf5a2033c38 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:42.867260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-377204f3-ae22-46e2-b8e4-2cf5a2033c38 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:42.867945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-377204f3-ae22-46e2-b8e4-2cf5a2033c38 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:42.868384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-377204f3-ae22-46e2-b8e4-2cf5a2033c38 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:42.869604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-377204f3-ae22-46e2-b8e4-2cf5a2033c38 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:42.899689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1f8534a7-fd6b-4c59-819e-7435bd154cf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054917 Aug 24 05:12:42.900880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-377204f3-ae22-46e2-b8e4-2cf5a2033c38 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048558 Aug 24 05:12:42.901010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 508/1123] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:42.901444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 616/1124] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:43.634408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:12:43.634742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:12:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:12:43.739518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-87a70f27-9560-4494-9ccf-3bc68bf20fe2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:43.742309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-87a70f27-9560-4494-9ccf-3bc68bf20fe2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:43.749457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87a70f27-9560-4494-9ccf-3bc68bf20fe2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:43.749947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87a70f27-9560-4494-9ccf-3bc68bf20fe2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:43.750386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87a70f27-9560-4494-9ccf-3bc68bf20fe2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:43.751143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87a70f27-9560-4494-9ccf-3bc68bf20fe2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:43.751596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87a70f27-9560-4494-9ccf-3bc68bf20fe2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:43.752026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87a70f27-9560-4494-9ccf-3bc68bf20fe2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:43.783852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-87a70f27-9560-4494-9ccf-3bc68bf20fe2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050084 Aug 24 05:12:43.784387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 509/1125] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:43.912364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ab27f4e1-22ea-404e-bdf8-45d40aa4c1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:43.912908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e6025744-0337-49c7-ac1e-3f446ceee550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:43.914394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ab27f4e1-22ea-404e-bdf8-45d40aa4c1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:43.915042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e6025744-0337-49c7-ac1e-3f446ceee550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:43.921827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab27f4e1-22ea-404e-bdf8-45d40aa4c1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:43.922302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab27f4e1-22ea-404e-bdf8-45d40aa4c1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:43.922562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6025744-0337-49c7-ac1e-3f446ceee550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:43.922812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab27f4e1-22ea-404e-bdf8-45d40aa4c1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:43.923094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6025744-0337-49c7-ac1e-3f446ceee550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:43.923424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab27f4e1-22ea-404e-bdf8-45d40aa4c1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:43.923581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6025744-0337-49c7-ac1e-3f446ceee550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:43.923866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab27f4e1-22ea-404e-bdf8-45d40aa4c1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:43.924219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6025744-0337-49c7-ac1e-3f446ceee550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:43.924422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab27f4e1-22ea-404e-bdf8-45d40aa4c1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:43.924668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6025744-0337-49c7-ac1e-3f446ceee550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:43.925090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6025744-0337-49c7-ac1e-3f446ceee550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:43.958019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e6025744-0337-49c7-ac1e-3f446ceee550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049034 Aug 24 05:12:43.958608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 510/1126] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:43.959867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ab27f4e1-22ea-404e-bdf8-45d40aa4c1c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051481 Aug 24 05:12:43.960469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 617/1127] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:43 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:44.796405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5fa70f57-aade-45bc-be57-fa5a732d73b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:44.798547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5fa70f57-aade-45bc-be57-fa5a732d73b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:44.804784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fa70f57-aade-45bc-be57-fa5a732d73b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:44.805264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fa70f57-aade-45bc-be57-fa5a732d73b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:44.805694 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fa70f57-aade-45bc-be57-fa5a732d73b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:44.806482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fa70f57-aade-45bc-be57-fa5a732d73b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:44.807343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fa70f57-aade-45bc-be57-fa5a732d73b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:44.807781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5fa70f57-aade-45bc-be57-fa5a732d73b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:44.840088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5fa70f57-aade-45bc-be57-fa5a732d73b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047565 Aug 24 05:12:44.840673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 511/1128] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:44.970661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e0cd74fc-56b4-4ca3-a544-ae5126025196 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:44.972665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ff0589d1-aa38-4bdd-8fe4-85a47b979acd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:44.973053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e0cd74fc-56b4-4ca3-a544-ae5126025196 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:44.974932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ff0589d1-aa38-4bdd-8fe4-85a47b979acd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:44.979996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cd74fc-56b4-4ca3-a544-ae5126025196 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:44.980462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cd74fc-56b4-4ca3-a544-ae5126025196 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:44.980886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cd74fc-56b4-4ca3-a544-ae5126025196 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:44.981544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff0589d1-aa38-4bdd-8fe4-85a47b979acd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:44.981661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cd74fc-56b4-4ca3-a544-ae5126025196 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:44.981987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cd74fc-56b4-4ca3-a544-ae5126025196 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:44.982095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff0589d1-aa38-4bdd-8fe4-85a47b979acd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:44.982395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cd74fc-56b4-4ca3-a544-ae5126025196 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:44.982497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff0589d1-aa38-4bdd-8fe4-85a47b979acd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:44.983152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff0589d1-aa38-4bdd-8fe4-85a47b979acd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:44.983606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff0589d1-aa38-4bdd-8fe4-85a47b979acd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:44.984032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff0589d1-aa38-4bdd-8fe4-85a47b979acd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:45.011934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e0cd74fc-56b4-4ca3-a544-ae5126025196 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045227 Aug 24 05:12:45.012484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 618/1129] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:45.013759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ff0589d1-aa38-4bdd-8fe4-85a47b979acd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Aug 24 05:12:45.014310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 512/1130] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:45.852737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b072b42e-e430-4ba3-91a2-26ff6462db28 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:45.855425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b072b42e-e430-4ba3-91a2-26ff6462db28 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:45.861623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b072b42e-e430-4ba3-91a2-26ff6462db28 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:45.862099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b072b42e-e430-4ba3-91a2-26ff6462db28 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:45.862533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b072b42e-e430-4ba3-91a2-26ff6462db28 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:45.863259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b072b42e-e430-4ba3-91a2-26ff6462db28 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:45.863816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b072b42e-e430-4ba3-91a2-26ff6462db28 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:45.864276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b072b42e-e430-4ba3-91a2-26ff6462db28 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:45.895429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b072b42e-e430-4ba3-91a2-26ff6462db28 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046729 Aug 24 05:12:45.895993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 619/1131] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:46.024538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-87bc8b8e-dcd5-44f0-8b39-d006653f26c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:46.025825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dfce6b08-c6cd-4992-abd0-031fc3b3e12a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:46.027260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-87bc8b8e-dcd5-44f0-8b39-d006653f26c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:46.028058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dfce6b08-c6cd-4992-abd0-031fc3b3e12a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:46.034110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87bc8b8e-dcd5-44f0-8b39-d006653f26c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:46.034590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87bc8b8e-dcd5-44f0-8b39-d006653f26c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:46.034761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfce6b08-c6cd-4992-abd0-031fc3b3e12a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:46.035047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87bc8b8e-dcd5-44f0-8b39-d006653f26c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:46.035163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfce6b08-c6cd-4992-abd0-031fc3b3e12a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:46.035585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfce6b08-c6cd-4992-abd0-031fc3b3e12a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:46.035741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87bc8b8e-dcd5-44f0-8b39-d006653f26c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:46.036187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87bc8b8e-dcd5-44f0-8b39-d006653f26c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:46.036294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfce6b08-c6cd-4992-abd0-031fc3b3e12a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:46.036602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87bc8b8e-dcd5-44f0-8b39-d006653f26c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:46.036702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfce6b08-c6cd-4992-abd0-031fc3b3e12a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:46.037122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfce6b08-c6cd-4992-abd0-031fc3b3e12a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:46.068819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-87bc8b8e-dcd5-44f0-8b39-d006653f26c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048268 Aug 24 05:12:46.069066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dfce6b08-c6cd-4992-abd0-031fc3b3e12a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047409 Aug 24 05:12:46.069390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 513/1133] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:46.069566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 620/1133] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:46.908797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fd822224-3e35-4adc-8bc9-3d059a873a22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:46.910987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fd822224-3e35-4adc-8bc9-3d059a873a22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:46.917769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd822224-3e35-4adc-8bc9-3d059a873a22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:46.918324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd822224-3e35-4adc-8bc9-3d059a873a22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:46.918813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd822224-3e35-4adc-8bc9-3d059a873a22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:46.919500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd822224-3e35-4adc-8bc9-3d059a873a22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:46.919965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd822224-3e35-4adc-8bc9-3d059a873a22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:46.920374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd822224-3e35-4adc-8bc9-3d059a873a22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:46.954627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fd822224-3e35-4adc-8bc9-3d059a873a22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050045 Aug 24 05:12:46.955234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 621/1134] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:47.081714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e7ad5d5b-3bc2-4a17-857b-b0f2e35d71b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:47.082369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cfb9b1f6-7e53-4674-a8da-06e7a9b5fe50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:47.083833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cfb9b1f6-7e53-4674-a8da-06e7a9b5fe50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:47.084007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e7ad5d5b-3bc2-4a17-857b-b0f2e35d71b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:47.090933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb9b1f6-7e53-4674-a8da-06e7a9b5fe50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:47.091247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7ad5d5b-3bc2-4a17-857b-b0f2e35d71b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:47.091398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb9b1f6-7e53-4674-a8da-06e7a9b5fe50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:47.091741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7ad5d5b-3bc2-4a17-857b-b0f2e35d71b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:47.091921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb9b1f6-7e53-4674-a8da-06e7a9b5fe50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:47.092189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7ad5d5b-3bc2-4a17-857b-b0f2e35d71b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:47.092509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb9b1f6-7e53-4674-a8da-06e7a9b5fe50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:47.092887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7ad5d5b-3bc2-4a17-857b-b0f2e35d71b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:47.093026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb9b1f6-7e53-4674-a8da-06e7a9b5fe50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:47.093340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7ad5d5b-3bc2-4a17-857b-b0f2e35d71b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:47.093477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb9b1f6-7e53-4674-a8da-06e7a9b5fe50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:47.093767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7ad5d5b-3bc2-4a17-857b-b0f2e35d71b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:47.138527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e7ad5d5b-3bc2-4a17-857b-b0f2e35d71b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060884 Aug 24 05:12:47.138982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cfb9b1f6-7e53-4674-a8da-06e7a9b5fe50 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061064 Aug 24 05:12:47.142937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 514/1135] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:47.143111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 622/1136] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:47.966330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-913b9bf0-786e-45df-9037-27308bc19685 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:47.968668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-913b9bf0-786e-45df-9037-27308bc19685 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:47.974703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-913b9bf0-786e-45df-9037-27308bc19685 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:47.975204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-913b9bf0-786e-45df-9037-27308bc19685 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:47.975647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-913b9bf0-786e-45df-9037-27308bc19685 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:47.976350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-913b9bf0-786e-45df-9037-27308bc19685 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:47.976805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-913b9bf0-786e-45df-9037-27308bc19685 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:47.977227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-913b9bf0-786e-45df-9037-27308bc19685 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:48.010706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-913b9bf0-786e-45df-9037-27308bc19685 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048127 Aug 24 05:12:48.011195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 515/1137] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:48.151641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c2ff4f9e-11f9-4791-a396-5258411ac9e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:48.152232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cd69160b-8980-4dd6-97db-6231598233da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:48.153766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c2ff4f9e-11f9-4791-a396-5258411ac9e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:48.154244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cd69160b-8980-4dd6-97db-6231598233da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:48.160460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ff4f9e-11f9-4791-a396-5258411ac9e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:48.160646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd69160b-8980-4dd6-97db-6231598233da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:48.160938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ff4f9e-11f9-4791-a396-5258411ac9e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:48.161087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd69160b-8980-4dd6-97db-6231598233da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:48.161368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ff4f9e-11f9-4791-a396-5258411ac9e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:48.161518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd69160b-8980-4dd6-97db-6231598233da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:48.162055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ff4f9e-11f9-4791-a396-5258411ac9e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:48.162198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd69160b-8980-4dd6-97db-6231598233da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:48.162500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ff4f9e-11f9-4791-a396-5258411ac9e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:48.162642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd69160b-8980-4dd6-97db-6231598233da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:48.163017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2ff4f9e-11f9-4791-a396-5258411ac9e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:48.163118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd69160b-8980-4dd6-97db-6231598233da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:48.195099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c2ff4f9e-11f9-4791-a396-5258411ac9e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047891 Aug 24 05:12:48.195364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cd69160b-8980-4dd6-97db-6231598233da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047719 Aug 24 05:12:48.195668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 623/1138] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:48.195799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 516/1139] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:48.684145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:12:48.684368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:12:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:12:49.022940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-86c58b67-9af7-445b-b006-a527572daeb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:49.025049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-86c58b67-9af7-445b-b006-a527572daeb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:49.031197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86c58b67-9af7-445b-b006-a527572daeb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:49.031674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86c58b67-9af7-445b-b006-a527572daeb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:49.032108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86c58b67-9af7-445b-b006-a527572daeb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:49.032801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86c58b67-9af7-445b-b006-a527572daeb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:49.033251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86c58b67-9af7-445b-b006-a527572daeb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:49.033675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-86c58b67-9af7-445b-b006-a527572daeb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:49.070372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-86c58b67-9af7-445b-b006-a527572daeb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051415 Aug 24 05:12:49.071885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 624/1140] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:49.208264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9011eea2-b863-41ba-82d2-649838430b0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:49.208909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ed2faa21-95ce-4258-8b5b-2a1ec070bd39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:49.210393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ed2faa21-95ce-4258-8b5b-2a1ec070bd39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:49.210497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9011eea2-b863-41ba-82d2-649838430b0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:49.216906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed2faa21-95ce-4258-8b5b-2a1ec070bd39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:49.217126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9011eea2-b863-41ba-82d2-649838430b0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:49.217392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed2faa21-95ce-4258-8b5b-2a1ec070bd39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:49.217579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9011eea2-b863-41ba-82d2-649838430b0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:49.217832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed2faa21-95ce-4258-8b5b-2a1ec070bd39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:49.218007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9011eea2-b863-41ba-82d2-649838430b0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:49.218531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed2faa21-95ce-4258-8b5b-2a1ec070bd39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:49.218709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9011eea2-b863-41ba-82d2-649838430b0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:49.219021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed2faa21-95ce-4258-8b5b-2a1ec070bd39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:49.219298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9011eea2-b863-41ba-82d2-649838430b0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:49.219457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ed2faa21-95ce-4258-8b5b-2a1ec070bd39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:49.219590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9011eea2-b863-41ba-82d2-649838430b0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:49.250858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9011eea2-b863-41ba-82d2-649838430b0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046488 Aug 24 05:12:49.251112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ed2faa21-95ce-4258-8b5b-2a1ec070bd39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046759 Aug 24 05:12:49.251420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 625/1141] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:49.251634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 517/1142] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:50.082612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6730393d-5541-4a0e-830d-6d07c757a61f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:50.084700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6730393d-5541-4a0e-830d-6d07c757a61f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:50.090713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6730393d-5541-4a0e-830d-6d07c757a61f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:50.091191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6730393d-5541-4a0e-830d-6d07c757a61f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:50.091616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6730393d-5541-4a0e-830d-6d07c757a61f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:50.092286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6730393d-5541-4a0e-830d-6d07c757a61f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:50.092730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6730393d-5541-4a0e-830d-6d07c757a61f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:50.093141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6730393d-5541-4a0e-830d-6d07c757a61f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:50.110190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:50.124004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6730393d-5541-4a0e-830d-6d07c757a61f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045431 Aug 24 05:12:50.124551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 626/1143] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:50.262979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-faaee97d-f966-48be-8f8f-3417d2d56b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:50.263605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-68bd1ed9-dcd9-436f-b259-08a903a9495b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:50.265169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-faaee97d-f966-48be-8f8f-3417d2d56b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:50.265289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-68bd1ed9-dcd9-436f-b259-08a903a9495b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:50.271540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-faaee97d-f966-48be-8f8f-3417d2d56b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:50.271697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68bd1ed9-dcd9-436f-b259-08a903a9495b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:50.272015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-faaee97d-f966-48be-8f8f-3417d2d56b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:50.272209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68bd1ed9-dcd9-436f-b259-08a903a9495b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:50.272450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68bd1ed9-dcd9-436f-b259-08a903a9495b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:50.272570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-faaee97d-f966-48be-8f8f-3417d2d56b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:50.273126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68bd1ed9-dcd9-436f-b259-08a903a9495b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:50.273251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-faaee97d-f966-48be-8f8f-3417d2d56b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:50.273566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-faaee97d-f966-48be-8f8f-3417d2d56b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:50.273680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68bd1ed9-dcd9-436f-b259-08a903a9495b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:50.273980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68bd1ed9-dcd9-436f-b259-08a903a9495b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:50.274079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-faaee97d-f966-48be-8f8f-3417d2d56b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:50.303857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-68bd1ed9-dcd9-436f-b259-08a903a9495b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Aug 24 05:12:50.304424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 518/1144] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:50.304587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-faaee97d-f966-48be-8f8f-3417d2d56b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045372 Aug 24 05:12:50.304984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 627/1145] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:51.137157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3ce1e606-9664-4c01-9147-e3eede67792b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:51.139724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3ce1e606-9664-4c01-9147-e3eede67792b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:51.145791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ce1e606-9664-4c01-9147-e3eede67792b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:51.146266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ce1e606-9664-4c01-9147-e3eede67792b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:51.146709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ce1e606-9664-4c01-9147-e3eede67792b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:51.147402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ce1e606-9664-4c01-9147-e3eede67792b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:51.147864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ce1e606-9664-4c01-9147-e3eede67792b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:51.148261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ce1e606-9664-4c01-9147-e3eede67792b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:51.152343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:51.178911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3ce1e606-9664-4c01-9147-e3eede67792b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046407 Aug 24 05:12:51.179462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 519/1146] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:51.317365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fef13a78-afcf-4e17-9064-fa2783fb56bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:51.317921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5b6497d5-1f65-43e4-8f1a-166e2f26aedf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:51.319440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fef13a78-afcf-4e17-9064-fa2783fb56bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:51.319575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5b6497d5-1f65-43e4-8f1a-166e2f26aedf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:51.326823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fef13a78-afcf-4e17-9064-fa2783fb56bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:51.327078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b6497d5-1f65-43e4-8f1a-166e2f26aedf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:51.327309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fef13a78-afcf-4e17-9064-fa2783fb56bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:51.327491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b6497d5-1f65-43e4-8f1a-166e2f26aedf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:51.327747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fef13a78-afcf-4e17-9064-fa2783fb56bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:51.327907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b6497d5-1f65-43e4-8f1a-166e2f26aedf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:51.328446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fef13a78-afcf-4e17-9064-fa2783fb56bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:51.328598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b6497d5-1f65-43e4-8f1a-166e2f26aedf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:51.328883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fef13a78-afcf-4e17-9064-fa2783fb56bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:51.329036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b6497d5-1f65-43e4-8f1a-166e2f26aedf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:51.329316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fef13a78-afcf-4e17-9064-fa2783fb56bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:51.329432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b6497d5-1f65-43e4-8f1a-166e2f26aedf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:51.359370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fef13a78-afcf-4e17-9064-fa2783fb56bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046006 Aug 24 05:12:51.359645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5b6497d5-1f65-43e4-8f1a-166e2f26aedf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045961 Aug 24 05:12:51.359936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 520/1148] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:51.360108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 628/1148] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:52.192119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ee85f04b-0932-4bd5-8bff-80e616eb07aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:52.194270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ee85f04b-0932-4bd5-8bff-80e616eb07aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:52.200925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee85f04b-0932-4bd5-8bff-80e616eb07aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:52.201404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee85f04b-0932-4bd5-8bff-80e616eb07aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:52.201836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee85f04b-0932-4bd5-8bff-80e616eb07aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:52.202534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee85f04b-0932-4bd5-8bff-80e616eb07aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:52.203151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee85f04b-0932-4bd5-8bff-80e616eb07aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:52.203575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee85f04b-0932-4bd5-8bff-80e616eb07aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:52.234116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ee85f04b-0932-4bd5-8bff-80e616eb07aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Aug 24 05:12:52.234661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 521/1149] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:52.371800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b61040c5-77a3-44c0-be23-e5da277742e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:52.372622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-04fa9257-a93e-4a24-b55e-0e959aa16778 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:52.373988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b61040c5-77a3-44c0-be23-e5da277742e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:52.374168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-04fa9257-a93e-4a24-b55e-0e959aa16778 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:52.380784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b61040c5-77a3-44c0-be23-e5da277742e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:52.381003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04fa9257-a93e-4a24-b55e-0e959aa16778 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:52.381256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b61040c5-77a3-44c0-be23-e5da277742e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:52.381368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04fa9257-a93e-4a24-b55e-0e959aa16778 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:52.381681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b61040c5-77a3-44c0-be23-e5da277742e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:52.381788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04fa9257-a93e-4a24-b55e-0e959aa16778 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:52.382365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b61040c5-77a3-44c0-be23-e5da277742e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:52.382465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04fa9257-a93e-4a24-b55e-0e959aa16778 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:52.382833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b61040c5-77a3-44c0-be23-e5da277742e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:52.382945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04fa9257-a93e-4a24-b55e-0e959aa16778 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:52.383250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b61040c5-77a3-44c0-be23-e5da277742e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:52.383357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04fa9257-a93e-4a24-b55e-0e959aa16778 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:52.413978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b61040c5-77a3-44c0-be23-e5da277742e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046191 Aug 24 05:12:52.414248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-04fa9257-a93e-4a24-b55e-0e959aa16778 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046430 Aug 24 05:12:52.414535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 629/1150] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:52.414918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 522/1151] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:53.246374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f5730558-2877-4198-8357-2496229546de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:53.248578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f5730558-2877-4198-8357-2496229546de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:53.254933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5730558-2877-4198-8357-2496229546de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:53.255422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5730558-2877-4198-8357-2496229546de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:53.255857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5730558-2877-4198-8357-2496229546de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:53.256584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5730558-2877-4198-8357-2496229546de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:53.257154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5730558-2877-4198-8357-2496229546de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:53.257578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5730558-2877-4198-8357-2496229546de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:53.290365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f5730558-2877-4198-8357-2496229546de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047958 Aug 24 05:12:53.290954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 630/1152] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:53.426944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fb16d4ec-84ad-4b3c-a30a-16f63b238b64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:53.427588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2208d8fd-3114-4237-a1bc-1c4fd7555ee8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:53.428972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2208d8fd-3114-4237-a1bc-1c4fd7555ee8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:53.429091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fb16d4ec-84ad-4b3c-a30a-16f63b238b64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:53.436757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2208d8fd-3114-4237-a1bc-1c4fd7555ee8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:53.437000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb16d4ec-84ad-4b3c-a30a-16f63b238b64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:53.437244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2208d8fd-3114-4237-a1bc-1c4fd7555ee8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:53.437359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb16d4ec-84ad-4b3c-a30a-16f63b238b64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:53.437796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2208d8fd-3114-4237-a1bc-1c4fd7555ee8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:53.437926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb16d4ec-84ad-4b3c-a30a-16f63b238b64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:53.438367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb16d4ec-84ad-4b3c-a30a-16f63b238b64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:53.438467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2208d8fd-3114-4237-a1bc-1c4fd7555ee8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:53.438837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb16d4ec-84ad-4b3c-a30a-16f63b238b64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:53.438953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2208d8fd-3114-4237-a1bc-1c4fd7555ee8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:53.439252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb16d4ec-84ad-4b3c-a30a-16f63b238b64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:53.439352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2208d8fd-3114-4237-a1bc-1c4fd7555ee8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:53.471202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fb16d4ec-84ad-4b3c-a30a-16f63b238b64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048435 Aug 24 05:12:53.471466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2208d8fd-3114-4237-a1bc-1c4fd7555ee8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048641 Aug 24 05:12:53.471965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 631/1153] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:53.472096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 523/1154] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:54.303331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7b1fa2bb-8f39-4b73-a1b7-4d146d31241f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:54.305712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7b1fa2bb-8f39-4b73-a1b7-4d146d31241f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:54.312820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1fa2bb-8f39-4b73-a1b7-4d146d31241f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:54.313301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1fa2bb-8f39-4b73-a1b7-4d146d31241f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:54.313733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1fa2bb-8f39-4b73-a1b7-4d146d31241f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:54.314428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1fa2bb-8f39-4b73-a1b7-4d146d31241f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:54.314912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1fa2bb-8f39-4b73-a1b7-4d146d31241f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:54.315336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b1fa2bb-8f39-4b73-a1b7-4d146d31241f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:54.346069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7b1fa2bb-8f39-4b73-a1b7-4d146d31241f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Aug 24 05:12:54.346644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 632/1155] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:54.484279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0166e4c8-87d4-479d-a844-3e214b1813eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:54.484877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cc65b316-d131-4fb3-b457-f4a615179b26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:54.486413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cc65b316-d131-4fb3-b457-f4a615179b26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:54.486567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0166e4c8-87d4-479d-a844-3e214b1813eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:54.493005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0166e4c8-87d4-479d-a844-3e214b1813eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:54.493199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc65b316-d131-4fb3-b457-f4a615179b26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:54.493482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc65b316-d131-4fb3-b457-f4a615179b26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:54.493604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0166e4c8-87d4-479d-a844-3e214b1813eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:54.493916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc65b316-d131-4fb3-b457-f4a615179b26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:54.494045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0166e4c8-87d4-479d-a844-3e214b1813eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:54.494613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc65b316-d131-4fb3-b457-f4a615179b26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:54.494747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0166e4c8-87d4-479d-a844-3e214b1813eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:54.495772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc65b316-d131-4fb3-b457-f4a615179b26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:54.496034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0166e4c8-87d4-479d-a844-3e214b1813eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:54.496146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc65b316-d131-4fb3-b457-f4a615179b26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:54.496247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0166e4c8-87d4-479d-a844-3e214b1813eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:54.526492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cc65b316-d131-4fb3-b457-f4a615179b26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046716 Aug 24 05:12:54.526816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0166e4c8-87d4-479d-a844-3e214b1813eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047084 Aug 24 05:12:54.527096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 633/1156] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:54.527553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 524/1157] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:55.358841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2ebd734f-7bca-4af5-95d0-48f84fe2a928 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:55.361164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2ebd734f-7bca-4af5-95d0-48f84fe2a928 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:55.367398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ebd734f-7bca-4af5-95d0-48f84fe2a928 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:55.367872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ebd734f-7bca-4af5-95d0-48f84fe2a928 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:55.368298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ebd734f-7bca-4af5-95d0-48f84fe2a928 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:55.368986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ebd734f-7bca-4af5-95d0-48f84fe2a928 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:55.373335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ebd734f-7bca-4af5-95d0-48f84fe2a928 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:55.373335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ebd734f-7bca-4af5-95d0-48f84fe2a928 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:55.403779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2ebd734f-7bca-4af5-95d0-48f84fe2a928 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049059 Aug 24 05:12:55.404333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 634/1158] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:55.538994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fecb0acd-5f34-4f8a-a613-575469c47bd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:55.539552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a4d64224-9bbd-4ea2-a7cd-d2ef92a84e8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:55.541046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fecb0acd-5f34-4f8a-a613-575469c47bd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:55.541194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a4d64224-9bbd-4ea2-a7cd-d2ef92a84e8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:55.548001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fecb0acd-5f34-4f8a-a613-575469c47bd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:55.548462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4d64224-9bbd-4ea2-a7cd-d2ef92a84e8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:55.548604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fecb0acd-5f34-4f8a-a613-575469c47bd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:55.548919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fecb0acd-5f34-4f8a-a613-575469c47bd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:55.549033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4d64224-9bbd-4ea2-a7cd-d2ef92a84e8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:55.549364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4d64224-9bbd-4ea2-a7cd-d2ef92a84e8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:55.549623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fecb0acd-5f34-4f8a-a613-575469c47bd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:55.550222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4d64224-9bbd-4ea2-a7cd-d2ef92a84e8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:55.550337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fecb0acd-5f34-4f8a-a613-575469c47bd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:55.550491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fecb0acd-5f34-4f8a-a613-575469c47bd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:55.550589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4d64224-9bbd-4ea2-a7cd-d2ef92a84e8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:55.551211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4d64224-9bbd-4ea2-a7cd-d2ef92a84e8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:55.583035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a4d64224-9bbd-4ea2-a7cd-d2ef92a84e8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047907 Aug 24 05:12:55.583363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fecb0acd-5f34-4f8a-a613-575469c47bd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048162 Aug 24 05:12:55.583931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 635/1159] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:55 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:55.584113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 525/1160] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:56.415402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-761a6957-88d0-4e11-a7fd-e36804093109 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:56.417516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-761a6957-88d0-4e11-a7fd-e36804093109 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:56.423782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-761a6957-88d0-4e11-a7fd-e36804093109 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:56.424255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-761a6957-88d0-4e11-a7fd-e36804093109 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:56.424683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-761a6957-88d0-4e11-a7fd-e36804093109 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:56.425364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-761a6957-88d0-4e11-a7fd-e36804093109 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:56.426072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-761a6957-88d0-4e11-a7fd-e36804093109 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:56.426483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-761a6957-88d0-4e11-a7fd-e36804093109 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:56.457353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-761a6957-88d0-4e11-a7fd-e36804093109 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045932 Aug 24 05:12:56.457891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 636/1161] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:56.598846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-af0bb1a5-7b0b-4c60-b324-37950a5ae452 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:56.599320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-63afc674-7234-4147-94a6-18221968367d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:56.601878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-af0bb1a5-7b0b-4c60-b324-37950a5ae452 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:56.602319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-63afc674-7234-4147-94a6-18221968367d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:56.612172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af0bb1a5-7b0b-4c60-b324-37950a5ae452 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:56.612730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63afc674-7234-4147-94a6-18221968367d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:56.612933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af0bb1a5-7b0b-4c60-b324-37950a5ae452 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:56.613505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63afc674-7234-4147-94a6-18221968367d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:56.613646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af0bb1a5-7b0b-4c60-b324-37950a5ae452 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:56.614196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63afc674-7234-4147-94a6-18221968367d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:56.614711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af0bb1a5-7b0b-4c60-b324-37950a5ae452 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:56.615339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63afc674-7234-4147-94a6-18221968367d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:56.615467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af0bb1a5-7b0b-4c60-b324-37950a5ae452 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:56.616079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af0bb1a5-7b0b-4c60-b324-37950a5ae452 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:56.616188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63afc674-7234-4147-94a6-18221968367d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:56.616750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63afc674-7234-4147-94a6-18221968367d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:56.666539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-63afc674-7234-4147-94a6-18221968367d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074352 Aug 24 05:12:56.667458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-af0bb1a5-7b0b-4c60-b324-37950a5ae452 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074284 Aug 24 05:12:56.668286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 637/1163] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:56.668439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 526/1163] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:57.470292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dbf51383-41f6-4774-913b-d81ce20b4b7c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:57.472464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dbf51383-41f6-4774-913b-d81ce20b4b7c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:57.478483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbf51383-41f6-4774-913b-d81ce20b4b7c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:57.478992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbf51383-41f6-4774-913b-d81ce20b4b7c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:57.479987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbf51383-41f6-4774-913b-d81ce20b4b7c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:57.480681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbf51383-41f6-4774-913b-d81ce20b4b7c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:57.481135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbf51383-41f6-4774-913b-d81ce20b4b7c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:57.481553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbf51383-41f6-4774-913b-d81ce20b4b7c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:57.511230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dbf51383-41f6-4774-913b-d81ce20b4b7c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Aug 24 05:12:57.511780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 527/1164] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:57.680345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c31eaf2c-fe5f-4098-9202-1edda94aa6ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:57.680865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d9f19f44-e484-480e-aa2a-1d567c9b0d5e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:57.683190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c31eaf2c-fe5f-4098-9202-1edda94aa6ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:57.683329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d9f19f44-e484-480e-aa2a-1d567c9b0d5e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:57.689724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9f19f44-e484-480e-aa2a-1d567c9b0d5e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:57.689935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c31eaf2c-fe5f-4098-9202-1edda94aa6ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:57.690200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c31eaf2c-fe5f-4098-9202-1edda94aa6ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:57.690317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9f19f44-e484-480e-aa2a-1d567c9b0d5e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:57.690630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c31eaf2c-fe5f-4098-9202-1edda94aa6ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:57.690767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9f19f44-e484-480e-aa2a-1d567c9b0d5e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:57.691366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9f19f44-e484-480e-aa2a-1d567c9b0d5e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:57.691463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c31eaf2c-fe5f-4098-9202-1edda94aa6ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:57.691811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c31eaf2c-fe5f-4098-9202-1edda94aa6ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:57.691930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9f19f44-e484-480e-aa2a-1d567c9b0d5e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:57.692226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c31eaf2c-fe5f-4098-9202-1edda94aa6ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:57.692327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9f19f44-e484-480e-aa2a-1d567c9b0d5e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:57.723531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d9f19f44-e484-480e-aa2a-1d567c9b0d5e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 Aug 24 05:12:57.724097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 528/1165] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:57.728348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c31eaf2c-fe5f-4098-9202-1edda94aa6ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052223 Aug 24 05:12:57.728907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 638/1166] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:58.523698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-78c5ae5f-0544-412f-906c-a347e8021b97 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:58.525837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-78c5ae5f-0544-412f-906c-a347e8021b97 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:58.532433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c5ae5f-0544-412f-906c-a347e8021b97 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:58.532905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c5ae5f-0544-412f-906c-a347e8021b97 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:58.533337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c5ae5f-0544-412f-906c-a347e8021b97 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:58.534019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c5ae5f-0544-412f-906c-a347e8021b97 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:58.534463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c5ae5f-0544-412f-906c-a347e8021b97 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:58.534908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c5ae5f-0544-412f-906c-a347e8021b97 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:58.564931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-78c5ae5f-0544-412f-906c-a347e8021b97 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045186 Aug 24 05:12:58.565499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 529/1167] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:58.736851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1bd5a625-ac9b-4902-9056-471c2ed3c0ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:58.739848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1bd5a625-ac9b-4902-9056-471c2ed3c0ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:58.741246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-29e802a9-706f-4707-9567-02a1df576cb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:58.743702 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-29e802a9-706f-4707-9567-02a1df576cb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:58.747080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bd5a625-ac9b-4902-9056-471c2ed3c0ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:58.747561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bd5a625-ac9b-4902-9056-471c2ed3c0ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:58.747994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bd5a625-ac9b-4902-9056-471c2ed3c0ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:58.748695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bd5a625-ac9b-4902-9056-471c2ed3c0ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:58.749150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bd5a625-ac9b-4902-9056-471c2ed3c0ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:58.749695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bd5a625-ac9b-4902-9056-471c2ed3c0ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:58.750785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29e802a9-706f-4707-9567-02a1df576cb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:58.751274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29e802a9-706f-4707-9567-02a1df576cb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:58.751731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29e802a9-706f-4707-9567-02a1df576cb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:58.752405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29e802a9-706f-4707-9567-02a1df576cb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:58.752860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29e802a9-706f-4707-9567-02a1df576cb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:58.754548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29e802a9-706f-4707-9567-02a1df576cb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:58.784162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1bd5a625-ac9b-4902-9056-471c2ed3c0ac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051176 Aug 24 05:12:58.786780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-29e802a9-706f-4707-9567-02a1df576cb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049660 Aug 24 05:12:58.787211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 639/1168] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:58.791011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 530/1169] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:12:59.576388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bf3081a0-b335-4d03-af5d-6a5f205b8931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:59.578623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bf3081a0-b335-4d03-af5d-6a5f205b8931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:59.584760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf3081a0-b335-4d03-af5d-6a5f205b8931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:59.585235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf3081a0-b335-4d03-af5d-6a5f205b8931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:59.585675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf3081a0-b335-4d03-af5d-6a5f205b8931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:59.587444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf3081a0-b335-4d03-af5d-6a5f205b8931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:59.587924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf3081a0-b335-4d03-af5d-6a5f205b8931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:59.588363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf3081a0-b335-4d03-af5d-6a5f205b8931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:59.619500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bf3081a0-b335-4d03-af5d-6a5f205b8931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047115 Aug 24 05:12:59.620084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 640/1170] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:59.799214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c0fdb1a0-5c85-443c-a561-3fa2a38a1332 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:59.800235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4f96067f-b485-4e91-9f39-2eda02ad334f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:12:59.801639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c0fdb1a0-5c85-443c-a561-3fa2a38a1332 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:59.801839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4f96067f-b485-4e91-9f39-2eda02ad334f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:12:59.808268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0fdb1a0-5c85-443c-a561-3fa2a38a1332 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:59.808515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f96067f-b485-4e91-9f39-2eda02ad334f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:59.808830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f96067f-b485-4e91-9f39-2eda02ad334f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:59.808977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0fdb1a0-5c85-443c-a561-3fa2a38a1332 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:59.809295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f96067f-b485-4e91-9f39-2eda02ad334f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:59.809424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0fdb1a0-5c85-443c-a561-3fa2a38a1332 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:59.810033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f96067f-b485-4e91-9f39-2eda02ad334f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:59.810133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0fdb1a0-5c85-443c-a561-3fa2a38a1332 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:12:59.810481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0fdb1a0-5c85-443c-a561-3fa2a38a1332 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:59.810599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f96067f-b485-4e91-9f39-2eda02ad334f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:12:59.811001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f96067f-b485-4e91-9f39-2eda02ad334f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:59.811706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0fdb1a0-5c85-443c-a561-3fa2a38a1332 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:12:59.843281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4f96067f-b485-4e91-9f39-2eda02ad334f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047840 Aug 24 05:12:59.843546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c0fdb1a0-5c85-443c-a561-3fa2a38a1332 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048196 Aug 24 05:12:59.843858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 531/1171] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:59 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:12:59.844102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 641/1172] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:12:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:00.632589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0bd3a911-4e2c-43c4-bb3f-0d1652fa3659 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:00.634785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0bd3a911-4e2c-43c4-bb3f-0d1652fa3659 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:00.641008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bd3a911-4e2c-43c4-bb3f-0d1652fa3659 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:00.641487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bd3a911-4e2c-43c4-bb3f-0d1652fa3659 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:00.641919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bd3a911-4e2c-43c4-bb3f-0d1652fa3659 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:00.642609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bd3a911-4e2c-43c4-bb3f-0d1652fa3659 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:00.643089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bd3a911-4e2c-43c4-bb3f-0d1652fa3659 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:00.643511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bd3a911-4e2c-43c4-bb3f-0d1652fa3659 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:00.674482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0bd3a911-4e2c-43c4-bb3f-0d1652fa3659 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046328 Aug 24 05:13:00.675073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 532/1173] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:00.856136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-94785cfd-2385-48bf-9f80-3cceb2f2976a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:00.856744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-90791b4b-10da-40a2-a2df-483ac8863d98 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:00.858447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-94785cfd-2385-48bf-9f80-3cceb2f2976a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:00.858580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-90791b4b-10da-40a2-a2df-483ac8863d98 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:00.865316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90791b4b-10da-40a2-a2df-483ac8863d98 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:00.865547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94785cfd-2385-48bf-9f80-3cceb2f2976a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:00.865792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94785cfd-2385-48bf-9f80-3cceb2f2976a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:00.865899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90791b4b-10da-40a2-a2df-483ac8863d98 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:00.866224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94785cfd-2385-48bf-9f80-3cceb2f2976a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:00.866347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90791b4b-10da-40a2-a2df-483ac8863d98 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:00.867027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90791b4b-10da-40a2-a2df-483ac8863d98 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:00.867407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94785cfd-2385-48bf-9f80-3cceb2f2976a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:00.867525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90791b4b-10da-40a2-a2df-483ac8863d98 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:00.867876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94785cfd-2385-48bf-9f80-3cceb2f2976a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:00.868023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90791b4b-10da-40a2-a2df-483ac8863d98 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:00.868278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94785cfd-2385-48bf-9f80-3cceb2f2976a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:00.900589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-90791b4b-10da-40a2-a2df-483ac8863d98 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049020 Aug 24 05:13:00.901953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 533/1174] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:00.902102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-94785cfd-2385-48bf-9f80-3cceb2f2976a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049761 Aug 24 05:13:00.902336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 642/1175] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:01.687708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9d870a96-0113-4ebb-9203-deb8de8df670 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:01.689910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9d870a96-0113-4ebb-9203-deb8de8df670 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:01.691852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=86 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:01.697420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d870a96-0113-4ebb-9203-deb8de8df670 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:01.698529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d870a96-0113-4ebb-9203-deb8de8df670 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:01.699072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d870a96-0113-4ebb-9203-deb8de8df670 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:01.699780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d870a96-0113-4ebb-9203-deb8de8df670 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:01.700238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d870a96-0113-4ebb-9203-deb8de8df670 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:01.700662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d870a96-0113-4ebb-9203-deb8de8df670 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:01.731252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9d870a96-0113-4ebb-9203-deb8de8df670 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047430 Aug 24 05:13:01.731832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 534/1176] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:01.918527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dd2cdba7-a396-45e5-8df3-cd51a173ba5a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:01.919115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a46f4162-3b98-4e2b-a6e9-bdeecd6005d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:01.921693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dd2cdba7-a396-45e5-8df3-cd51a173ba5a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:01.921829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a46f4162-3b98-4e2b-a6e9-bdeecd6005d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:01.929997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46f4162-3b98-4e2b-a6e9-bdeecd6005d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:01.930206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd2cdba7-a396-45e5-8df3-cd51a173ba5a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:01.930483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46f4162-3b98-4e2b-a6e9-bdeecd6005d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:01.930618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd2cdba7-a396-45e5-8df3-cd51a173ba5a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:01.930949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46f4162-3b98-4e2b-a6e9-bdeecd6005d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:01.931110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd2cdba7-a396-45e5-8df3-cd51a173ba5a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:01.931647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46f4162-3b98-4e2b-a6e9-bdeecd6005d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:01.931800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd2cdba7-a396-45e5-8df3-cd51a173ba5a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:01.932099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46f4162-3b98-4e2b-a6e9-bdeecd6005d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:01.932939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd2cdba7-a396-45e5-8df3-cd51a173ba5a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:01.933388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd2cdba7-a396-45e5-8df3-cd51a173ba5a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:01.933503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a46f4162-3b98-4e2b-a6e9-bdeecd6005d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:01.937597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:01.965494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dd2cdba7-a396-45e5-8df3-cd51a173ba5a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053966 Aug 24 05:13:01.965824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:01.966535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 643/1177] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:01.970788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a46f4162-3b98-4e2b-a6e9-bdeecd6005d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059488 Aug 24 05:13:01.971353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 535/1178] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:02.743568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8f3c0b9a-f776-491c-b993-db177ea85cdc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:02.745750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8f3c0b9a-f776-491c-b993-db177ea85cdc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:02.752274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f3c0b9a-f776-491c-b993-db177ea85cdc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:02.752764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f3c0b9a-f776-491c-b993-db177ea85cdc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:02.753267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f3c0b9a-f776-491c-b993-db177ea85cdc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:02.754037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f3c0b9a-f776-491c-b993-db177ea85cdc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:02.754494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f3c0b9a-f776-491c-b993-db177ea85cdc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:02.754944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f3c0b9a-f776-491c-b993-db177ea85cdc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:02.787522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8f3c0b9a-f776-491c-b993-db177ea85cdc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047840 Aug 24 05:13:02.788063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 644/1179] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:02.978483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-77c6f22b-d954-4afd-96bd-a6f642534e08 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:02.980824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-77c6f22b-d954-4afd-96bd-a6f642534e08 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:02.983074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8319e066-886a-49ad-ad42-cb9f72bc6bad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:02.985249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8319e066-886a-49ad-ad42-cb9f72bc6bad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:02.987787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77c6f22b-d954-4afd-96bd-a6f642534e08 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:02.988272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77c6f22b-d954-4afd-96bd-a6f642534e08 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:02.988709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77c6f22b-d954-4afd-96bd-a6f642534e08 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:02.989403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77c6f22b-d954-4afd-96bd-a6f642534e08 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:02.989858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77c6f22b-d954-4afd-96bd-a6f642534e08 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:02.990283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77c6f22b-d954-4afd-96bd-a6f642534e08 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:02.991818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8319e066-886a-49ad-ad42-cb9f72bc6bad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:02.992296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8319e066-886a-49ad-ad42-cb9f72bc6bad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:02.992734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8319e066-886a-49ad-ad42-cb9f72bc6bad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:02.993426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8319e066-886a-49ad-ad42-cb9f72bc6bad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:02.993875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8319e066-886a-49ad-ad42-cb9f72bc6bad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:02.994293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8319e066-886a-49ad-ad42-cb9f72bc6bad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:03.020985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-77c6f22b-d954-4afd-96bd-a6f642534e08 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046643 Aug 24 05:13:03.021553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 536/1180] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:03.025343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8319e066-886a-49ad-ad42-cb9f72bc6bad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046435 Aug 24 05:13:03.026074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 645/1181] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:03.800356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-522d91ec-0f24-47da-a167-4a2821c5f7bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:03.802826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-522d91ec-0f24-47da-a167-4a2821c5f7bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:03.809647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-522d91ec-0f24-47da-a167-4a2821c5f7bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:03.810135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-522d91ec-0f24-47da-a167-4a2821c5f7bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:03.810574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-522d91ec-0f24-47da-a167-4a2821c5f7bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:03.811332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-522d91ec-0f24-47da-a167-4a2821c5f7bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:03.811773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-522d91ec-0f24-47da-a167-4a2821c5f7bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:03.812205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-522d91ec-0f24-47da-a167-4a2821c5f7bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:03.843328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-522d91ec-0f24-47da-a167-4a2821c5f7bd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046827 Aug 24 05:13:03.843892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 537/1182] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:03 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:04.033564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b93fdaec-ad28-4744-88c2-861507d9849a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:04.035778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b93fdaec-ad28-4744-88c2-861507d9849a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:04.041333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f1acfcd0-c335-4b4a-9554-238b283a7a6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:04.043259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b93fdaec-ad28-4744-88c2-861507d9849a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:04.043743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b93fdaec-ad28-4744-88c2-861507d9849a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:04.044181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b93fdaec-ad28-4744-88c2-861507d9849a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:04.044881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b93fdaec-ad28-4744-88c2-861507d9849a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:04.045175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f1acfcd0-c335-4b4a-9554-238b283a7a6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:04.045327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b93fdaec-ad28-4744-88c2-861507d9849a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:04.045745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b93fdaec-ad28-4744-88c2-861507d9849a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:04.055096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1acfcd0-c335-4b4a-9554-238b283a7a6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:04.055885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1acfcd0-c335-4b4a-9554-238b283a7a6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:04.056602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1acfcd0-c335-4b4a-9554-238b283a7a6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:04.057710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1acfcd0-c335-4b4a-9554-238b283a7a6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:04.058475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1acfcd0-c335-4b4a-9554-238b283a7a6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:04.059206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1acfcd0-c335-4b4a-9554-238b283a7a6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:04.077530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b93fdaec-ad28-4744-88c2-861507d9849a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047989 Aug 24 05:13:04.078104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 646/1183] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:04.092068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f1acfcd0-c335-4b4a-9554-238b283a7a6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057209 Aug 24 05:13:04.092645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 538/1184] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:04.855610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-92623666-02be-4d48-adf5-3502d7ccd9a4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:04.857796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-92623666-02be-4d48-adf5-3502d7ccd9a4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:04.864079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92623666-02be-4d48-adf5-3502d7ccd9a4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:04.864558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92623666-02be-4d48-adf5-3502d7ccd9a4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:04.864992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92623666-02be-4d48-adf5-3502d7ccd9a4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:04.865683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92623666-02be-4d48-adf5-3502d7ccd9a4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:04.866133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92623666-02be-4d48-adf5-3502d7ccd9a4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:04.866555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-92623666-02be-4d48-adf5-3502d7ccd9a4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:04.896749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-92623666-02be-4d48-adf5-3502d7ccd9a4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045747 Aug 24 05:13:04.897207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 647/1185] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:05.090603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f723dc49-a1e5-432a-9c9f-14cbb79aefab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:05.092721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f723dc49-a1e5-432a-9c9f-14cbb79aefab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:05.099377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f723dc49-a1e5-432a-9c9f-14cbb79aefab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:05.099864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f723dc49-a1e5-432a-9c9f-14cbb79aefab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:05.100306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f723dc49-a1e5-432a-9c9f-14cbb79aefab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:05.101011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f723dc49-a1e5-432a-9c9f-14cbb79aefab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:05.101463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f723dc49-a1e5-432a-9c9f-14cbb79aefab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:05.101890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f723dc49-a1e5-432a-9c9f-14cbb79aefab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:05.104661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-49238956-763a-4455-83ae-c59d16e6cb63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:05.107622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-49238956-763a-4455-83ae-c59d16e6cb63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:05.117160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49238956-763a-4455-83ae-c59d16e6cb63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:05.117932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49238956-763a-4455-83ae-c59d16e6cb63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:05.118647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49238956-763a-4455-83ae-c59d16e6cb63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:05.119773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49238956-763a-4455-83ae-c59d16e6cb63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:05.120729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49238956-763a-4455-83ae-c59d16e6cb63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:05.121441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49238956-763a-4455-83ae-c59d16e6cb63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:05.132051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f723dc49-a1e5-432a-9c9f-14cbb79aefab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046111 Aug 24 05:13:05.132637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 539/1186] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:05.154492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-49238956-763a-4455-83ae-c59d16e6cb63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053825 Aug 24 05:13:05.155081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 648/1187] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:05.909847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6609aea9-4a60-4eb5-9383-1c37a00dacef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:05.912021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6609aea9-4a60-4eb5-9383-1c37a00dacef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:05.918486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6609aea9-4a60-4eb5-9383-1c37a00dacef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:05.919010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6609aea9-4a60-4eb5-9383-1c37a00dacef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:05.919439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6609aea9-4a60-4eb5-9383-1c37a00dacef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:05.920363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6609aea9-4a60-4eb5-9383-1c37a00dacef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:05.920995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6609aea9-4a60-4eb5-9383-1c37a00dacef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:05.921490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6609aea9-4a60-4eb5-9383-1c37a00dacef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:05.953939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6609aea9-4a60-4eb5-9383-1c37a00dacef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047918 Aug 24 05:13:05.954499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 540/1188] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:06.145448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c4e59d2b-307d-4d94-81be-e63257e1fd75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:06.147533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c4e59d2b-307d-4d94-81be-e63257e1fd75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:06.154129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4e59d2b-307d-4d94-81be-e63257e1fd75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:06.154607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4e59d2b-307d-4d94-81be-e63257e1fd75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:06.155067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4e59d2b-307d-4d94-81be-e63257e1fd75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:06.155750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4e59d2b-307d-4d94-81be-e63257e1fd75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:06.156188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4e59d2b-307d-4d94-81be-e63257e1fd75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:06.156599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4e59d2b-307d-4d94-81be-e63257e1fd75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:06.167137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-72037146-7d14-46c9-8d31-01082ea12af2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:06.169303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-72037146-7d14-46c9-8d31-01082ea12af2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:06.176372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72037146-7d14-46c9-8d31-01082ea12af2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:06.176862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72037146-7d14-46c9-8d31-01082ea12af2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:06.177299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72037146-7d14-46c9-8d31-01082ea12af2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:06.178004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72037146-7d14-46c9-8d31-01082ea12af2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:06.178459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72037146-7d14-46c9-8d31-01082ea12af2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:06.178914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72037146-7d14-46c9-8d31-01082ea12af2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:06.188188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c4e59d2b-307d-4d94-81be-e63257e1fd75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046729 Aug 24 05:13:06.189089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 649/1189] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:06.215542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-72037146-7d14-46c9-8d31-01082ea12af2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052462 Aug 24 05:13:06.216137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 541/1190] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:06.967043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-52a31a4f-ec7f-42fc-a9d4-61a870f483a0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:06.969230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-52a31a4f-ec7f-42fc-a9d4-61a870f483a0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:06.971183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=88 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:06.976593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52a31a4f-ec7f-42fc-a9d4-61a870f483a0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:06.977356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52a31a4f-ec7f-42fc-a9d4-61a870f483a0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:06.977492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52a31a4f-ec7f-42fc-a9d4-61a870f483a0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:06.978178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52a31a4f-ec7f-42fc-a9d4-61a870f483a0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:06.978618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52a31a4f-ec7f-42fc-a9d4-61a870f483a0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:06.979140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52a31a4f-ec7f-42fc-a9d4-61a870f483a0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:07.009668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-52a31a4f-ec7f-42fc-a9d4-61a870f483a0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047314 Aug 24 05:13:07.010233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 650/1191] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:07.201672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-23c489a2-95ab-455e-bcaa-ce7d12d3df1f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:07.203876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-23c489a2-95ab-455e-bcaa-ce7d12d3df1f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:07.210039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c489a2-95ab-455e-bcaa-ce7d12d3df1f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:07.210527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c489a2-95ab-455e-bcaa-ce7d12d3df1f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:07.210996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c489a2-95ab-455e-bcaa-ce7d12d3df1f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:07.211686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c489a2-95ab-455e-bcaa-ce7d12d3df1f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:07.212133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c489a2-95ab-455e-bcaa-ce7d12d3df1f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:07.212553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23c489a2-95ab-455e-bcaa-ce7d12d3df1f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:07.229558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e8463ca5-0d70-42ce-8cc2-bd7f0c33a91d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:07.231770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e8463ca5-0d70-42ce-8cc2-bd7f0c33a91d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:07.238303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8463ca5-0d70-42ce-8cc2-bd7f0c33a91d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:07.238825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8463ca5-0d70-42ce-8cc2-bd7f0c33a91d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:07.239261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8463ca5-0d70-42ce-8cc2-bd7f0c33a91d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:07.239960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8463ca5-0d70-42ce-8cc2-bd7f0c33a91d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:07.240409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8463ca5-0d70-42ce-8cc2-bd7f0c33a91d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:07.240825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8463ca5-0d70-42ce-8cc2-bd7f0c33a91d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:07.244071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-23c489a2-95ab-455e-bcaa-ce7d12d3df1f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047458 Aug 24 05:13:07.245031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 542/1192] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:07.275326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e8463ca5-0d70-42ce-8cc2-bd7f0c33a91d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051220 Aug 24 05:13:07.276504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 651/1193] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:08.021499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3abcef01-9fff-4ee5-adb3-9b7f7d9d7b7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:08.023721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3abcef01-9fff-4ee5-adb3-9b7f7d9d7b7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:08.030162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3abcef01-9fff-4ee5-adb3-9b7f7d9d7b7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:08.030647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3abcef01-9fff-4ee5-adb3-9b7f7d9d7b7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:08.031114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3abcef01-9fff-4ee5-adb3-9b7f7d9d7b7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:08.031813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3abcef01-9fff-4ee5-adb3-9b7f7d9d7b7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:08.032268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3abcef01-9fff-4ee5-adb3-9b7f7d9d7b7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:08.032696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3abcef01-9fff-4ee5-adb3-9b7f7d9d7b7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:08.068060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3abcef01-9fff-4ee5-adb3-9b7f7d9d7b7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050424 Aug 24 05:13:08.068623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 543/1194] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:08.255823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-074fa816-63d6-4658-a2cb-c3808c89e616 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:08.257924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-074fa816-63d6-4658-a2cb-c3808c89e616 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:08.266416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074fa816-63d6-4658-a2cb-c3808c89e616 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:08.267069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074fa816-63d6-4658-a2cb-c3808c89e616 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:08.267515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074fa816-63d6-4658-a2cb-c3808c89e616 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:08.268583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074fa816-63d6-4658-a2cb-c3808c89e616 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:08.269324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074fa816-63d6-4658-a2cb-c3808c89e616 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:08.269754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074fa816-63d6-4658-a2cb-c3808c89e616 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:08.288321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-920650ce-6953-4d0b-868f-234ccd52d432 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:08.290484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-920650ce-6953-4d0b-868f-234ccd52d432 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:08.298025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-920650ce-6953-4d0b-868f-234ccd52d432 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:08.298509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-920650ce-6953-4d0b-868f-234ccd52d432 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:08.298972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-920650ce-6953-4d0b-868f-234ccd52d432 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:08.299699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-920650ce-6953-4d0b-868f-234ccd52d432 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:08.300149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-920650ce-6953-4d0b-868f-234ccd52d432 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:08.300569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-920650ce-6953-4d0b-868f-234ccd52d432 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:08.301468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-074fa816-63d6-4658-a2cb-c3808c89e616 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049412 Aug 24 05:13:08.302047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 652/1195] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:08.331898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-920650ce-6953-4d0b-868f-234ccd52d432 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047493 Aug 24 05:13:08.332453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 544/1196] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:09.080515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-54dca595-55ab-4e17-8343-822f2e467397 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:09.082657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-54dca595-55ab-4e17-8343-822f2e467397 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:09.089345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54dca595-55ab-4e17-8343-822f2e467397 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:09.089859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54dca595-55ab-4e17-8343-822f2e467397 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:09.090305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54dca595-55ab-4e17-8343-822f2e467397 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:09.091024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54dca595-55ab-4e17-8343-822f2e467397 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:09.091468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54dca595-55ab-4e17-8343-822f2e467397 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:09.091892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54dca595-55ab-4e17-8343-822f2e467397 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:09.122534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-54dca595-55ab-4e17-8343-822f2e467397 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045970 Aug 24 05:13:09.123116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 653/1197] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:09.314010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ece316ec-7682-4a1f-a85c-43586912e117 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:09.316070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ece316ec-7682-4a1f-a85c-43586912e117 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:09.322837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ece316ec-7682-4a1f-a85c-43586912e117 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:09.323321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ece316ec-7682-4a1f-a85c-43586912e117 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:09.323754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ece316ec-7682-4a1f-a85c-43586912e117 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:09.324446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ece316ec-7682-4a1f-a85c-43586912e117 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:09.324896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ece316ec-7682-4a1f-a85c-43586912e117 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:09.325311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ece316ec-7682-4a1f-a85c-43586912e117 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:09.345329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cc3486b8-c1f4-4902-9383-947a23a491d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:09.348142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cc3486b8-c1f4-4902-9383-947a23a491d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:09.355826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc3486b8-c1f4-4902-9383-947a23a491d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:09.356402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc3486b8-c1f4-4902-9383-947a23a491d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:09.357012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc3486b8-c1f4-4902-9383-947a23a491d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:09.357539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ece316ec-7682-4a1f-a85c-43586912e117 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047563 Aug 24 05:13:09.357980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc3486b8-c1f4-4902-9383-947a23a491d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:09.358163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 545/1198] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:09.358779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc3486b8-c1f4-4902-9383-947a23a491d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:09.359376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc3486b8-c1f4-4902-9383-947a23a491d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:09.390365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cc3486b8-c1f4-4902-9383-947a23a491d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049206 Aug 24 05:13:09.390972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 654/1199] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:10.134511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-782c6733-f27d-4a96-b58c-00ce8339ecb6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:10.137331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-782c6733-f27d-4a96-b58c-00ce8339ecb6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:10.143543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-782c6733-f27d-4a96-b58c-00ce8339ecb6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:10.144026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-782c6733-f27d-4a96-b58c-00ce8339ecb6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:10.144459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-782c6733-f27d-4a96-b58c-00ce8339ecb6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:10.145160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-782c6733-f27d-4a96-b58c-00ce8339ecb6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:10.145610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-782c6733-f27d-4a96-b58c-00ce8339ecb6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:10.146030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-782c6733-f27d-4a96-b58c-00ce8339ecb6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:10.177192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-782c6733-f27d-4a96-b58c-00ce8339ecb6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046598 Aug 24 05:13:10.177765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 546/1200] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:10.369838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e62b7223-ab02-4451-8661-733dde3e8b17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:10.372005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e62b7223-ab02-4451-8661-733dde3e8b17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:10.378653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e62b7223-ab02-4451-8661-733dde3e8b17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:10.379161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e62b7223-ab02-4451-8661-733dde3e8b17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:10.379592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e62b7223-ab02-4451-8661-733dde3e8b17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:10.380282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e62b7223-ab02-4451-8661-733dde3e8b17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:10.380736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e62b7223-ab02-4451-8661-733dde3e8b17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:10.381147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e62b7223-ab02-4451-8661-733dde3e8b17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:10.403576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eed4ef37-9c07-4891-b91f-d516ad419de4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:10.406965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-eed4ef37-9c07-4891-b91f-d516ad419de4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:10.412985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e62b7223-ab02-4451-8661-733dde3e8b17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 Aug 24 05:13:10.413461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eed4ef37-9c07-4891-b91f-d516ad419de4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:10.413579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 655/1201] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:10.414032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eed4ef37-9c07-4891-b91f-d516ad419de4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:10.414550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eed4ef37-9c07-4891-b91f-d516ad419de4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:10.415469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eed4ef37-9c07-4891-b91f-d516ad419de4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:10.415934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eed4ef37-9c07-4891-b91f-d516ad419de4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:10.416358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eed4ef37-9c07-4891-b91f-d516ad419de4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:10.449942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-eed4ef37-9c07-4891-b91f-d516ad419de4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051172 Aug 24 05:13:10.450518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 547/1202] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:11.189718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cb733ce4-524f-4d12-bc6d-9692d1415113 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:11.191901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cb733ce4-524f-4d12-bc6d-9692d1415113 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:11.197897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb733ce4-524f-4d12-bc6d-9692d1415113 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:11.198387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb733ce4-524f-4d12-bc6d-9692d1415113 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:11.198909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb733ce4-524f-4d12-bc6d-9692d1415113 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:11.199545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb733ce4-524f-4d12-bc6d-9692d1415113 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:11.199999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb733ce4-524f-4d12-bc6d-9692d1415113 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:11.200416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb733ce4-524f-4d12-bc6d-9692d1415113 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:11.230989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cb733ce4-524f-4d12-bc6d-9692d1415113 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045203 Aug 24 05:13:11.231538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 656/1203] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:11.425802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-037b24c8-07cd-41af-a965-f5a757649e52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:11.428195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-037b24c8-07cd-41af-a965-f5a757649e52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:11.436621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-037b24c8-07cd-41af-a965-f5a757649e52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:11.437111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-037b24c8-07cd-41af-a965-f5a757649e52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:11.437546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-037b24c8-07cd-41af-a965-f5a757649e52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:11.438279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-037b24c8-07cd-41af-a965-f5a757649e52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:11.438745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-037b24c8-07cd-41af-a965-f5a757649e52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:11.439177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-037b24c8-07cd-41af-a965-f5a757649e52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:11.461650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e2a47177-e059-4c3f-917d-254a84924bb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:11.463806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e2a47177-e059-4c3f-917d-254a84924bb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:11.470449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2a47177-e059-4c3f-917d-254a84924bb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:11.470889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-037b24c8-07cd-41af-a965-f5a757649e52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049140 Aug 24 05:13:11.471013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2a47177-e059-4c3f-917d-254a84924bb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:11.471369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2a47177-e059-4c3f-917d-254a84924bb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:11.471476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 548/1204] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:11.472065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2a47177-e059-4c3f-917d-254a84924bb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:11.472508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2a47177-e059-4c3f-917d-254a84924bb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:11.472923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2a47177-e059-4c3f-917d-254a84924bb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:11.503719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e2a47177-e059-4c3f-917d-254a84924bb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Aug 24 05:13:11.504269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 657/1205] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:12.243590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-352eaeae-daa6-44ae-b846-e70b3d0b7e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:12.245962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-352eaeae-daa6-44ae-b846-e70b3d0b7e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:12.252111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-352eaeae-daa6-44ae-b846-e70b3d0b7e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:12.252593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-352eaeae-daa6-44ae-b846-e70b3d0b7e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:12.253027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-352eaeae-daa6-44ae-b846-e70b3d0b7e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:12.253764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-352eaeae-daa6-44ae-b846-e70b3d0b7e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:12.254175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-352eaeae-daa6-44ae-b846-e70b3d0b7e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:12.254594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-352eaeae-daa6-44ae-b846-e70b3d0b7e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:12.284883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-352eaeae-daa6-44ae-b846-e70b3d0b7e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045508 Aug 24 05:13:12.285438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 549/1206] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:12.482792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4336941e-8326-49df-a38d-e52aa53ad187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:12.484961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4336941e-8326-49df-a38d-e52aa53ad187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:12.491419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4336941e-8326-49df-a38d-e52aa53ad187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:12.491898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4336941e-8326-49df-a38d-e52aa53ad187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:12.492331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4336941e-8326-49df-a38d-e52aa53ad187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:12.493022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4336941e-8326-49df-a38d-e52aa53ad187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:12.493467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4336941e-8326-49df-a38d-e52aa53ad187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:12.493888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4336941e-8326-49df-a38d-e52aa53ad187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:12.516076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0ad7cc5f-91b2-4862-8bef-5492ea60304d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:12.518299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0ad7cc5f-91b2-4862-8bef-5492ea60304d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:12.524770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ad7cc5f-91b2-4862-8bef-5492ea60304d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:12.525091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4336941e-8326-49df-a38d-e52aa53ad187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046757 Aug 24 05:13:12.525249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ad7cc5f-91b2-4862-8bef-5492ea60304d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:12.525666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 658/1207] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:12.525780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ad7cc5f-91b2-4862-8bef-5492ea60304d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:12.526370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ad7cc5f-91b2-4862-8bef-5492ea60304d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:12.526839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ad7cc5f-91b2-4862-8bef-5492ea60304d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:12.527258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ad7cc5f-91b2-4862-8bef-5492ea60304d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:12.559179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0ad7cc5f-91b2-4862-8bef-5492ea60304d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047039 Aug 24 05:13:12.559787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 550/1208] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:13.297306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-efed4ccd-15ae-4ade-a7d6-0fef5d228261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:13.299460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-efed4ccd-15ae-4ade-a7d6-0fef5d228261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:13.306104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efed4ccd-15ae-4ade-a7d6-0fef5d228261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:13.306588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efed4ccd-15ae-4ade-a7d6-0fef5d228261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:13.307106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efed4ccd-15ae-4ade-a7d6-0fef5d228261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:13.307893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efed4ccd-15ae-4ade-a7d6-0fef5d228261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:13.308284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efed4ccd-15ae-4ade-a7d6-0fef5d228261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:13.308699 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efed4ccd-15ae-4ade-a7d6-0fef5d228261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:13.334481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:13.340731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-efed4ccd-15ae-4ade-a7d6-0fef5d228261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047324 Aug 24 05:13:13.341285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 659/1209] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:13.537803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-008eac42-e757-489e-a06b-b92d2857b8c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:13.539977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-008eac42-e757-489e-a06b-b92d2857b8c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:13.546653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-008eac42-e757-489e-a06b-b92d2857b8c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:13.547160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-008eac42-e757-489e-a06b-b92d2857b8c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:13.547590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-008eac42-e757-489e-a06b-b92d2857b8c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:13.548287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-008eac42-e757-489e-a06b-b92d2857b8c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:13.548728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-008eac42-e757-489e-a06b-b92d2857b8c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:13.549145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-008eac42-e757-489e-a06b-b92d2857b8c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:13.571557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0142c102-cfc1-4db8-9bfe-1b3659e08750 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:13.574433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0142c102-cfc1-4db8-9bfe-1b3659e08750 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:13.580882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-008eac42-e757-489e-a06b-b92d2857b8c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Aug 24 05:13:13.581468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 551/1210] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:13.581636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0142c102-cfc1-4db8-9bfe-1b3659e08750 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:13.582049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0142c102-cfc1-4db8-9bfe-1b3659e08750 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:13.582482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0142c102-cfc1-4db8-9bfe-1b3659e08750 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:13.583215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0142c102-cfc1-4db8-9bfe-1b3659e08750 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:13.583693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0142c102-cfc1-4db8-9bfe-1b3659e08750 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:13.584112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0142c102-cfc1-4db8-9bfe-1b3659e08750 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:13.616356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0142c102-cfc1-4db8-9bfe-1b3659e08750 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048694 Aug 24 05:13:13.616920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 660/1211] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:14.352499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e5843a9d-0098-4551-a0ad-f5ddad1833d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:14.355442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e5843a9d-0098-4551-a0ad-f5ddad1833d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:14.361633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5843a9d-0098-4551-a0ad-f5ddad1833d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:14.362159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5843a9d-0098-4551-a0ad-f5ddad1833d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:14.362607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5843a9d-0098-4551-a0ad-f5ddad1833d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:14.363340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5843a9d-0098-4551-a0ad-f5ddad1833d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:14.363823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5843a9d-0098-4551-a0ad-f5ddad1833d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:14.364319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5843a9d-0098-4551-a0ad-f5ddad1833d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:14.382512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:14.396792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e5843a9d-0098-4551-a0ad-f5ddad1833d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048242 Aug 24 05:13:14.397352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 552/1212] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:14.593995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-196d490f-e757-4aae-b044-eb6076163a1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:14.596085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-196d490f-e757-4aae-b044-eb6076163a1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:14.602612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-196d490f-e757-4aae-b044-eb6076163a1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:14.603125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-196d490f-e757-4aae-b044-eb6076163a1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:14.603561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-196d490f-e757-4aae-b044-eb6076163a1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:14.604993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-196d490f-e757-4aae-b044-eb6076163a1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:14.605527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-196d490f-e757-4aae-b044-eb6076163a1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:14.605947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-196d490f-e757-4aae-b044-eb6076163a1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:14.631356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b51de599-1f71-4bb5-8c1d-e722147ad137 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:14.633693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b51de599-1f71-4bb5-8c1d-e722147ad137 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:14.637559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-196d490f-e757-4aae-b044-eb6076163a1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047704 Aug 24 05:13:14.640598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51de599-1f71-4bb5-8c1d-e722147ad137 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:14.641242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51de599-1f71-4bb5-8c1d-e722147ad137 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:14.641951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51de599-1f71-4bb5-8c1d-e722147ad137 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:14.642091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 661/1213] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:14 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:14.643144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51de599-1f71-4bb5-8c1d-e722147ad137 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:14.643767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51de599-1f71-4bb5-8c1d-e722147ad137 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:14.644198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51de599-1f71-4bb5-8c1d-e722147ad137 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:14.686178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b51de599-1f71-4bb5-8c1d-e722147ad137 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060693 Aug 24 05:13:14.686833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 553/1214] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:15.409863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-36e0e121-bf02-4131-801c-968e4858a202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:15.412445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-36e0e121-bf02-4131-801c-968e4858a202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:15.419457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e0e121-bf02-4131-801c-968e4858a202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:15.419806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e0e121-bf02-4131-801c-968e4858a202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:15.420303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e0e121-bf02-4131-801c-968e4858a202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:15.421219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e0e121-bf02-4131-801c-968e4858a202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:15.421869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e0e121-bf02-4131-801c-968e4858a202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:15.422299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e0e121-bf02-4131-801c-968e4858a202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:15.455069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-36e0e121-bf02-4131-801c-968e4858a202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049331 Aug 24 05:13:15.455644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 662/1215] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:15.650925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3930b390-7290-4aa4-b898-6827aad3169a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:15.653071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3930b390-7290-4aa4-b898-6827aad3169a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:15.661454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3930b390-7290-4aa4-b898-6827aad3169a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:15.662165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3930b390-7290-4aa4-b898-6827aad3169a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:15.662844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3930b390-7290-4aa4-b898-6827aad3169a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:15.663890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3930b390-7290-4aa4-b898-6827aad3169a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:15.664684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3930b390-7290-4aa4-b898-6827aad3169a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:15.665410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3930b390-7290-4aa4-b898-6827aad3169a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:15.698823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cc412bd9-5084-49ca-abab-27a1a0883af8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:15.699838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3930b390-7290-4aa4-b898-6827aad3169a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053929 Aug 24 05:13:15.700424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 554/1216] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:15.701020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cc412bd9-5084-49ca-abab-27a1a0883af8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:15.707301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc412bd9-5084-49ca-abab-27a1a0883af8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:15.707777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc412bd9-5084-49ca-abab-27a1a0883af8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:15.708208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc412bd9-5084-49ca-abab-27a1a0883af8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:15.708898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc412bd9-5084-49ca-abab-27a1a0883af8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:15.709340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc412bd9-5084-49ca-abab-27a1a0883af8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:15.709755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc412bd9-5084-49ca-abab-27a1a0883af8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:15.741960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cc412bd9-5084-49ca-abab-27a1a0883af8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047179 Aug 24 05:13:15.742524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 663/1217] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:16.467501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5b4e3b2c-97e1-4eb3-9c8b-1b54640b2388 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:16.469776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5b4e3b2c-97e1-4eb3-9c8b-1b54640b2388 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:16.475876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b4e3b2c-97e1-4eb3-9c8b-1b54640b2388 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:16.476355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b4e3b2c-97e1-4eb3-9c8b-1b54640b2388 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:16.476902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b4e3b2c-97e1-4eb3-9c8b-1b54640b2388 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:16.477610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b4e3b2c-97e1-4eb3-9c8b-1b54640b2388 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:16.478059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b4e3b2c-97e1-4eb3-9c8b-1b54640b2388 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:16.478484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b4e3b2c-97e1-4eb3-9c8b-1b54640b2388 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:16.516844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5b4e3b2c-97e1-4eb3-9c8b-1b54640b2388 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053347 Aug 24 05:13:16.517456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 555/1218] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:16 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:16.712831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4f95152d-9b76-48bc-b30d-c410d254d5d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:16.715491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4f95152d-9b76-48bc-b30d-c410d254d5d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:16.722136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f95152d-9b76-48bc-b30d-c410d254d5d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:16.722613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f95152d-9b76-48bc-b30d-c410d254d5d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:16.723075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f95152d-9b76-48bc-b30d-c410d254d5d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:16.723768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f95152d-9b76-48bc-b30d-c410d254d5d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:16.724213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f95152d-9b76-48bc-b30d-c410d254d5d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:16.724631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f95152d-9b76-48bc-b30d-c410d254d5d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:16.756394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-df6b275e-676b-424e-b726-9c86ff4a199a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:16.758035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4f95152d-9b76-48bc-b30d-c410d254d5d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049336 Aug 24 05:13:16.758865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-df6b275e-676b-424e-b726-9c86ff4a199a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:16.759031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 664/1219] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:16.766015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df6b275e-676b-424e-b726-9c86ff4a199a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:16.766497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df6b275e-676b-424e-b726-9c86ff4a199a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:16.766955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df6b275e-676b-424e-b726-9c86ff4a199a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:16.767644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df6b275e-676b-424e-b726-9c86ff4a199a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:16.768091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df6b275e-676b-424e-b726-9c86ff4a199a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:16.768504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df6b275e-676b-424e-b726-9c86ff4a199a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:16.802039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-df6b275e-676b-424e-b726-9c86ff4a199a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050296 Aug 24 05:13:16.802616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 556/1220] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:16 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:17.530335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-08da86db-ee55-4422-babf-00850830bbc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:17.532913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-08da86db-ee55-4422-babf-00850830bbc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:17.539147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08da86db-ee55-4422-babf-00850830bbc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:17.539620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08da86db-ee55-4422-babf-00850830bbc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:17.540044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08da86db-ee55-4422-babf-00850830bbc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:17.540727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08da86db-ee55-4422-babf-00850830bbc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:17.541164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08da86db-ee55-4422-babf-00850830bbc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:17.542197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-08da86db-ee55-4422-babf-00850830bbc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:17.573457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-08da86db-ee55-4422-babf-00850830bbc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047659 Aug 24 05:13:17.574057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 665/1221] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:17.769954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e49637b4-3a64-486b-a8ad-5e6ac6176ad5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:17.772290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e49637b4-3a64-486b-a8ad-5e6ac6176ad5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:17.779628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e49637b4-3a64-486b-a8ad-5e6ac6176ad5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:17.780111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e49637b4-3a64-486b-a8ad-5e6ac6176ad5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:17.780541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e49637b4-3a64-486b-a8ad-5e6ac6176ad5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:17.781237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e49637b4-3a64-486b-a8ad-5e6ac6176ad5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:17.781683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e49637b4-3a64-486b-a8ad-5e6ac6176ad5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:17.782105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e49637b4-3a64-486b-a8ad-5e6ac6176ad5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:17.813500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e49637b4-3a64-486b-a8ad-5e6ac6176ad5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047541 Aug 24 05:13:17.813763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f0b74343-b75c-4272-8f41-7432af560924 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:17.814226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 557/1222] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:17 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:17.816003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f0b74343-b75c-4272-8f41-7432af560924 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:17.823473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0b74343-b75c-4272-8f41-7432af560924 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:17.823963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0b74343-b75c-4272-8f41-7432af560924 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:17.824395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0b74343-b75c-4272-8f41-7432af560924 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:17.825150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0b74343-b75c-4272-8f41-7432af560924 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:17.825579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0b74343-b75c-4272-8f41-7432af560924 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:17.826037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0b74343-b75c-4272-8f41-7432af560924 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:17.858503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f0b74343-b75c-4272-8f41-7432af560924 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048619 Aug 24 05:13:17.859743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 666/1223] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:18.586426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-649619b9-dc09-4105-9c5b-0f8db825670a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:18.589752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-649619b9-dc09-4105-9c5b-0f8db825670a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:18.600189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-649619b9-dc09-4105-9c5b-0f8db825670a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:18.600691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-649619b9-dc09-4105-9c5b-0f8db825670a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:18.601123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-649619b9-dc09-4105-9c5b-0f8db825670a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:18.601836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-649619b9-dc09-4105-9c5b-0f8db825670a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:18.602291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-649619b9-dc09-4105-9c5b-0f8db825670a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:18.602737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-649619b9-dc09-4105-9c5b-0f8db825670a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:18.634430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-649619b9-dc09-4105-9c5b-0f8db825670a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052537 Aug 24 05:13:18.635537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 558/1224] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:18.826324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-eb116edf-9d8b-4678-b55a-525612ac6783 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:18.828510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-eb116edf-9d8b-4678-b55a-525612ac6783 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:18.835282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eb116edf-9d8b-4678-b55a-525612ac6783 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:18.836105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eb116edf-9d8b-4678-b55a-525612ac6783 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:18.836936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eb116edf-9d8b-4678-b55a-525612ac6783 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:18.837901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eb116edf-9d8b-4678-b55a-525612ac6783 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:18.838979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eb116edf-9d8b-4678-b55a-525612ac6783 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:18.839408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eb116edf-9d8b-4678-b55a-525612ac6783 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:18.871356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0e352042-c335-4ada-ba54-fa121ec8424c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:18.873272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-eb116edf-9d8b-4678-b55a-525612ac6783 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051502 Aug 24 05:13:18.873509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0e352042-c335-4ada-ba54-fa121ec8424c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:18.873860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 667/1225] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:18.880192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e352042-c335-4ada-ba54-fa121ec8424c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:18.880676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e352042-c335-4ada-ba54-fa121ec8424c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:18.881104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e352042-c335-4ada-ba54-fa121ec8424c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:18.881805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e352042-c335-4ada-ba54-fa121ec8424c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:18.882253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e352042-c335-4ada-ba54-fa121ec8424c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:18.882673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e352042-c335-4ada-ba54-fa121ec8424c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:18.913649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0e352042-c335-4ada-ba54-fa121ec8424c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046914 Aug 24 05:13:18.914225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 559/1226] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:19.647899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fffe4e39-d2f5-40fd-824e-b6ebfe550d9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:19.650031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fffe4e39-d2f5-40fd-824e-b6ebfe550d9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:19.657036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fffe4e39-d2f5-40fd-824e-b6ebfe550d9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:19.657663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fffe4e39-d2f5-40fd-824e-b6ebfe550d9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:19.657963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fffe4e39-d2f5-40fd-824e-b6ebfe550d9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:19.658651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fffe4e39-d2f5-40fd-824e-b6ebfe550d9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:19.659115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fffe4e39-d2f5-40fd-824e-b6ebfe550d9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:19.659528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fffe4e39-d2f5-40fd-824e-b6ebfe550d9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:19.692676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fffe4e39-d2f5-40fd-824e-b6ebfe550d9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048838 Aug 24 05:13:19.693241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 668/1227] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:19.886262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-baa125c3-9905-4ee6-9a6f-18ca8da383f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:19.888497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-baa125c3-9905-4ee6-9a6f-18ca8da383f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:19.895441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baa125c3-9905-4ee6-9a6f-18ca8da383f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:19.895928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baa125c3-9905-4ee6-9a6f-18ca8da383f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:19.896368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baa125c3-9905-4ee6-9a6f-18ca8da383f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:19.897105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baa125c3-9905-4ee6-9a6f-18ca8da383f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:19.897565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baa125c3-9905-4ee6-9a6f-18ca8da383f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:19.898040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baa125c3-9905-4ee6-9a6f-18ca8da383f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:19.926394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4272961b-2f67-4da2-bdee-0c6bc89025cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:19.929394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4272961b-2f67-4da2-bdee-0c6bc89025cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:19.932604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-baa125c3-9905-4ee6-9a6f-18ca8da383f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050776 Aug 24 05:13:19.933187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 560/1228] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:19.938527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4272961b-2f67-4da2-bdee-0c6bc89025cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:19.939040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4272961b-2f67-4da2-bdee-0c6bc89025cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:19.939477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4272961b-2f67-4da2-bdee-0c6bc89025cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:19.940182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4272961b-2f67-4da2-bdee-0c6bc89025cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:19.940630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4272961b-2f67-4da2-bdee-0c6bc89025cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:19.941051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4272961b-2f67-4da2-bdee-0c6bc89025cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:19.974075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4272961b-2f67-4da2-bdee-0c6bc89025cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051836 Aug 24 05:13:19.974620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 669/1229] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:20.705082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-175745d4-7796-4cd6-973a-cc26ba243eb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:20.707327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-175745d4-7796-4cd6-973a-cc26ba243eb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:20.713347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175745d4-7796-4cd6-973a-cc26ba243eb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:20.714030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175745d4-7796-4cd6-973a-cc26ba243eb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:20.714471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175745d4-7796-4cd6-973a-cc26ba243eb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:20.715207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175745d4-7796-4cd6-973a-cc26ba243eb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:20.715663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175745d4-7796-4cd6-973a-cc26ba243eb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:20.716077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-175745d4-7796-4cd6-973a-cc26ba243eb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:20.749509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-175745d4-7796-4cd6-973a-cc26ba243eb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048327 Aug 24 05:13:20.750301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 561/1230] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:20.944698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7e0e4b95-221b-4a33-8f28-857c56d17b21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:20.946908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7e0e4b95-221b-4a33-8f28-857c56d17b21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:20.953707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0e4b95-221b-4a33-8f28-857c56d17b21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:20.954176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0e4b95-221b-4a33-8f28-857c56d17b21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:20.954604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0e4b95-221b-4a33-8f28-857c56d17b21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:20.955361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0e4b95-221b-4a33-8f28-857c56d17b21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:20.955749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0e4b95-221b-4a33-8f28-857c56d17b21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:20.956159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e0e4b95-221b-4a33-8f28-857c56d17b21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:20.986271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-38267bb1-612f-4e03-8b64-daf6bbffb7e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:20.986969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7e0e4b95-221b-4a33-8f28-857c56d17b21 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046036 Aug 24 05:13:20.988377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 670/1231] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:20.988956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-38267bb1-612f-4e03-8b64-daf6bbffb7e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:20.996570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38267bb1-612f-4e03-8b64-daf6bbffb7e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:20.997060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38267bb1-612f-4e03-8b64-daf6bbffb7e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:20.997500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38267bb1-612f-4e03-8b64-daf6bbffb7e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:20.998214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38267bb1-612f-4e03-8b64-daf6bbffb7e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:20.998668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38267bb1-612f-4e03-8b64-daf6bbffb7e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:20.999127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38267bb1-612f-4e03-8b64-daf6bbffb7e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:21.029808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-38267bb1-612f-4e03-8b64-daf6bbffb7e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047590 Aug 24 05:13:21.030386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 562/1232] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:21.761765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f1bfa2c-1996-4f77-89c9-84e4ef3554b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:21.764030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1f1bfa2c-1996-4f77-89c9-84e4ef3554b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:21.770062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f1bfa2c-1996-4f77-89c9-84e4ef3554b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:21.770533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f1bfa2c-1996-4f77-89c9-84e4ef3554b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:21.770998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f1bfa2c-1996-4f77-89c9-84e4ef3554b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:21.771683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f1bfa2c-1996-4f77-89c9-84e4ef3554b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:21.772123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f1bfa2c-1996-4f77-89c9-84e4ef3554b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:21.772535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f1bfa2c-1996-4f77-89c9-84e4ef3554b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:21.803956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1f1bfa2c-1996-4f77-89c9-84e4ef3554b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046112 Aug 24 05:13:21.804525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 671/1233] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:21.999414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8f0dab42-0559-4a22-91c5-23a35b9af162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:22.001483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8f0dab42-0559-4a22-91c5-23a35b9af162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:22.008033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f0dab42-0559-4a22-91c5-23a35b9af162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:22.008513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f0dab42-0559-4a22-91c5-23a35b9af162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:22.008951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f0dab42-0559-4a22-91c5-23a35b9af162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:22.009644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f0dab42-0559-4a22-91c5-23a35b9af162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:22.010140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f0dab42-0559-4a22-91c5-23a35b9af162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:22.010563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f0dab42-0559-4a22-91c5-23a35b9af162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:22.040446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8f0dab42-0559-4a22-91c5-23a35b9af162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045181 Aug 24 05:13:22.041012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 563/1234] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:22.042179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-607e559a-11c9-4597-984e-1682537144eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:22.044341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-607e559a-11c9-4597-984e-1682537144eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:22.050596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-607e559a-11c9-4597-984e-1682537144eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:22.051464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-607e559a-11c9-4597-984e-1682537144eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:22.051888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-607e559a-11c9-4597-984e-1682537144eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:22.052620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-607e559a-11c9-4597-984e-1682537144eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:22.053012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-607e559a-11c9-4597-984e-1682537144eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:22.053418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-607e559a-11c9-4597-984e-1682537144eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:22.082856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-607e559a-11c9-4597-984e-1682537144eb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Aug 24 05:13:22.083395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 672/1235] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:22.817924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-79b2e77e-c36b-4dd5-9a39-1b0521bbbdef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:22.820937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-79b2e77e-c36b-4dd5-9a39-1b0521bbbdef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:22.828550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79b2e77e-c36b-4dd5-9a39-1b0521bbbdef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:22.829035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79b2e77e-c36b-4dd5-9a39-1b0521bbbdef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:22.829537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79b2e77e-c36b-4dd5-9a39-1b0521bbbdef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:22.830242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79b2e77e-c36b-4dd5-9a39-1b0521bbbdef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:22.831669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79b2e77e-c36b-4dd5-9a39-1b0521bbbdef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:22.832096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79b2e77e-c36b-4dd5-9a39-1b0521bbbdef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:22.866152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-79b2e77e-c36b-4dd5-9a39-1b0521bbbdef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052367 Aug 24 05:13:22.866746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 564/1236] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:23.054178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-74b40745-6168-4c57-98c5-c6f2291ea185 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:23.056367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-74b40745-6168-4c57-98c5-c6f2291ea185 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:23.063037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74b40745-6168-4c57-98c5-c6f2291ea185 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:23.063513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74b40745-6168-4c57-98c5-c6f2291ea185 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:23.063947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74b40745-6168-4c57-98c5-c6f2291ea185 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:23.064637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74b40745-6168-4c57-98c5-c6f2291ea185 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:23.065085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74b40745-6168-4c57-98c5-c6f2291ea185 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:23.065505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74b40745-6168-4c57-98c5-c6f2291ea185 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:23.095803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1a6de39d-0406-44c2-845c-b06401ad5bd1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:23.097830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-74b40745-6168-4c57-98c5-c6f2291ea185 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047892 Aug 24 05:13:23.098004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1a6de39d-0406-44c2-845c-b06401ad5bd1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:23.098405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 673/1237] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:23.104565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a6de39d-0406-44c2-845c-b06401ad5bd1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:23.105048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a6de39d-0406-44c2-845c-b06401ad5bd1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:23.105484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a6de39d-0406-44c2-845c-b06401ad5bd1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:23.106216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a6de39d-0406-44c2-845c-b06401ad5bd1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:23.106671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a6de39d-0406-44c2-845c-b06401ad5bd1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:23.107118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a6de39d-0406-44c2-845c-b06401ad5bd1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:23.145503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1a6de39d-0406-44c2-845c-b06401ad5bd1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053594 Aug 24 05:13:23.146094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 565/1238] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:23.884207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1bdf70ce-9e08-4c9f-845b-5709a48c4be4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:23.886525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1bdf70ce-9e08-4c9f-845b-5709a48c4be4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:23.892680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bdf70ce-9e08-4c9f-845b-5709a48c4be4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:23.893151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bdf70ce-9e08-4c9f-845b-5709a48c4be4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:23.893580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bdf70ce-9e08-4c9f-845b-5709a48c4be4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:23.894287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bdf70ce-9e08-4c9f-845b-5709a48c4be4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:23.894761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bdf70ce-9e08-4c9f-845b-5709a48c4be4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:23.895179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1bdf70ce-9e08-4c9f-845b-5709a48c4be4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:23.926395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1bdf70ce-9e08-4c9f-845b-5709a48c4be4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045806 Aug 24 05:13:23.926998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 674/1239] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:24.109851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0b78feea-ca60-49cb-8f00-02d5f022b7dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:24.111978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0b78feea-ca60-49cb-8f00-02d5f022b7dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:24.118490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b78feea-ca60-49cb-8f00-02d5f022b7dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:24.118999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b78feea-ca60-49cb-8f00-02d5f022b7dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:24.120064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b78feea-ca60-49cb-8f00-02d5f022b7dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:24.120882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b78feea-ca60-49cb-8f00-02d5f022b7dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:24.121337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b78feea-ca60-49cb-8f00-02d5f022b7dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:24.121766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0b78feea-ca60-49cb-8f00-02d5f022b7dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:24.151651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0b78feea-ca60-49cb-8f00-02d5f022b7dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045851 Aug 24 05:13:24.152476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 566/1240] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:24 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:24.159916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-562fbe25-eed7-42e4-b2e3-34e554cd7e95 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:24.162031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-562fbe25-eed7-42e4-b2e3-34e554cd7e95 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:24.171147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-562fbe25-eed7-42e4-b2e3-34e554cd7e95 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:24.171732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-562fbe25-eed7-42e4-b2e3-34e554cd7e95 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:24.172273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-562fbe25-eed7-42e4-b2e3-34e554cd7e95 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:24.173113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-562fbe25-eed7-42e4-b2e3-34e554cd7e95 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:24.173643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-562fbe25-eed7-42e4-b2e3-34e554cd7e95 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:24.174106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-562fbe25-eed7-42e4-b2e3-34e554cd7e95 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:24.205603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-562fbe25-eed7-42e4-b2e3-34e554cd7e95 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050777 Aug 24 05:13:24.206159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 675/1241] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:24.938935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-35720204-b620-410b-89d4-7c2bad67d255 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:24.941037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-35720204-b620-410b-89d4-7c2bad67d255 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:24.947224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35720204-b620-410b-89d4-7c2bad67d255 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:24.947715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35720204-b620-410b-89d4-7c2bad67d255 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:24.948171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35720204-b620-410b-89d4-7c2bad67d255 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:24.948958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35720204-b620-410b-89d4-7c2bad67d255 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:24.949417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35720204-b620-410b-89d4-7c2bad67d255 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:24.949849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35720204-b620-410b-89d4-7c2bad67d255 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:24.981937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-35720204-b620-410b-89d4-7c2bad67d255 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046018 Aug 24 05:13:24.981937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 567/1242] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:25.164663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-db27995d-3528-4428-ab27-a37c5f07bf0a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:25.167490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-db27995d-3528-4428-ab27-a37c5f07bf0a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:25.175300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db27995d-3528-4428-ab27-a37c5f07bf0a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:25.175781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db27995d-3528-4428-ab27-a37c5f07bf0a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:25.176481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db27995d-3528-4428-ab27-a37c5f07bf0a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:25.177178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db27995d-3528-4428-ab27-a37c5f07bf0a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:25.177626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db27995d-3528-4428-ab27-a37c5f07bf0a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:25.178043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-db27995d-3528-4428-ab27-a37c5f07bf0a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:25.195398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:25.209780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-db27995d-3528-4428-ab27-a37c5f07bf0a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049037 Aug 24 05:13:25.210347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 676/1243] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:25.218091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-beb790e0-b652-48ad-b124-1fc7e83092b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:25.220238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-beb790e0-b652-48ad-b124-1fc7e83092b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:25.227765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-beb790e0-b652-48ad-b124-1fc7e83092b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:25.228238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-beb790e0-b652-48ad-b124-1fc7e83092b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:25.228671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-beb790e0-b652-48ad-b124-1fc7e83092b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:25.229364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-beb790e0-b652-48ad-b124-1fc7e83092b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:25.229810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-beb790e0-b652-48ad-b124-1fc7e83092b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:25.230248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-beb790e0-b652-48ad-b124-1fc7e83092b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:25.261435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-beb790e0-b652-48ad-b124-1fc7e83092b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047725 Aug 24 05:13:25.261907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 568/1244] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:25.993923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-264d23f3-254a-486b-a1b7-d9732011b87e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:25.996553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-264d23f3-254a-486b-a1b7-d9732011b87e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:26.002694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-264d23f3-254a-486b-a1b7-d9732011b87e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:26.003189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-264d23f3-254a-486b-a1b7-d9732011b87e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:26.003619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-264d23f3-254a-486b-a1b7-d9732011b87e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:26.004308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-264d23f3-254a-486b-a1b7-d9732011b87e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:26.004758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-264d23f3-254a-486b-a1b7-d9732011b87e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:26.005177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-264d23f3-254a-486b-a1b7-d9732011b87e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:26.035936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-264d23f3-254a-486b-a1b7-d9732011b87e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046176 Aug 24 05:13:26.036506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 677/1245] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:26.222968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fd5bdd15-85dd-47a9-aae2-dae5ef2acc50 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:26.225177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fd5bdd15-85dd-47a9-aae2-dae5ef2acc50 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:26.232432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd5bdd15-85dd-47a9-aae2-dae5ef2acc50 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:26.232913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd5bdd15-85dd-47a9-aae2-dae5ef2acc50 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:26.233347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd5bdd15-85dd-47a9-aae2-dae5ef2acc50 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:26.234048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd5bdd15-85dd-47a9-aae2-dae5ef2acc50 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:26.234503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd5bdd15-85dd-47a9-aae2-dae5ef2acc50 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:26.234952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd5bdd15-85dd-47a9-aae2-dae5ef2acc50 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:26.238860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:26.266376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fd5bdd15-85dd-47a9-aae2-dae5ef2acc50 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047441 Aug 24 05:13:26.266908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 569/1246] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:26.273469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b83ad4e8-516f-4433-858c-2429ffca41a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:26.275689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b83ad4e8-516f-4433-858c-2429ffca41a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:26.282191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83ad4e8-516f-4433-858c-2429ffca41a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:26.282659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83ad4e8-516f-4433-858c-2429ffca41a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:26.283115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83ad4e8-516f-4433-858c-2429ffca41a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:26.283797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83ad4e8-516f-4433-858c-2429ffca41a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:26.284238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83ad4e8-516f-4433-858c-2429ffca41a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:26.284650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b83ad4e8-516f-4433-858c-2429ffca41a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:26.315939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b83ad4e8-516f-4433-858c-2429ffca41a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046250 Aug 24 05:13:26.316495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 678/1247] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:27.048597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-326f1335-250d-4b6b-a09b-7b4efa251858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:27.050774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-326f1335-250d-4b6b-a09b-7b4efa251858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:27.057930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-326f1335-250d-4b6b-a09b-7b4efa251858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:27.058530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-326f1335-250d-4b6b-a09b-7b4efa251858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:27.058985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-326f1335-250d-4b6b-a09b-7b4efa251858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:27.059679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-326f1335-250d-4b6b-a09b-7b4efa251858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:27.060126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-326f1335-250d-4b6b-a09b-7b4efa251858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:27.060544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-326f1335-250d-4b6b-a09b-7b4efa251858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:27.091729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-326f1335-250d-4b6b-a09b-7b4efa251858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047065 Aug 24 05:13:27.092296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 570/1248] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:27.279376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-36a33a0e-be1d-44a7-b126-c3eceed07d46 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:27.281532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-36a33a0e-be1d-44a7-b126-c3eceed07d46 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:27.288310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36a33a0e-be1d-44a7-b126-c3eceed07d46 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:27.288787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36a33a0e-be1d-44a7-b126-c3eceed07d46 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:27.289218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36a33a0e-be1d-44a7-b126-c3eceed07d46 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:27.289908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36a33a0e-be1d-44a7-b126-c3eceed07d46 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:27.290354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36a33a0e-be1d-44a7-b126-c3eceed07d46 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:27.290796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36a33a0e-be1d-44a7-b126-c3eceed07d46 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:27.321572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-36a33a0e-be1d-44a7-b126-c3eceed07d46 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 Aug 24 05:13:27.322119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 679/1249] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:27 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:27.328876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-55b23eda-5a37-48be-9e88-1af4c3fc5114 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:27.331076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-55b23eda-5a37-48be-9e88-1af4c3fc5114 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:27.337637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55b23eda-5a37-48be-9e88-1af4c3fc5114 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:27.338262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55b23eda-5a37-48be-9e88-1af4c3fc5114 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:27.338761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55b23eda-5a37-48be-9e88-1af4c3fc5114 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:27.339492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55b23eda-5a37-48be-9e88-1af4c3fc5114 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:27.339936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55b23eda-5a37-48be-9e88-1af4c3fc5114 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:27.340350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55b23eda-5a37-48be-9e88-1af4c3fc5114 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:27.370943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-55b23eda-5a37-48be-9e88-1af4c3fc5114 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046428 Aug 24 05:13:27.371500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 571/1250] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:27 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:28.104930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4bc2eb6a-8334-43cd-932b-684da85a9867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:28.107144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4bc2eb6a-8334-43cd-932b-684da85a9867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:28.113270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bc2eb6a-8334-43cd-932b-684da85a9867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:28.113749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bc2eb6a-8334-43cd-932b-684da85a9867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:28.114180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bc2eb6a-8334-43cd-932b-684da85a9867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:28.114910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bc2eb6a-8334-43cd-932b-684da85a9867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:28.115357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bc2eb6a-8334-43cd-932b-684da85a9867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:28.115775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bc2eb6a-8334-43cd-932b-684da85a9867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:28.147599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4bc2eb6a-8334-43cd-932b-684da85a9867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047323 Aug 24 05:13:28.148161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 680/1251] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:28.335037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-48421c68-0e32-43a4-9b87-f87e5ffa8a9d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:28.337238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-48421c68-0e32-43a4-9b87-f87e5ffa8a9d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:28.344714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48421c68-0e32-43a4-9b87-f87e5ffa8a9d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:28.345242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48421c68-0e32-43a4-9b87-f87e5ffa8a9d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:28.345815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48421c68-0e32-43a4-9b87-f87e5ffa8a9d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:28.346516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48421c68-0e32-43a4-9b87-f87e5ffa8a9d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:28.347035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48421c68-0e32-43a4-9b87-f87e5ffa8a9d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:28.347486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48421c68-0e32-43a4-9b87-f87e5ffa8a9d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:28.382847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-48421c68-0e32-43a4-9b87-f87e5ffa8a9d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052148 Aug 24 05:13:28.383460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 572/1252] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:28.385289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ec83e36a-1f27-48b3-b634-7286321ab110 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:28.387570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ec83e36a-1f27-48b3-b634-7286321ab110 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:28.393997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec83e36a-1f27-48b3-b634-7286321ab110 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:28.394476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec83e36a-1f27-48b3-b634-7286321ab110 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:28.394947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec83e36a-1f27-48b3-b634-7286321ab110 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:28.395637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec83e36a-1f27-48b3-b634-7286321ab110 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:28.396088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec83e36a-1f27-48b3-b634-7286321ab110 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:28.396504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec83e36a-1f27-48b3-b634-7286321ab110 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:28.427805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ec83e36a-1f27-48b3-b634-7286321ab110 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047835 Aug 24 05:13:28.428281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 681/1253] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:29.159948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9b236054-0708-44ef-944a-870763969e4a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:29.162158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9b236054-0708-44ef-944a-870763969e4a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:29.168454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b236054-0708-44ef-944a-870763969e4a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:29.168941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b236054-0708-44ef-944a-870763969e4a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:29.169378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b236054-0708-44ef-944a-870763969e4a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:29.170075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b236054-0708-44ef-944a-870763969e4a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:29.170530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b236054-0708-44ef-944a-870763969e4a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:29.170975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b236054-0708-44ef-944a-870763969e4a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:29.202343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9b236054-0708-44ef-944a-870763969e4a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046478 Aug 24 05:13:29.202943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 573/1254] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:29.395637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f2bb8f0a-02e8-4f34-8f35-7f13aed944a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:29.397802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f2bb8f0a-02e8-4f34-8f35-7f13aed944a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:29.404835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2bb8f0a-02e8-4f34-8f35-7f13aed944a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:29.405322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2bb8f0a-02e8-4f34-8f35-7f13aed944a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:29.405756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2bb8f0a-02e8-4f34-8f35-7f13aed944a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:29.406454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2bb8f0a-02e8-4f34-8f35-7f13aed944a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:29.406927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2bb8f0a-02e8-4f34-8f35-7f13aed944a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:29.407356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2bb8f0a-02e8-4f34-8f35-7f13aed944a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:29.438837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f2bb8f0a-02e8-4f34-8f35-7f13aed944a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047127 Aug 24 05:13:29.439411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 682/1255] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:29.440989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b51dbca3-6f16-4037-907e-3dda10c16d8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:29.443163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b51dbca3-6f16-4037-907e-3dda10c16d8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:29.450322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51dbca3-6f16-4037-907e-3dda10c16d8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:29.450835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51dbca3-6f16-4037-907e-3dda10c16d8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:29.451268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51dbca3-6f16-4037-907e-3dda10c16d8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:29.451959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51dbca3-6f16-4037-907e-3dda10c16d8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:29.452402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51dbca3-6f16-4037-907e-3dda10c16d8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:29.452818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b51dbca3-6f16-4037-907e-3dda10c16d8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:29.483440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b51dbca3-6f16-4037-907e-3dda10c16d8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046606 Aug 24 05:13:29.484022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 574/1256] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:30.216715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0f10b9c0-78e1-4cc2-9bd2-9f60b8c6f479 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:30.221035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0f10b9c0-78e1-4cc2-9bd2-9f60b8c6f479 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:30.227220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f10b9c0-78e1-4cc2-9bd2-9f60b8c6f479 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:30.227701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f10b9c0-78e1-4cc2-9bd2-9f60b8c6f479 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:30.228188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f10b9c0-78e1-4cc2-9bd2-9f60b8c6f479 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:30.228833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f10b9c0-78e1-4cc2-9bd2-9f60b8c6f479 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:30.229352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f10b9c0-78e1-4cc2-9bd2-9f60b8c6f479 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:30.229706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f10b9c0-78e1-4cc2-9bd2-9f60b8c6f479 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:30.264250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0f10b9c0-78e1-4cc2-9bd2-9f60b8c6f479 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052525 Aug 24 05:13:30.264822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 683/1257] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:30.453220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3a2c8dfb-9c08-435f-83da-c97c2cde5431 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:30.455391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3a2c8dfb-9c08-435f-83da-c97c2cde5431 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:30.461927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a2c8dfb-9c08-435f-83da-c97c2cde5431 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:30.462412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a2c8dfb-9c08-435f-83da-c97c2cde5431 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:30.462902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a2c8dfb-9c08-435f-83da-c97c2cde5431 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:30.463614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a2c8dfb-9c08-435f-83da-c97c2cde5431 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:30.464059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a2c8dfb-9c08-435f-83da-c97c2cde5431 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:30.464484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a2c8dfb-9c08-435f-83da-c97c2cde5431 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:30.496694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-221645f6-6687-4c72-8229-d50179d4f324 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:30.498585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3a2c8dfb-9c08-435f-83da-c97c2cde5431 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049381 Aug 24 05:13:30.499067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-221645f6-6687-4c72-8229-d50179d4f324 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:30.499197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 575/1258] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:30.505975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-221645f6-6687-4c72-8229-d50179d4f324 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:30.506452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-221645f6-6687-4c72-8229-d50179d4f324 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:30.506917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-221645f6-6687-4c72-8229-d50179d4f324 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:30.507614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-221645f6-6687-4c72-8229-d50179d4f324 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:30.508065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-221645f6-6687-4c72-8229-d50179d4f324 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:30.508486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-221645f6-6687-4c72-8229-d50179d4f324 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:30.545304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-221645f6-6687-4c72-8229-d50179d4f324 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053524 Aug 24 05:13:30.545865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 684/1259] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:31.276798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8e3cb7d9-ba8c-47dc-bf5e-f9a43fa84bb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:31.278947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8e3cb7d9-ba8c-47dc-bf5e-f9a43fa84bb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:31.284977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e3cb7d9-ba8c-47dc-bf5e-f9a43fa84bb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:31.285455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e3cb7d9-ba8c-47dc-bf5e-f9a43fa84bb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:31.285885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e3cb7d9-ba8c-47dc-bf5e-f9a43fa84bb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:31.286574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e3cb7d9-ba8c-47dc-bf5e-f9a43fa84bb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:31.287058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e3cb7d9-ba8c-47dc-bf5e-f9a43fa84bb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:31.287505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8e3cb7d9-ba8c-47dc-bf5e-f9a43fa84bb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:31.319777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8e3cb7d9-ba8c-47dc-bf5e-f9a43fa84bb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047095 Aug 24 05:13:31.320348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 576/1260] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:31.511353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e232cd07-1c0c-4f80-adfa-6537756efeb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:31.513491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e232cd07-1c0c-4f80-adfa-6537756efeb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:31.520234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e232cd07-1c0c-4f80-adfa-6537756efeb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:31.520715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e232cd07-1c0c-4f80-adfa-6537756efeb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:31.521147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e232cd07-1c0c-4f80-adfa-6537756efeb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:31.521839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e232cd07-1c0c-4f80-adfa-6537756efeb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:31.522313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e232cd07-1c0c-4f80-adfa-6537756efeb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:31.522832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e232cd07-1c0c-4f80-adfa-6537756efeb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:31.554029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e232cd07-1c0c-4f80-adfa-6537756efeb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046874 Aug 24 05:13:31.554510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 685/1261] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:31.558941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-afe3f898-2a17-4232-81af-1220c80dcae1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:31.561082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-afe3f898-2a17-4232-81af-1220c80dcae1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:31.567692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe3f898-2a17-4232-81af-1220c80dcae1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:31.568167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe3f898-2a17-4232-81af-1220c80dcae1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:31.568599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe3f898-2a17-4232-81af-1220c80dcae1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:31.569284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe3f898-2a17-4232-81af-1220c80dcae1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:31.569729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe3f898-2a17-4232-81af-1220c80dcae1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:31.570146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe3f898-2a17-4232-81af-1220c80dcae1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:31.601224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-afe3f898-2a17-4232-81af-1220c80dcae1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047349 Aug 24 05:13:31.601795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 577/1262] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:32.332194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-21bbb9e4-0195-4765-bfec-95454a432707 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:32.334296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-21bbb9e4-0195-4765-bfec-95454a432707 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:32.341619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21bbb9e4-0195-4765-bfec-95454a432707 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:32.342109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21bbb9e4-0195-4765-bfec-95454a432707 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:32.342557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21bbb9e4-0195-4765-bfec-95454a432707 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:32.343291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21bbb9e4-0195-4765-bfec-95454a432707 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:32.343732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21bbb9e4-0195-4765-bfec-95454a432707 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:32.344174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21bbb9e4-0195-4765-bfec-95454a432707 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:32.376032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-21bbb9e4-0195-4765-bfec-95454a432707 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047791 Aug 24 05:13:32.376589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 686/1263] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:32.567515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-47b5b8dd-ff12-4e35-9457-3a0495d7ae05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:32.569674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-47b5b8dd-ff12-4e35-9457-3a0495d7ae05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:32.572875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=88 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:32.578727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47b5b8dd-ff12-4e35-9457-3a0495d7ae05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:32.579541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47b5b8dd-ff12-4e35-9457-3a0495d7ae05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:32.581155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47b5b8dd-ff12-4e35-9457-3a0495d7ae05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:32.581859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47b5b8dd-ff12-4e35-9457-3a0495d7ae05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:32.582361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47b5b8dd-ff12-4e35-9457-3a0495d7ae05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:32.582757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47b5b8dd-ff12-4e35-9457-3a0495d7ae05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:32.613606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6ed4b1a0-9305-4eee-a886-b07be1dbd3da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:32.614622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-47b5b8dd-ff12-4e35-9457-3a0495d7ae05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051368 Aug 24 05:13:32.615229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 578/1264] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:32.616158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6ed4b1a0-9305-4eee-a886-b07be1dbd3da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:32.623264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ed4b1a0-9305-4eee-a886-b07be1dbd3da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:32.623794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ed4b1a0-9305-4eee-a886-b07be1dbd3da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:32.624181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ed4b1a0-9305-4eee-a886-b07be1dbd3da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:32.624886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ed4b1a0-9305-4eee-a886-b07be1dbd3da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:32.625333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ed4b1a0-9305-4eee-a886-b07be1dbd3da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:32.625751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ed4b1a0-9305-4eee-a886-b07be1dbd3da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:32.656520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6ed4b1a0-9305-4eee-a886-b07be1dbd3da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046794 Aug 24 05:13:32.657102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 687/1265] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:33.389807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fb6f3469-0fec-4825-94fc-212123a86308 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:33.392041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fb6f3469-0fec-4825-94fc-212123a86308 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:33.398084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6f3469-0fec-4825-94fc-212123a86308 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:33.398560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6f3469-0fec-4825-94fc-212123a86308 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:33.399030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6f3469-0fec-4825-94fc-212123a86308 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:33.399721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6f3469-0fec-4825-94fc-212123a86308 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:33.400166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6f3469-0fec-4825-94fc-212123a86308 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:33.400804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6f3469-0fec-4825-94fc-212123a86308 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:33.430823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fb6f3469-0fec-4825-94fc-212123a86308 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044911 Aug 24 05:13:33.431379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 579/1266] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:33.629758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bc7a24b0-25c3-4ae4-886b-215fc7453366 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:33.631949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bc7a24b0-25c3-4ae4-886b-215fc7453366 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:33.638069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc7a24b0-25c3-4ae4-886b-215fc7453366 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:33.638546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc7a24b0-25c3-4ae4-886b-215fc7453366 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:33.639021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc7a24b0-25c3-4ae4-886b-215fc7453366 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:33.639716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc7a24b0-25c3-4ae4-886b-215fc7453366 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:33.640226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc7a24b0-25c3-4ae4-886b-215fc7453366 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:33.640590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc7a24b0-25c3-4ae4-886b-215fc7453366 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:33.669660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9f3d766e-41fe-458b-973f-07977414463a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:33.671934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9f3d766e-41fe-458b-973f-07977414463a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:33.672108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bc7a24b0-25c3-4ae4-886b-215fc7453366 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046930 Aug 24 05:13:33.672690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 688/1267] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:33 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:33.680639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f3d766e-41fe-458b-973f-07977414463a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:33.681120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f3d766e-41fe-458b-973f-07977414463a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:33.681636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f3d766e-41fe-458b-973f-07977414463a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:33.683092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f3d766e-41fe-458b-973f-07977414463a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:33.683542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f3d766e-41fe-458b-973f-07977414463a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:33.683963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f3d766e-41fe-458b-973f-07977414463a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:33.714305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9f3d766e-41fe-458b-973f-07977414463a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049314 Aug 24 05:13:33.714899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 580/1268] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:34.444277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2438c593-1e1a-47d0-8f85-839963474aa4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:34.446414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2438c593-1e1a-47d0-8f85-839963474aa4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:34.453282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2438c593-1e1a-47d0-8f85-839963474aa4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:34.453682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2438c593-1e1a-47d0-8f85-839963474aa4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:34.454105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2438c593-1e1a-47d0-8f85-839963474aa4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:34.454816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2438c593-1e1a-47d0-8f85-839963474aa4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:34.455260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2438c593-1e1a-47d0-8f85-839963474aa4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:34.455674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2438c593-1e1a-47d0-8f85-839963474aa4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:34.486494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2438c593-1e1a-47d0-8f85-839963474aa4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046128 Aug 24 05:13:34.487101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 689/1269] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:34.684877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9e20a37a-04d6-4881-9d55-46af818c9bb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:34.687025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9e20a37a-04d6-4881-9d55-46af818c9bb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:34.693489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e20a37a-04d6-4881-9d55-46af818c9bb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:34.693961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e20a37a-04d6-4881-9d55-46af818c9bb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:34.694388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e20a37a-04d6-4881-9d55-46af818c9bb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:34.695101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e20a37a-04d6-4881-9d55-46af818c9bb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:34.695547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e20a37a-04d6-4881-9d55-46af818c9bb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:34.695965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e20a37a-04d6-4881-9d55-46af818c9bb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:34.727065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1165e4d1-ab1d-4750-9793-653b31c31f3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:34.729114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9e20a37a-04d6-4881-9d55-46af818c9bb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047780 Aug 24 05:13:34.730138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 581/1270] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:34.733458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1165e4d1-ab1d-4750-9793-653b31c31f3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:34.740525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1165e4d1-ab1d-4750-9793-653b31c31f3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:34.741005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1165e4d1-ab1d-4750-9793-653b31c31f3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:34.741436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1165e4d1-ab1d-4750-9793-653b31c31f3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:34.742131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1165e4d1-ab1d-4750-9793-653b31c31f3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:34.742574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1165e4d1-ab1d-4750-9793-653b31c31f3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:34.743017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1165e4d1-ab1d-4750-9793-653b31c31f3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:34.775343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1165e4d1-ab1d-4750-9793-653b31c31f3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052323 Aug 24 05:13:34.775920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 690/1271] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:34 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:35.499312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-339a0397-b5c7-431e-839e-368530d0e0d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:35.501433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-339a0397-b5c7-431e-839e-368530d0e0d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:35.507646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-339a0397-b5c7-431e-839e-368530d0e0d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:35.508122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-339a0397-b5c7-431e-839e-368530d0e0d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:35.508589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-339a0397-b5c7-431e-839e-368530d0e0d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:35.509279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-339a0397-b5c7-431e-839e-368530d0e0d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:35.509806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-339a0397-b5c7-431e-839e-368530d0e0d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:35.510366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-339a0397-b5c7-431e-839e-368530d0e0d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:35.543165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-339a0397-b5c7-431e-839e-368530d0e0d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048044 Aug 24 05:13:35.543929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 582/1272] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:35.740403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d4b1b70a-23aa-4ed3-9837-5e70d871950a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:35.742532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d4b1b70a-23aa-4ed3-9837-5e70d871950a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:35.749186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d4b1b70a-23aa-4ed3-9837-5e70d871950a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:35.749726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d4b1b70a-23aa-4ed3-9837-5e70d871950a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:35.750097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d4b1b70a-23aa-4ed3-9837-5e70d871950a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:35.750817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d4b1b70a-23aa-4ed3-9837-5e70d871950a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:35.751265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d4b1b70a-23aa-4ed3-9837-5e70d871950a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:35.751684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d4b1b70a-23aa-4ed3-9837-5e70d871950a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:35.783774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d4b1b70a-23aa-4ed3-9837-5e70d871950a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047292 Aug 24 05:13:35.784476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 691/1273] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:35 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:35.787960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9b5324e8-a4e7-48f4-9fcd-b4e27ff18749 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:35.790076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9b5324e8-a4e7-48f4-9fcd-b4e27ff18749 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:35.796818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b5324e8-a4e7-48f4-9fcd-b4e27ff18749 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:35.797299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b5324e8-a4e7-48f4-9fcd-b4e27ff18749 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:35.797727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b5324e8-a4e7-48f4-9fcd-b4e27ff18749 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:35.798417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b5324e8-a4e7-48f4-9fcd-b4e27ff18749 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:35.798891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b5324e8-a4e7-48f4-9fcd-b4e27ff18749 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:35.799307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b5324e8-a4e7-48f4-9fcd-b4e27ff18749 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:35.831062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9b5324e8-a4e7-48f4-9fcd-b4e27ff18749 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047071 Aug 24 05:13:35.831639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 583/1274] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:36.559562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a78387ba-9ec0-4994-bfdc-6139571e9b1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:36.561652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a78387ba-9ec0-4994-bfdc-6139571e9b1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:36.568084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a78387ba-9ec0-4994-bfdc-6139571e9b1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:36.568570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a78387ba-9ec0-4994-bfdc-6139571e9b1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:36.569008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a78387ba-9ec0-4994-bfdc-6139571e9b1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:36.569700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a78387ba-9ec0-4994-bfdc-6139571e9b1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:36.570150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a78387ba-9ec0-4994-bfdc-6139571e9b1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:36.570570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a78387ba-9ec0-4994-bfdc-6139571e9b1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:36.601898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a78387ba-9ec0-4994-bfdc-6139571e9b1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047299 Aug 24 05:13:36.602454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 692/1275] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:36.796679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5223ff1f-7ce1-4105-b173-93548d28a895 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:36.798878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5223ff1f-7ce1-4105-b173-93548d28a895 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:36.805666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5223ff1f-7ce1-4105-b173-93548d28a895 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:36.806146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5223ff1f-7ce1-4105-b173-93548d28a895 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:36.807292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5223ff1f-7ce1-4105-b173-93548d28a895 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:36.807993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5223ff1f-7ce1-4105-b173-93548d28a895 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:36.808530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5223ff1f-7ce1-4105-b173-93548d28a895 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:36.808888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5223ff1f-7ce1-4105-b173-93548d28a895 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:36.840170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5223ff1f-7ce1-4105-b173-93548d28a895 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047394 Aug 24 05:13:36.840746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 584/1276] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:36 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:36.844003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9df85254-73dd-4660-8926-5b3aafa7936d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:36.846176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9df85254-73dd-4660-8926-5b3aafa7936d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:36.852884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9df85254-73dd-4660-8926-5b3aafa7936d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:36.854256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9df85254-73dd-4660-8926-5b3aafa7936d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:36.854679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9df85254-73dd-4660-8926-5b3aafa7936d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:36.855436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9df85254-73dd-4660-8926-5b3aafa7936d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:36.855879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9df85254-73dd-4660-8926-5b3aafa7936d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:36.856292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9df85254-73dd-4660-8926-5b3aafa7936d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:36.860152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:36.887214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9df85254-73dd-4660-8926-5b3aafa7936d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047135 Aug 24 05:13:36.887775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 693/1277] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:37.616079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-61a8f01c-9884-42f0-970d-3dba39fb873d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:37.618236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-61a8f01c-9884-42f0-970d-3dba39fb873d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:37.625594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61a8f01c-9884-42f0-970d-3dba39fb873d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:37.626085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61a8f01c-9884-42f0-970d-3dba39fb873d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:37.626527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61a8f01c-9884-42f0-970d-3dba39fb873d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:37.627293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61a8f01c-9884-42f0-970d-3dba39fb873d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:37.627749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61a8f01c-9884-42f0-970d-3dba39fb873d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:37.628177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61a8f01c-9884-42f0-970d-3dba39fb873d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:37.654958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:37.660638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-61a8f01c-9884-42f0-970d-3dba39fb873d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048596 Aug 24 05:13:37.661207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 585/1278] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:37.852517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-65e3034c-abfa-48d1-bddc-06f3efd5f8cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:37.854813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-65e3034c-abfa-48d1-bddc-06f3efd5f8cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:37.857108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=88 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:37.862607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65e3034c-abfa-48d1-bddc-06f3efd5f8cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:37.863107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65e3034c-abfa-48d1-bddc-06f3efd5f8cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:37.863529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65e3034c-abfa-48d1-bddc-06f3efd5f8cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:37.864210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65e3034c-abfa-48d1-bddc-06f3efd5f8cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:37.864646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65e3034c-abfa-48d1-bddc-06f3efd5f8cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:37.865053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65e3034c-abfa-48d1-bddc-06f3efd5f8cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:37.897483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-65e3034c-abfa-48d1-bddc-06f3efd5f8cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048805 Aug 24 05:13:37.897964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 694/1279] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:37.899809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e4255882-c9e4-418f-846a-99422b327b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:37.902242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e4255882-c9e4-418f-846a-99422b327b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:37.908773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4255882-c9e4-418f-846a-99422b327b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:37.909252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4255882-c9e4-418f-846a-99422b327b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:37.909684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4255882-c9e4-418f-846a-99422b327b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:37.910374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4255882-c9e4-418f-846a-99422b327b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:37.910868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4255882-c9e4-418f-846a-99422b327b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:37.911285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4255882-c9e4-418f-846a-99422b327b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:37.942937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e4255882-c9e4-418f-846a-99422b327b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046951 Aug 24 05:13:37.943495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 586/1280] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:38.673383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ccb977a0-8670-4538-835e-db29b83f70ec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:38.675457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ccb977a0-8670-4538-835e-db29b83f70ec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:38.681932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccb977a0-8670-4538-835e-db29b83f70ec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:38.682412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccb977a0-8670-4538-835e-db29b83f70ec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:38.682880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccb977a0-8670-4538-835e-db29b83f70ec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:38.683578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccb977a0-8670-4538-835e-db29b83f70ec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:38.684028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccb977a0-8670-4538-835e-db29b83f70ec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:38.684443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccb977a0-8670-4538-835e-db29b83f70ec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:38.715583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ccb977a0-8670-4538-835e-db29b83f70ec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046159 Aug 24 05:13:38.716148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 695/1281] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:38.909657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1b39120b-fd4d-40f6-81f1-64060b42c290 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:38.911822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1b39120b-fd4d-40f6-81f1-64060b42c290 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:38.918755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b39120b-fd4d-40f6-81f1-64060b42c290 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:38.919233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b39120b-fd4d-40f6-81f1-64060b42c290 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:38.919661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b39120b-fd4d-40f6-81f1-64060b42c290 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:38.920376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b39120b-fd4d-40f6-81f1-64060b42c290 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:38.920820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b39120b-fd4d-40f6-81f1-64060b42c290 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:38.921234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b39120b-fd4d-40f6-81f1-64060b42c290 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:38.953095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1b39120b-fd4d-40f6-81f1-64060b42c290 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047375 Aug 24 05:13:38.953659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 587/1282] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:38.955895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-29290511-b350-4b3f-8851-41eae3ccd4ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:38.958108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-29290511-b350-4b3f-8851-41eae3ccd4ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:38.965690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29290511-b350-4b3f-8851-41eae3ccd4ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:38.966168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29290511-b350-4b3f-8851-41eae3ccd4ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:38.966601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29290511-b350-4b3f-8851-41eae3ccd4ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:38.967328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29290511-b350-4b3f-8851-41eae3ccd4ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:38.967772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29290511-b350-4b3f-8851-41eae3ccd4ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:38.968219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29290511-b350-4b3f-8851-41eae3ccd4ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:38.999555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-29290511-b350-4b3f-8851-41eae3ccd4ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047606 Aug 24 05:13:39.000155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 696/1283] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:39.728186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d730ca35-85c7-451e-8e1c-741badb2b261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:39.731190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d730ca35-85c7-451e-8e1c-741badb2b261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:39.737457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d730ca35-85c7-451e-8e1c-741badb2b261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:39.737946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d730ca35-85c7-451e-8e1c-741badb2b261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:39.738386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d730ca35-85c7-451e-8e1c-741badb2b261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:39.739114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d730ca35-85c7-451e-8e1c-741badb2b261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:39.739571 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d730ca35-85c7-451e-8e1c-741badb2b261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:39.739992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d730ca35-85c7-451e-8e1c-741badb2b261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:39.771815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d730ca35-85c7-451e-8e1c-741badb2b261 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047722 Aug 24 05:13:39.772376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 588/1284] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:39.966555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b86ab011-f402-4275-9527-d2c6c1cf3795 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:39.968728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b86ab011-f402-4275-9527-d2c6c1cf3795 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:39.975215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b86ab011-f402-4275-9527-d2c6c1cf3795 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:39.975683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b86ab011-f402-4275-9527-d2c6c1cf3795 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:39.976110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b86ab011-f402-4275-9527-d2c6c1cf3795 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:39.976787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b86ab011-f402-4275-9527-d2c6c1cf3795 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:39.977224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b86ab011-f402-4275-9527-d2c6c1cf3795 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:39.977632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b86ab011-f402-4275-9527-d2c6c1cf3795 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:40.007936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b86ab011-f402-4275-9527-d2c6c1cf3795 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Aug 24 05:13:40.008535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 697/1285] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:40.012978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-02d94fd7-e939-423f-9477-3750f5ea83d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:40.016219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-02d94fd7-e939-423f-9477-3750f5ea83d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:40.023454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d94fd7-e939-423f-9477-3750f5ea83d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:40.023946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d94fd7-e939-423f-9477-3750f5ea83d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:40.024431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d94fd7-e939-423f-9477-3750f5ea83d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:40.025658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d94fd7-e939-423f-9477-3750f5ea83d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:40.026092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d94fd7-e939-423f-9477-3750f5ea83d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:40.026544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02d94fd7-e939-423f-9477-3750f5ea83d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:40.057391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-02d94fd7-e939-423f-9477-3750f5ea83d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049353 Aug 24 05:13:40.057958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 589/1286] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:40.783833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-44b43d4e-66f8-4231-a555-cb4c03a83c62 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:40.786141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-44b43d4e-66f8-4231-a555-cb4c03a83c62 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:40.792597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b43d4e-66f8-4231-a555-cb4c03a83c62 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:40.793012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b43d4e-66f8-4231-a555-cb4c03a83c62 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:40.793461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b43d4e-66f8-4231-a555-cb4c03a83c62 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:40.794163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b43d4e-66f8-4231-a555-cb4c03a83c62 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:40.794603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b43d4e-66f8-4231-a555-cb4c03a83c62 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:40.795096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-44b43d4e-66f8-4231-a555-cb4c03a83c62 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:40.827099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-44b43d4e-66f8-4231-a555-cb4c03a83c62 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047217 Aug 24 05:13:40.827668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 698/1287] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:41.020420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ffd3af0c-3660-4703-a9e3-ae38a1f30c93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:41.022550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ffd3af0c-3660-4703-a9e3-ae38a1f30c93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:41.029228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd3af0c-3660-4703-a9e3-ae38a1f30c93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:41.029702 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd3af0c-3660-4703-a9e3-ae38a1f30c93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:41.030130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd3af0c-3660-4703-a9e3-ae38a1f30c93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:41.030914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd3af0c-3660-4703-a9e3-ae38a1f30c93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:41.031360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd3af0c-3660-4703-a9e3-ae38a1f30c93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:41.031775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd3af0c-3660-4703-a9e3-ae38a1f30c93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:41.063968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ffd3af0c-3660-4703-a9e3-ae38a1f30c93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047516 Aug 24 05:13:41.064532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 590/1288] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:41.069647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-63d9c9c9-e4ff-4f44-a41b-d5f88f72a1a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:41.071815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-63d9c9c9-e4ff-4f44-a41b-d5f88f72a1a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:41.078458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63d9c9c9-e4ff-4f44-a41b-d5f88f72a1a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:41.078962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63d9c9c9-e4ff-4f44-a41b-d5f88f72a1a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:41.079398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63d9c9c9-e4ff-4f44-a41b-d5f88f72a1a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:41.080081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63d9c9c9-e4ff-4f44-a41b-d5f88f72a1a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:41.080525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63d9c9c9-e4ff-4f44-a41b-d5f88f72a1a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:41.080943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63d9c9c9-e4ff-4f44-a41b-d5f88f72a1a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:41.112360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-63d9c9c9-e4ff-4f44-a41b-d5f88f72a1a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046616 Aug 24 05:13:41.112922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 699/1289] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:41 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:41.840344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5377ab52-fff8-41b5-9e6d-5259b10993ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:41.842508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5377ab52-fff8-41b5-9e6d-5259b10993ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:41.848677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5377ab52-fff8-41b5-9e6d-5259b10993ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:41.849163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5377ab52-fff8-41b5-9e6d-5259b10993ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:41.849599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5377ab52-fff8-41b5-9e6d-5259b10993ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:41.850298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5377ab52-fff8-41b5-9e6d-5259b10993ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:41.850785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5377ab52-fff8-41b5-9e6d-5259b10993ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:41.851211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5377ab52-fff8-41b5-9e6d-5259b10993ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:41.881294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5377ab52-fff8-41b5-9e6d-5259b10993ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045579 Aug 24 05:13:41.881911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 591/1290] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:42.076755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9c294ae9-51f1-4f8c-8c07-4e9925f9f201 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:42.078838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9c294ae9-51f1-4f8c-8c07-4e9925f9f201 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:42.085494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c294ae9-51f1-4f8c-8c07-4e9925f9f201 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:42.085976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c294ae9-51f1-4f8c-8c07-4e9925f9f201 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:42.086412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c294ae9-51f1-4f8c-8c07-4e9925f9f201 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:42.087138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c294ae9-51f1-4f8c-8c07-4e9925f9f201 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:42.087656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c294ae9-51f1-4f8c-8c07-4e9925f9f201 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:42.088596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c294ae9-51f1-4f8c-8c07-4e9925f9f201 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:42.118784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9c294ae9-51f1-4f8c-8c07-4e9925f9f201 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046512 Aug 24 05:13:42.120270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 700/1291] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:42.125424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-65d1e4d4-08e1-4e6b-9914-ac95242cec5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:42.127613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-65d1e4d4-08e1-4e6b-9914-ac95242cec5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:42.134173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65d1e4d4-08e1-4e6b-9914-ac95242cec5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:42.135300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65d1e4d4-08e1-4e6b-9914-ac95242cec5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:42.135715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65d1e4d4-08e1-4e6b-9914-ac95242cec5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:42.136413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65d1e4d4-08e1-4e6b-9914-ac95242cec5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:42.136864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65d1e4d4-08e1-4e6b-9914-ac95242cec5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:42.137287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65d1e4d4-08e1-4e6b-9914-ac95242cec5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:42.169118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-65d1e4d4-08e1-4e6b-9914-ac95242cec5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047731 Aug 24 05:13:42.169684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 592/1292] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:42.894251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d900e090-c0d2-4e9f-bf63-7c71b43a776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:42.896346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d900e090-c0d2-4e9f-bf63-7c71b43a776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:42.903419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d900e090-c0d2-4e9f-bf63-7c71b43a776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:42.903900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d900e090-c0d2-4e9f-bf63-7c71b43a776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:42.904331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d900e090-c0d2-4e9f-bf63-7c71b43a776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:42.905027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d900e090-c0d2-4e9f-bf63-7c71b43a776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:42.905469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d900e090-c0d2-4e9f-bf63-7c71b43a776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:42.905883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d900e090-c0d2-4e9f-bf63-7c71b43a776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:42.937301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d900e090-c0d2-4e9f-bf63-7c71b43a776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047060 Aug 24 05:13:42.937858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 701/1293] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:43.132490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fe30d5da-1d1d-4165-af3b-45dbe5af99b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:43.134888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fe30d5da-1d1d-4165-af3b-45dbe5af99b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:43.141484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe30d5da-1d1d-4165-af3b-45dbe5af99b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:43.141997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe30d5da-1d1d-4165-af3b-45dbe5af99b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:43.142428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe30d5da-1d1d-4165-af3b-45dbe5af99b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:43.143242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe30d5da-1d1d-4165-af3b-45dbe5af99b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:43.143696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe30d5da-1d1d-4165-af3b-45dbe5af99b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:43.144138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe30d5da-1d1d-4165-af3b-45dbe5af99b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:43.175734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fe30d5da-1d1d-4165-af3b-45dbe5af99b6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047118 Aug 24 05:13:43.176496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 593/1294] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:43 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:43.181764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-85a2435a-ac94-468a-83c4-2bf0eb59811e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:43.184013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-85a2435a-ac94-468a-83c4-2bf0eb59811e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:43.190409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85a2435a-ac94-468a-83c4-2bf0eb59811e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:43.190929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85a2435a-ac94-468a-83c4-2bf0eb59811e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:43.191362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85a2435a-ac94-468a-83c4-2bf0eb59811e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:43.192047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85a2435a-ac94-468a-83c4-2bf0eb59811e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:43.192491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85a2435a-ac94-468a-83c4-2bf0eb59811e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:43.192906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85a2435a-ac94-468a-83c4-2bf0eb59811e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:43.224414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-85a2435a-ac94-468a-83c4-2bf0eb59811e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046556 Aug 24 05:13:43.225000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 702/1295] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:43.950228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-19227c14-16c0-4676-925d-849abec7aced tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:43.952385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-19227c14-16c0-4676-925d-849abec7aced tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:43.958529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19227c14-16c0-4676-925d-849abec7aced tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:43.959043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19227c14-16c0-4676-925d-849abec7aced tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:43.959483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19227c14-16c0-4676-925d-849abec7aced tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:43.960180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19227c14-16c0-4676-925d-849abec7aced tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:43.960635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19227c14-16c0-4676-925d-849abec7aced tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:43.961059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19227c14-16c0-4676-925d-849abec7aced tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:43.993266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-19227c14-16c0-4676-925d-849abec7aced tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047553 Aug 24 05:13:43.994536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 594/1296] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:44.189583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-06fec4e6-c441-4c34-93ba-d0ef0efac0d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:44.191757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-06fec4e6-c441-4c34-93ba-d0ef0efac0d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:44.198856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fec4e6-c441-4c34-93ba-d0ef0efac0d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:44.199321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fec4e6-c441-4c34-93ba-d0ef0efac0d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:44.199746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fec4e6-c441-4c34-93ba-d0ef0efac0d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:44.200480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fec4e6-c441-4c34-93ba-d0ef0efac0d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:44.200867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fec4e6-c441-4c34-93ba-d0ef0efac0d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:44.201281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fec4e6-c441-4c34-93ba-d0ef0efac0d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:44.232586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-06fec4e6-c441-4c34-93ba-d0ef0efac0d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046873 Aug 24 05:13:44.233147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 703/1297] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:44.237390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-73331a23-6a6a-4ec5-84b9-50fa72f741f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:44.239617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-73331a23-6a6a-4ec5-84b9-50fa72f741f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:44.246831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73331a23-6a6a-4ec5-84b9-50fa72f741f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:44.247311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73331a23-6a6a-4ec5-84b9-50fa72f741f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:44.247743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73331a23-6a6a-4ec5-84b9-50fa72f741f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:44.248439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73331a23-6a6a-4ec5-84b9-50fa72f741f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:44.248988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73331a23-6a6a-4ec5-84b9-50fa72f741f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:44.249414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73331a23-6a6a-4ec5-84b9-50fa72f741f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:44.280534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-73331a23-6a6a-4ec5-84b9-50fa72f741f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047279 Aug 24 05:13:44.281098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 595/1298] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:45.005904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-255fd41a-4d2e-4dff-a44b-6520bdc16e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:45.008042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-255fd41a-4d2e-4dff-a44b-6520bdc16e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:45.014827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-255fd41a-4d2e-4dff-a44b-6520bdc16e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:45.015311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-255fd41a-4d2e-4dff-a44b-6520bdc16e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:45.015746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-255fd41a-4d2e-4dff-a44b-6520bdc16e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:45.016473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-255fd41a-4d2e-4dff-a44b-6520bdc16e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:45.016961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-255fd41a-4d2e-4dff-a44b-6520bdc16e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:45.017473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-255fd41a-4d2e-4dff-a44b-6520bdc16e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:45.052760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-255fd41a-4d2e-4dff-a44b-6520bdc16e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051072 Aug 24 05:13:45.053318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 704/1299] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:45.245830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-052758c1-f440-4591-b04a-9964c9a3df1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:45.248238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-052758c1-f440-4591-b04a-9964c9a3df1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:45.255422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-052758c1-f440-4591-b04a-9964c9a3df1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:45.255904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-052758c1-f440-4591-b04a-9964c9a3df1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:45.256339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-052758c1-f440-4591-b04a-9964c9a3df1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:45.257040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-052758c1-f440-4591-b04a-9964c9a3df1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:45.257492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-052758c1-f440-4591-b04a-9964c9a3df1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:45.257915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-052758c1-f440-4591-b04a-9964c9a3df1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:45.290186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-052758c1-f440-4591-b04a-9964c9a3df1a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049303 Aug 24 05:13:45.291076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 596/1300] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:45 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:45.292932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d3c852f8-cad4-41de-b728-678c2af84d53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:45.295110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d3c852f8-cad4-41de-b728-678c2af84d53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:45.301668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3c852f8-cad4-41de-b728-678c2af84d53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:45.302143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3c852f8-cad4-41de-b728-678c2af84d53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:45.302576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3c852f8-cad4-41de-b728-678c2af84d53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:45.303317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3c852f8-cad4-41de-b728-678c2af84d53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:45.303768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3c852f8-cad4-41de-b728-678c2af84d53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:45.304190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3c852f8-cad4-41de-b728-678c2af84d53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:45.345759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d3c852f8-cad4-41de-b728-678c2af84d53 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056741 Aug 24 05:13:45.346320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 705/1301] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:46.066101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e4f5ee9b-d0de-41ac-bc6b-458719b24afb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:46.068296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e4f5ee9b-d0de-41ac-bc6b-458719b24afb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:46.074726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4f5ee9b-d0de-41ac-bc6b-458719b24afb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:46.075218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4f5ee9b-d0de-41ac-bc6b-458719b24afb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:46.075663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4f5ee9b-d0de-41ac-bc6b-458719b24afb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:46.076362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4f5ee9b-d0de-41ac-bc6b-458719b24afb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:46.076814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4f5ee9b-d0de-41ac-bc6b-458719b24afb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:46.077250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4f5ee9b-d0de-41ac-bc6b-458719b24afb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:46.108735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e4f5ee9b-d0de-41ac-bc6b-458719b24afb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046908 Aug 24 05:13:46.109295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 597/1302] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:46.303313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-93f4bdc3-2d97-4978-aa7b-8dfa085d057b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:46.305467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-93f4bdc3-2d97-4978-aa7b-8dfa085d057b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:46.312318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93f4bdc3-2d97-4978-aa7b-8dfa085d057b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:46.312918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93f4bdc3-2d97-4978-aa7b-8dfa085d057b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:46.313347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93f4bdc3-2d97-4978-aa7b-8dfa085d057b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:46.314042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93f4bdc3-2d97-4978-aa7b-8dfa085d057b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:46.314491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93f4bdc3-2d97-4978-aa7b-8dfa085d057b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:46.314930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93f4bdc3-2d97-4978-aa7b-8dfa085d057b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:46.346766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-93f4bdc3-2d97-4978-aa7b-8dfa085d057b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047760 Aug 24 05:13:46.347226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 706/1303] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:46.358206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-adf0a087-7b8f-4352-8e9d-87a53830fda1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:46.360362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-adf0a087-7b8f-4352-8e9d-87a53830fda1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:46.367083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-adf0a087-7b8f-4352-8e9d-87a53830fda1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:46.367810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-adf0a087-7b8f-4352-8e9d-87a53830fda1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:46.368507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-adf0a087-7b8f-4352-8e9d-87a53830fda1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:46.369598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-adf0a087-7b8f-4352-8e9d-87a53830fda1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:46.370295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-adf0a087-7b8f-4352-8e9d-87a53830fda1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:46.370985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-adf0a087-7b8f-4352-8e9d-87a53830fda1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:46.404632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-adf0a087-7b8f-4352-8e9d-87a53830fda1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050921 Aug 24 05:13:46.405193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 598/1304] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:47.121971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-648231dc-6e8c-4b6f-acd1-84a887625fcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:47.124151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-648231dc-6e8c-4b6f-acd1-84a887625fcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:47.130248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-648231dc-6e8c-4b6f-acd1-84a887625fcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:47.130766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-648231dc-6e8c-4b6f-acd1-84a887625fcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:47.131212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-648231dc-6e8c-4b6f-acd1-84a887625fcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:47.131913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-648231dc-6e8c-4b6f-acd1-84a887625fcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:47.132361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-648231dc-6e8c-4b6f-acd1-84a887625fcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:47.132779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-648231dc-6e8c-4b6f-acd1-84a887625fcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:47.163220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-648231dc-6e8c-4b6f-acd1-84a887625fcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046011 Aug 24 05:13:47.163768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 707/1305] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:47.359834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-acf39b8c-9f5e-49dc-a155-1a4d09273bc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:47.362003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-acf39b8c-9f5e-49dc-a155-1a4d09273bc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:47.368820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acf39b8c-9f5e-49dc-a155-1a4d09273bc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:47.369305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acf39b8c-9f5e-49dc-a155-1a4d09273bc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:47.369747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acf39b8c-9f5e-49dc-a155-1a4d09273bc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:47.370451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acf39b8c-9f5e-49dc-a155-1a4d09273bc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:47.370942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acf39b8c-9f5e-49dc-a155-1a4d09273bc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:47.371371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acf39b8c-9f5e-49dc-a155-1a4d09273bc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:47.403134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-acf39b8c-9f5e-49dc-a155-1a4d09273bc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047238 Aug 24 05:13:47.403698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 599/1306] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:47.418057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2eabb58e-4d5f-453e-a7ea-4888976be2c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:47.420239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2eabb58e-4d5f-453e-a7ea-4888976be2c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:47.427062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eabb58e-4d5f-453e-a7ea-4888976be2c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:47.427536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eabb58e-4d5f-453e-a7ea-4888976be2c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:47.427960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eabb58e-4d5f-453e-a7ea-4888976be2c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:47.428640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eabb58e-4d5f-453e-a7ea-4888976be2c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:47.429080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eabb58e-4d5f-453e-a7ea-4888976be2c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:47.429491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eabb58e-4d5f-453e-a7ea-4888976be2c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:47.459611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2eabb58e-4d5f-453e-a7ea-4888976be2c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046496 Aug 24 05:13:47.460164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 708/1307] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:48.176579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b0477ea9-9208-4e76-9856-d25894e21b74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:48.178673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b0477ea9-9208-4e76-9856-d25894e21b74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:48.184869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0477ea9-9208-4e76-9856-d25894e21b74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:48.185342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0477ea9-9208-4e76-9856-d25894e21b74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:48.185770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0477ea9-9208-4e76-9856-d25894e21b74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:48.186456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0477ea9-9208-4e76-9856-d25894e21b74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:48.186926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0477ea9-9208-4e76-9856-d25894e21b74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:48.187342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0477ea9-9208-4e76-9856-d25894e21b74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:48.217912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b0477ea9-9208-4e76-9856-d25894e21b74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Aug 24 05:13:48.218475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 600/1308] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:48.416029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-163ea7af-2678-424a-88fc-a4c65ba98043 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:48.418944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-163ea7af-2678-424a-88fc-a4c65ba98043 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:48.425532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-163ea7af-2678-424a-88fc-a4c65ba98043 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:48.426009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-163ea7af-2678-424a-88fc-a4c65ba98043 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:48.426777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-163ea7af-2678-424a-88fc-a4c65ba98043 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:48.427419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-163ea7af-2678-424a-88fc-a4c65ba98043 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:48.427866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-163ea7af-2678-424a-88fc-a4c65ba98043 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:48.428285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-163ea7af-2678-424a-88fc-a4c65ba98043 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:48.455622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:48.460936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-163ea7af-2678-424a-88fc-a4c65ba98043 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049151 Aug 24 05:13:48.461508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 709/1309] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:48.472302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eab7d85a-56cc-472b-b4ea-a909f4303dae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:48.474428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-eab7d85a-56cc-472b-b4ea-a909f4303dae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:48.483071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eab7d85a-56cc-472b-b4ea-a909f4303dae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:48.483547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eab7d85a-56cc-472b-b4ea-a909f4303dae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:48.483974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eab7d85a-56cc-472b-b4ea-a909f4303dae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:48.484667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eab7d85a-56cc-472b-b4ea-a909f4303dae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:48.485107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eab7d85a-56cc-472b-b4ea-a909f4303dae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:48.485521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eab7d85a-56cc-472b-b4ea-a909f4303dae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:48.516523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-eab7d85a-56cc-472b-b4ea-a909f4303dae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048158 Aug 24 05:13:48.517079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 601/1310] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:49.230818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-87c04254-2ddd-4082-880b-df24a33b96dd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:49.232935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-87c04254-2ddd-4082-880b-df24a33b96dd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:49.239208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c04254-2ddd-4082-880b-df24a33b96dd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:49.239605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c04254-2ddd-4082-880b-df24a33b96dd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:49.240031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c04254-2ddd-4082-880b-df24a33b96dd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:49.240714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c04254-2ddd-4082-880b-df24a33b96dd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:49.241154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c04254-2ddd-4082-880b-df24a33b96dd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:49.241571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87c04254-2ddd-4082-880b-df24a33b96dd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:49.271927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-87c04254-2ddd-4082-880b-df24a33b96dd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045624 Aug 24 05:13:49.272464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 710/1311] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:49.473905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-aaff69d5-db45-4e16-85a7-14079a0f1030 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:49.476101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-aaff69d5-db45-4e16-85a7-14079a0f1030 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:49.483553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaff69d5-db45-4e16-85a7-14079a0f1030 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:49.484041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaff69d5-db45-4e16-85a7-14079a0f1030 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:49.484476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaff69d5-db45-4e16-85a7-14079a0f1030 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:49.485176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaff69d5-db45-4e16-85a7-14079a0f1030 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:49.485628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaff69d5-db45-4e16-85a7-14079a0f1030 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:49.486052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaff69d5-db45-4e16-85a7-14079a0f1030 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:49.504439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:13:49.519499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-aaff69d5-db45-4e16-85a7-14079a0f1030 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049515 Aug 24 05:13:49.520064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 602/1312] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:49.529511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0a248f2e-e525-40c2-9083-4c393751e252 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:49.531706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0a248f2e-e525-40c2-9083-4c393751e252 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:49.538181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a248f2e-e525-40c2-9083-4c393751e252 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:49.538655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a248f2e-e525-40c2-9083-4c393751e252 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:49.539146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a248f2e-e525-40c2-9083-4c393751e252 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:49.539816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a248f2e-e525-40c2-9083-4c393751e252 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:49.540262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a248f2e-e525-40c2-9083-4c393751e252 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:49.540683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a248f2e-e525-40c2-9083-4c393751e252 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:49.571596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0a248f2e-e525-40c2-9083-4c393751e252 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046489 Aug 24 05:13:49.572153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 711/1313] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:50.284341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1ba78473-ea07-41e1-9893-7e9a9e927cdd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:50.286390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1ba78473-ea07-41e1-9893-7e9a9e927cdd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:50.292502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba78473-ea07-41e1-9893-7e9a9e927cdd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:50.293145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba78473-ea07-41e1-9893-7e9a9e927cdd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:50.293540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba78473-ea07-41e1-9893-7e9a9e927cdd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:50.294534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba78473-ea07-41e1-9893-7e9a9e927cdd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:50.294674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba78473-ea07-41e1-9893-7e9a9e927cdd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:50.295122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba78473-ea07-41e1-9893-7e9a9e927cdd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:50.328669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1ba78473-ea07-41e1-9893-7e9a9e927cdd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048361 Aug 24 05:13:50.329241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 603/1314] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:50.531708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-94a20da6-e87d-489e-9c57-b4edb7991ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:50.533851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-94a20da6-e87d-489e-9c57-b4edb7991ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:50.540551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94a20da6-e87d-489e-9c57-b4edb7991ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:50.540960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94a20da6-e87d-489e-9c57-b4edb7991ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:50.541394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94a20da6-e87d-489e-9c57-b4edb7991ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:50.542210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94a20da6-e87d-489e-9c57-b4edb7991ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:50.542680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94a20da6-e87d-489e-9c57-b4edb7991ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:50.543129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-94a20da6-e87d-489e-9c57-b4edb7991ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:50.574999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-94a20da6-e87d-489e-9c57-b4edb7991ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047204 Aug 24 05:13:50.575568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 712/1315] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:50.583709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b6f05828-0f4d-4ef5-a7d0-1e9035592e83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:50.585852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b6f05828-0f4d-4ef5-a7d0-1e9035592e83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:50.593099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6f05828-0f4d-4ef5-a7d0-1e9035592e83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:50.593591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6f05828-0f4d-4ef5-a7d0-1e9035592e83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:50.594031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6f05828-0f4d-4ef5-a7d0-1e9035592e83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:50.594824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6f05828-0f4d-4ef5-a7d0-1e9035592e83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:50.595281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6f05828-0f4d-4ef5-a7d0-1e9035592e83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:50.595706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6f05828-0f4d-4ef5-a7d0-1e9035592e83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:50.627264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b6f05828-0f4d-4ef5-a7d0-1e9035592e83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047370 Aug 24 05:13:50.627833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 604/1316] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:51.341682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e8f4641b-1d42-4fb3-95c5-034a818f6cd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:51.343728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e8f4641b-1d42-4fb3-95c5-034a818f6cd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:51.349836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8f4641b-1d42-4fb3-95c5-034a818f6cd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:51.350306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8f4641b-1d42-4fb3-95c5-034a818f6cd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:51.350760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8f4641b-1d42-4fb3-95c5-034a818f6cd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:51.351446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8f4641b-1d42-4fb3-95c5-034a818f6cd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:51.351883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8f4641b-1d42-4fb3-95c5-034a818f6cd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:51.352292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8f4641b-1d42-4fb3-95c5-034a818f6cd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:51.383153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e8f4641b-1d42-4fb3-95c5-034a818f6cd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045671 Aug 24 05:13:51.383707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 713/1317] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:51.587174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-919ed840-dfec-4070-8c71-c60b8602195c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:51.590088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-919ed840-dfec-4070-8c71-c60b8602195c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:51.596780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-919ed840-dfec-4070-8c71-c60b8602195c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:51.597189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-919ed840-dfec-4070-8c71-c60b8602195c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:51.597652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-919ed840-dfec-4070-8c71-c60b8602195c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:51.599751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-919ed840-dfec-4070-8c71-c60b8602195c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:51.599751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-919ed840-dfec-4070-8c71-c60b8602195c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:51.599751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-919ed840-dfec-4070-8c71-c60b8602195c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:51.629466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-919ed840-dfec-4070-8c71-c60b8602195c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Aug 24 05:13:51.630028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 605/1318] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:51.640200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-15c58d9a-6cb7-47ec-b682-34010612d4df tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:51.642363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-15c58d9a-6cb7-47ec-b682-34010612d4df tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:51.648883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15c58d9a-6cb7-47ec-b682-34010612d4df tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:51.649361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15c58d9a-6cb7-47ec-b682-34010612d4df tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:51.649793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15c58d9a-6cb7-47ec-b682-34010612d4df tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:51.650481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15c58d9a-6cb7-47ec-b682-34010612d4df tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:51.650961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15c58d9a-6cb7-47ec-b682-34010612d4df tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:51.651383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15c58d9a-6cb7-47ec-b682-34010612d4df tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:51.682584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-15c58d9a-6cb7-47ec-b682-34010612d4df tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047020 Aug 24 05:13:51.683459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 714/1319] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:52.397788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7585ce8f-b5d6-4c57-8b34-abaaabc16cf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:52.399887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7585ce8f-b5d6-4c57-8b34-abaaabc16cf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:52.407654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7585ce8f-b5d6-4c57-8b34-abaaabc16cf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:52.408144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7585ce8f-b5d6-4c57-8b34-abaaabc16cf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:52.408584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7585ce8f-b5d6-4c57-8b34-abaaabc16cf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:52.409282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7585ce8f-b5d6-4c57-8b34-abaaabc16cf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:52.409735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7585ce8f-b5d6-4c57-8b34-abaaabc16cf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:52.410157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7585ce8f-b5d6-4c57-8b34-abaaabc16cf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:52.443163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7585ce8f-b5d6-4c57-8b34-abaaabc16cf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050617 Aug 24 05:13:52.443732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 606/1320] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:52.644405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-84b2b1ef-0ef1-476a-934d-528216454404 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:52.646711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-84b2b1ef-0ef1-476a-934d-528216454404 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:52.654778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84b2b1ef-0ef1-476a-934d-528216454404 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:52.654975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84b2b1ef-0ef1-476a-934d-528216454404 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:52.655415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84b2b1ef-0ef1-476a-934d-528216454404 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:52.656108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84b2b1ef-0ef1-476a-934d-528216454404 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:52.656548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84b2b1ef-0ef1-476a-934d-528216454404 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:52.658823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-84b2b1ef-0ef1-476a-934d-528216454404 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:52.688451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-84b2b1ef-0ef1-476a-934d-528216454404 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047976 Aug 24 05:13:52.689021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 715/1321] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:52.696326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3f7ab81e-bd07-4cda-a4d7-ceee466e3efd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:52.698507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3f7ab81e-bd07-4cda-a4d7-ceee466e3efd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:52.705426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f7ab81e-bd07-4cda-a4d7-ceee466e3efd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:52.705906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f7ab81e-bd07-4cda-a4d7-ceee466e3efd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:52.706341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f7ab81e-bd07-4cda-a4d7-ceee466e3efd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:52.707068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f7ab81e-bd07-4cda-a4d7-ceee466e3efd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:52.707518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f7ab81e-bd07-4cda-a4d7-ceee466e3efd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:52.707938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f7ab81e-bd07-4cda-a4d7-ceee466e3efd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:52.740997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3f7ab81e-bd07-4cda-a4d7-ceee466e3efd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048522 Aug 24 05:13:52.741573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 607/1322] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:53.455026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c331dd3f-4f6b-4de4-b79b-5930fe1bb700 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:53.457216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c331dd3f-4f6b-4de4-b79b-5930fe1bb700 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:53.463291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c331dd3f-4f6b-4de4-b79b-5930fe1bb700 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:53.463770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c331dd3f-4f6b-4de4-b79b-5930fe1bb700 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:53.464706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c331dd3f-4f6b-4de4-b79b-5930fe1bb700 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:53.465666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c331dd3f-4f6b-4de4-b79b-5930fe1bb700 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:53.466124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c331dd3f-4f6b-4de4-b79b-5930fe1bb700 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:53.466547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c331dd3f-4f6b-4de4-b79b-5930fe1bb700 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:53.497514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c331dd3f-4f6b-4de4-b79b-5930fe1bb700 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046430 Aug 24 05:13:53.498075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 716/1323] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:53.701226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-72a2b2e8-f2c7-4464-90d1-504d1b2bd730 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:53.703577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-72a2b2e8-f2c7-4464-90d1-504d1b2bd730 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:53.710091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72a2b2e8-f2c7-4464-90d1-504d1b2bd730 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:53.710579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72a2b2e8-f2c7-4464-90d1-504d1b2bd730 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:53.711043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72a2b2e8-f2c7-4464-90d1-504d1b2bd730 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:53.711754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72a2b2e8-f2c7-4464-90d1-504d1b2bd730 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:53.712210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72a2b2e8-f2c7-4464-90d1-504d1b2bd730 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:53.712632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72a2b2e8-f2c7-4464-90d1-504d1b2bd730 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:53.744235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-72a2b2e8-f2c7-4464-90d1-504d1b2bd730 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047480 Aug 24 05:13:53.744807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 608/1324] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:53.753801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-797e7c40-69de-4b4e-bf23-df60c20b24af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:53.756017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-797e7c40-69de-4b4e-bf23-df60c20b24af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:53.763243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-797e7c40-69de-4b4e-bf23-df60c20b24af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:53.763713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-797e7c40-69de-4b4e-bf23-df60c20b24af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:53.764142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-797e7c40-69de-4b4e-bf23-df60c20b24af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:53.764831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-797e7c40-69de-4b4e-bf23-df60c20b24af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:53.765273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-797e7c40-69de-4b4e-bf23-df60c20b24af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:53.765689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-797e7c40-69de-4b4e-bf23-df60c20b24af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:53.796574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-797e7c40-69de-4b4e-bf23-df60c20b24af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046944 Aug 24 05:13:53.797126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 717/1325] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:54.509736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ef3844f4-a98d-478e-9669-431d78e2079b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:54.511910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ef3844f4-a98d-478e-9669-431d78e2079b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:54.518037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef3844f4-a98d-478e-9669-431d78e2079b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:54.518519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef3844f4-a98d-478e-9669-431d78e2079b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:54.518995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef3844f4-a98d-478e-9669-431d78e2079b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:54.519698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef3844f4-a98d-478e-9669-431d78e2079b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:54.520157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef3844f4-a98d-478e-9669-431d78e2079b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:54.520587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef3844f4-a98d-478e-9669-431d78e2079b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:54.551705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ef3844f4-a98d-478e-9669-431d78e2079b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045711 Aug 24 05:13:54.552277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 609/1326] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:54.758672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3feaee90-c9b9-4101-9d26-f7d204c8e214 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:54.761970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3feaee90-c9b9-4101-9d26-f7d204c8e214 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:54.768438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3feaee90-c9b9-4101-9d26-f7d204c8e214 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:54.769022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3feaee90-c9b9-4101-9d26-f7d204c8e214 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:54.769458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3feaee90-c9b9-4101-9d26-f7d204c8e214 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:54.770160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3feaee90-c9b9-4101-9d26-f7d204c8e214 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:54.770609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3feaee90-c9b9-4101-9d26-f7d204c8e214 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:54.771055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3feaee90-c9b9-4101-9d26-f7d204c8e214 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:54.803186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3feaee90-c9b9-4101-9d26-f7d204c8e214 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050492 Aug 24 05:13:54.803752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 718/1327] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:54.810295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dec271f2-af62-4d53-a041-f38cf81d2c37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:54.812943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dec271f2-af62-4d53-a041-f38cf81d2c37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:54.820198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dec271f2-af62-4d53-a041-f38cf81d2c37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:54.820683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dec271f2-af62-4d53-a041-f38cf81d2c37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:54.821121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dec271f2-af62-4d53-a041-f38cf81d2c37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:54.821825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dec271f2-af62-4d53-a041-f38cf81d2c37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:54.822274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dec271f2-af62-4d53-a041-f38cf81d2c37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:54.822722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dec271f2-af62-4d53-a041-f38cf81d2c37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:54.855248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dec271f2-af62-4d53-a041-f38cf81d2c37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049075 Aug 24 05:13:54.855838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 610/1328] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:55.564521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-09fb1d85-0aba-46c9-b944-a2aa560e7380 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:55.566632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-09fb1d85-0aba-46c9-b944-a2aa560e7380 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:55.572903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09fb1d85-0aba-46c9-b944-a2aa560e7380 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:55.573542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09fb1d85-0aba-46c9-b944-a2aa560e7380 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:55.573736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09fb1d85-0aba-46c9-b944-a2aa560e7380 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:55.574475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09fb1d85-0aba-46c9-b944-a2aa560e7380 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:55.574992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09fb1d85-0aba-46c9-b944-a2aa560e7380 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:55.575407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09fb1d85-0aba-46c9-b944-a2aa560e7380 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:55.608125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-09fb1d85-0aba-46c9-b944-a2aa560e7380 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047489 Aug 24 05:13:55.608674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 719/1329] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:55.817147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-21052a6f-2ef5-44d1-922c-1096a227ff4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:55.820141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-21052a6f-2ef5-44d1-922c-1096a227ff4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:55.826237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21052a6f-2ef5-44d1-922c-1096a227ff4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:55.826635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21052a6f-2ef5-44d1-922c-1096a227ff4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:55.827090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21052a6f-2ef5-44d1-922c-1096a227ff4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:55.827783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21052a6f-2ef5-44d1-922c-1096a227ff4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:55.828229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21052a6f-2ef5-44d1-922c-1096a227ff4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:55.828648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21052a6f-2ef5-44d1-922c-1096a227ff4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:55.859993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-21052a6f-2ef5-44d1-922c-1096a227ff4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046934 Aug 24 05:13:55.860560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 611/1330] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:55 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:55.866583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-989a0374-7451-404b-860a-5e4a1d94576b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:55.868749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-989a0374-7451-404b-860a-5e4a1d94576b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:55.875467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-989a0374-7451-404b-860a-5e4a1d94576b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:55.875948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-989a0374-7451-404b-860a-5e4a1d94576b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:55.876382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-989a0374-7451-404b-860a-5e4a1d94576b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:55.877078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-989a0374-7451-404b-860a-5e4a1d94576b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:55.877524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-989a0374-7451-404b-860a-5e4a1d94576b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:55.877947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-989a0374-7451-404b-860a-5e4a1d94576b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:55.909471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-989a0374-7451-404b-860a-5e4a1d94576b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046738 Aug 24 05:13:55.910043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 720/1331] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:56.620766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7fd2329f-e9ea-445d-8ba9-899c4febe50c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:56.623975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7fd2329f-e9ea-445d-8ba9-899c4febe50c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:56.630247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fd2329f-e9ea-445d-8ba9-899c4febe50c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:56.630664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fd2329f-e9ea-445d-8ba9-899c4febe50c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:56.631127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fd2329f-e9ea-445d-8ba9-899c4febe50c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:56.631827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fd2329f-e9ea-445d-8ba9-899c4febe50c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:56.632278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fd2329f-e9ea-445d-8ba9-899c4febe50c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:56.632704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fd2329f-e9ea-445d-8ba9-899c4febe50c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:56.664374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7fd2329f-e9ea-445d-8ba9-899c4febe50c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048064 Aug 24 05:13:56.664926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 612/1332] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:56.879496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ea70b3b1-40d9-42b0-a7be-0c23db617343 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:56.881667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ea70b3b1-40d9-42b0-a7be-0c23db617343 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:56.889546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea70b3b1-40d9-42b0-a7be-0c23db617343 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:56.890047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea70b3b1-40d9-42b0-a7be-0c23db617343 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:56.890510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea70b3b1-40d9-42b0-a7be-0c23db617343 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:56.891246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea70b3b1-40d9-42b0-a7be-0c23db617343 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:56.891697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea70b3b1-40d9-42b0-a7be-0c23db617343 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:56.892152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea70b3b1-40d9-42b0-a7be-0c23db617343 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:56.922264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1ab26835-76ab-4ed0-a07c-e5508fc30336 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:56.923516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ea70b3b1-40d9-42b0-a7be-0c23db617343 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047958 Aug 24 05:13:56.924096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 721/1333] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:56.929123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1ab26835-76ab-4ed0-a07c-e5508fc30336 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:56.931939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ab26835-76ab-4ed0-a07c-e5508fc30336 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:56.932426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ab26835-76ab-4ed0-a07c-e5508fc30336 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:56.933121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ab26835-76ab-4ed0-a07c-e5508fc30336 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:56.935229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ab26835-76ab-4ed0-a07c-e5508fc30336 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:56.935229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ab26835-76ab-4ed0-a07c-e5508fc30336 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:56.935437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ab26835-76ab-4ed0-a07c-e5508fc30336 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:56.965354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1ab26835-76ab-4ed0-a07c-e5508fc30336 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047058 Aug 24 05:13:56.965909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 613/1334] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:57.677654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a60c081f-909b-43de-ba05-4edce799aa4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:57.679869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a60c081f-909b-43de-ba05-4edce799aa4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:57.686173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a60c081f-909b-43de-ba05-4edce799aa4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:57.686655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a60c081f-909b-43de-ba05-4edce799aa4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:57.687119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a60c081f-909b-43de-ba05-4edce799aa4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:57.687805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a60c081f-909b-43de-ba05-4edce799aa4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:57.688252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a60c081f-909b-43de-ba05-4edce799aa4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:57.688667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a60c081f-909b-43de-ba05-4edce799aa4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:57.722430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a60c081f-909b-43de-ba05-4edce799aa4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048968 Aug 24 05:13:57.723018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 722/1335] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:57.936291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f499a044-2fbf-4884-a165-e00928b0c6fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:57.938720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f499a044-2fbf-4884-a165-e00928b0c6fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:57.945366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f499a044-2fbf-4884-a165-e00928b0c6fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:57.945851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f499a044-2fbf-4884-a165-e00928b0c6fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:57.946397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f499a044-2fbf-4884-a165-e00928b0c6fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:57.947010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f499a044-2fbf-4884-a165-e00928b0c6fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:57.947465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f499a044-2fbf-4884-a165-e00928b0c6fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:57.947889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f499a044-2fbf-4884-a165-e00928b0c6fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:57.977734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-83fe9a79-acfe-4807-aa70-3f2bfbc06fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:57.979729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f499a044-2fbf-4884-a165-e00928b0c6fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048053 Aug 24 05:13:57.979944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-83fe9a79-acfe-4807-aa70-3f2bfbc06fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:57.980261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 614/1336] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:57.986513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83fe9a79-acfe-4807-aa70-3f2bfbc06fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:57.987103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83fe9a79-acfe-4807-aa70-3f2bfbc06fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:57.987530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83fe9a79-acfe-4807-aa70-3f2bfbc06fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:57.988222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83fe9a79-acfe-4807-aa70-3f2bfbc06fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:57.988663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83fe9a79-acfe-4807-aa70-3f2bfbc06fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:57.989071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83fe9a79-acfe-4807-aa70-3f2bfbc06fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:58.020659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-83fe9a79-acfe-4807-aa70-3f2bfbc06fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046874 Aug 24 05:13:58.021224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 723/1337] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:58.735443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eb987e7a-e8e2-4be5-8628-eb9cb9b3de7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:58.737580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-eb987e7a-e8e2-4be5-8628-eb9cb9b3de7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:58.743670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb987e7a-e8e2-4be5-8628-eb9cb9b3de7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:58.744149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb987e7a-e8e2-4be5-8628-eb9cb9b3de7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:58.744583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb987e7a-e8e2-4be5-8628-eb9cb9b3de7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:58.745454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb987e7a-e8e2-4be5-8628-eb9cb9b3de7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:58.745916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb987e7a-e8e2-4be5-8628-eb9cb9b3de7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:58.746340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb987e7a-e8e2-4be5-8628-eb9cb9b3de7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:58.779772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-eb987e7a-e8e2-4be5-8628-eb9cb9b3de7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048239 Aug 24 05:13:58.780251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 615/1338] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:58.992295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e9bc3aed-ce11-4ef1-beb8-be21e361c24e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:58.994426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e9bc3aed-ce11-4ef1-beb8-be21e361c24e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:59.001786 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9bc3aed-ce11-4ef1-beb8-be21e361c24e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:59.002252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9bc3aed-ce11-4ef1-beb8-be21e361c24e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:59.002718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9bc3aed-ce11-4ef1-beb8-be21e361c24e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:59.003422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9bc3aed-ce11-4ef1-beb8-be21e361c24e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:59.003855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9bc3aed-ce11-4ef1-beb8-be21e361c24e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:59.004269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9bc3aed-ce11-4ef1-beb8-be21e361c24e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:59.033695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-aa228085-2213-4a8e-b24a-133335a6c33f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:59.036459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e9bc3aed-ce11-4ef1-beb8-be21e361c24e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048215 Aug 24 05:13:59.036611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-aa228085-2213-4a8e-b24a-133335a6c33f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:59.037241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 724/1339] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:13:59.043373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa228085-2213-4a8e-b24a-133335a6c33f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:59.043853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa228085-2213-4a8e-b24a-133335a6c33f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:59.044287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa228085-2213-4a8e-b24a-133335a6c33f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:59.044981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa228085-2213-4a8e-b24a-133335a6c33f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:59.045427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa228085-2213-4a8e-b24a-133335a6c33f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:59.045839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa228085-2213-4a8e-b24a-133335a6c33f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:59.076165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-aa228085-2213-4a8e-b24a-133335a6c33f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046474 Aug 24 05:13:59.076981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 616/1340] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:13:59.791799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-74a2a14b-1ef6-45f8-8b74-4b6e0ae3befd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:13:59.794611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-74a2a14b-1ef6-45f8-8b74-4b6e0ae3befd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:13:59.800672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74a2a14b-1ef6-45f8-8b74-4b6e0ae3befd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:59.801150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74a2a14b-1ef6-45f8-8b74-4b6e0ae3befd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:59.801846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74a2a14b-1ef6-45f8-8b74-4b6e0ae3befd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:59.802528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74a2a14b-1ef6-45f8-8b74-4b6e0ae3befd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:13:59.803015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74a2a14b-1ef6-45f8-8b74-4b6e0ae3befd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:13:59.803438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-74a2a14b-1ef6-45f8-8b74-4b6e0ae3befd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:13:59.834196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-74a2a14b-1ef6-45f8-8b74-4b6e0ae3befd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046326 Aug 24 05:13:59.834653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 725/1341] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:13:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:00.048842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-82c04800-69df-4dea-b1fb-9fc3910f316f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:00.051179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-82c04800-69df-4dea-b1fb-9fc3910f316f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:00.058657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82c04800-69df-4dea-b1fb-9fc3910f316f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:00.059179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82c04800-69df-4dea-b1fb-9fc3910f316f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:00.059653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82c04800-69df-4dea-b1fb-9fc3910f316f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:00.060367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82c04800-69df-4dea-b1fb-9fc3910f316f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:00.060865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82c04800-69df-4dea-b1fb-9fc3910f316f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:00.061241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82c04800-69df-4dea-b1fb-9fc3910f316f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:00.088129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-50b6f13a-c044-41fa-9be4-a0220bbeffae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:00.090914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-50b6f13a-c044-41fa-9be4-a0220bbeffae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:00.093576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-82c04800-69df-4dea-b1fb-9fc3910f316f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048655 Aug 24 05:14:00.094517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 617/1342] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:00.101681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b6f13a-c044-41fa-9be4-a0220bbeffae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:00.102162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b6f13a-c044-41fa-9be4-a0220bbeffae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:00.102597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b6f13a-c044-41fa-9be4-a0220bbeffae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:00.105840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b6f13a-c044-41fa-9be4-a0220bbeffae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:00.105840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b6f13a-c044-41fa-9be4-a0220bbeffae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:00.105840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b6f13a-c044-41fa-9be4-a0220bbeffae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:00.121838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:00.136735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-50b6f13a-c044-41fa-9be4-a0220bbeffae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052350 Aug 24 05:14:00.137309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 726/1343] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:00.846634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-65cfb616-7e0f-4f03-bf07-e8d951d57473 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:00.848886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-65cfb616-7e0f-4f03-bf07-e8d951d57473 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:00.855308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65cfb616-7e0f-4f03-bf07-e8d951d57473 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:00.855789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65cfb616-7e0f-4f03-bf07-e8d951d57473 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:00.856402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65cfb616-7e0f-4f03-bf07-e8d951d57473 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:00.857662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65cfb616-7e0f-4f03-bf07-e8d951d57473 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:00.858548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65cfb616-7e0f-4f03-bf07-e8d951d57473 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:00.858892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65cfb616-7e0f-4f03-bf07-e8d951d57473 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:00.890528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-65cfb616-7e0f-4f03-bf07-e8d951d57473 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047845 Aug 24 05:14:00.891138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 618/1344] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:01.106790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-103dfa5e-cf2a-4809-903d-112ddcc6558c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:01.108964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-103dfa5e-cf2a-4809-903d-112ddcc6558c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:01.115558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103dfa5e-cf2a-4809-903d-112ddcc6558c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:01.116038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103dfa5e-cf2a-4809-903d-112ddcc6558c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:01.116469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103dfa5e-cf2a-4809-903d-112ddcc6558c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:01.117166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103dfa5e-cf2a-4809-903d-112ddcc6558c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:01.117689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103dfa5e-cf2a-4809-903d-112ddcc6558c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:01.118058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103dfa5e-cf2a-4809-903d-112ddcc6558c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:01.155129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-37e62f91-63f6-4e1a-ba1c-134f03fde48d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:01.155129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-37e62f91-63f6-4e1a-ba1c-134f03fde48d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:01.158132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-103dfa5e-cf2a-4809-903d-112ddcc6558c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056141 Aug 24 05:14:01.158943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 727/1345] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:01.162844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e62f91-63f6-4e1a-ba1c-134f03fde48d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:01.163330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e62f91-63f6-4e1a-ba1c-134f03fde48d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:01.163759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e62f91-63f6-4e1a-ba1c-134f03fde48d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:01.164451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e62f91-63f6-4e1a-ba1c-134f03fde48d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:01.164894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e62f91-63f6-4e1a-ba1c-134f03fde48d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:01.165310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-37e62f91-63f6-4e1a-ba1c-134f03fde48d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:01.170097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:01.200678 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-37e62f91-63f6-4e1a-ba1c-134f03fde48d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055058 Aug 24 05:14:01.201281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 619/1346] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:01.902057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b73ab93b-b958-44e8-be27-d5d81f4eee4c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:01.904251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b73ab93b-b958-44e8-be27-d5d81f4eee4c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:01.910482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b73ab93b-b958-44e8-be27-d5d81f4eee4c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:01.910994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b73ab93b-b958-44e8-be27-d5d81f4eee4c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:01.911418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b73ab93b-b958-44e8-be27-d5d81f4eee4c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:01.912101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b73ab93b-b958-44e8-be27-d5d81f4eee4c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:01.912541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b73ab93b-b958-44e8-be27-d5d81f4eee4c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:01.913117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b73ab93b-b958-44e8-be27-d5d81f4eee4c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:01.945999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b73ab93b-b958-44e8-be27-d5d81f4eee4c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047846 Aug 24 05:14:01.946472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 728/1347] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:02.170296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c6f75757-c9c8-4c80-8338-edde5600fe75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:02.172438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c6f75757-c9c8-4c80-8338-edde5600fe75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:02.179523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6f75757-c9c8-4c80-8338-edde5600fe75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:02.180010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6f75757-c9c8-4c80-8338-edde5600fe75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:02.180448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6f75757-c9c8-4c80-8338-edde5600fe75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:02.181150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6f75757-c9c8-4c80-8338-edde5600fe75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:02.181604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6f75757-c9c8-4c80-8338-edde5600fe75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:02.182097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c6f75757-c9c8-4c80-8338-edde5600fe75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:02.213500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-63fe1e84-de8c-47c0-92d6-3ff046b1c781 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:02.215837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c6f75757-c9c8-4c80-8338-edde5600fe75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050024 Aug 24 05:14:02.216553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 620/1348] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:02.220930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-63fe1e84-de8c-47c0-92d6-3ff046b1c781 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:02.227831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63fe1e84-de8c-47c0-92d6-3ff046b1c781 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:02.228371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63fe1e84-de8c-47c0-92d6-3ff046b1c781 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:02.231315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63fe1e84-de8c-47c0-92d6-3ff046b1c781 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:02.231315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63fe1e84-de8c-47c0-92d6-3ff046b1c781 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:02.231315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63fe1e84-de8c-47c0-92d6-3ff046b1c781 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:02.231315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63fe1e84-de8c-47c0-92d6-3ff046b1c781 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:02.266122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-63fe1e84-de8c-47c0-92d6-3ff046b1c781 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056744 Aug 24 05:14:02.266706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 729/1349] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:02.957798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-55d71065-d5a0-4857-98b6-2a7f8514f67f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:02.959989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-55d71065-d5a0-4857-98b6-2a7f8514f67f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:02.961946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=86 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:02.967965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55d71065-d5a0-4857-98b6-2a7f8514f67f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:02.968451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55d71065-d5a0-4857-98b6-2a7f8514f67f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:02.968895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55d71065-d5a0-4857-98b6-2a7f8514f67f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:02.969596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55d71065-d5a0-4857-98b6-2a7f8514f67f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:02.970051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55d71065-d5a0-4857-98b6-2a7f8514f67f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:02.970476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-55d71065-d5a0-4857-98b6-2a7f8514f67f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:03.003264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-55d71065-d5a0-4857-98b6-2a7f8514f67f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049357 Aug 24 05:14:03.003751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 621/1350] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:03.228569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-957f0637-0a76-467f-adf5-9d86f0be6aa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:03.231467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-957f0637-0a76-467f-adf5-9d86f0be6aa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:03.238224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-957f0637-0a76-467f-adf5-9d86f0be6aa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:03.238791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-957f0637-0a76-467f-adf5-9d86f0be6aa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:03.239203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-957f0637-0a76-467f-adf5-9d86f0be6aa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:03.239976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-957f0637-0a76-467f-adf5-9d86f0be6aa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:03.240388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-957f0637-0a76-467f-adf5-9d86f0be6aa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:03.240807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-957f0637-0a76-467f-adf5-9d86f0be6aa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:03.273449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-957f0637-0a76-467f-adf5-9d86f0be6aa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Aug 24 05:14:03.274324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 730/1351] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:03 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:03.291241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1d4d2421-b4ff-4aad-ba22-9fe8d2606d42 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:03.293953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1d4d2421-b4ff-4aad-ba22-9fe8d2606d42 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:03.300597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d4d2421-b4ff-4aad-ba22-9fe8d2606d42 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:03.301071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d4d2421-b4ff-4aad-ba22-9fe8d2606d42 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:03.301760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d4d2421-b4ff-4aad-ba22-9fe8d2606d42 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:03.302455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d4d2421-b4ff-4aad-ba22-9fe8d2606d42 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:03.302938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d4d2421-b4ff-4aad-ba22-9fe8d2606d42 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:03.303355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d4d2421-b4ff-4aad-ba22-9fe8d2606d42 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:03.334316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1d4d2421-b4ff-4aad-ba22-9fe8d2606d42 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059783 Aug 24 05:14:03.334923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 622/1352] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:04.016204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e676f17b-256d-489c-b317-938d16c20dd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:04.018251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e676f17b-256d-489c-b317-938d16c20dd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:04.024330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e676f17b-256d-489c-b317-938d16c20dd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:04.024803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e676f17b-256d-489c-b317-938d16c20dd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:04.025234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e676f17b-256d-489c-b317-938d16c20dd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:04.025995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e676f17b-256d-489c-b317-938d16c20dd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:04.026578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e676f17b-256d-489c-b317-938d16c20dd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:04.027246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e676f17b-256d-489c-b317-938d16c20dd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:04.057940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e676f17b-256d-489c-b317-938d16c20dd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Aug 24 05:14:04.058484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 731/1353] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:04.286527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9cf186a0-1ea1-4292-b593-8dd4c22b0183 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:04.288641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9cf186a0-1ea1-4292-b593-8dd4c22b0183 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:04.295528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cf186a0-1ea1-4292-b593-8dd4c22b0183 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:04.296459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cf186a0-1ea1-4292-b593-8dd4c22b0183 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:04.296459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cf186a0-1ea1-4292-b593-8dd4c22b0183 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:04.297125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cf186a0-1ea1-4292-b593-8dd4c22b0183 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:04.297575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cf186a0-1ea1-4292-b593-8dd4c22b0183 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:04.297996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9cf186a0-1ea1-4292-b593-8dd4c22b0183 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:04.335675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9cf186a0-1ea1-4292-b593-8dd4c22b0183 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053189 Aug 24 05:14:04.336257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 623/1354] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:04.349832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cbbb8fbb-e3d6-4aab-a732-9e469191288c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:04.353414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cbbb8fbb-e3d6-4aab-a732-9e469191288c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:04.363861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbbb8fbb-e3d6-4aab-a732-9e469191288c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:04.364610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbbb8fbb-e3d6-4aab-a732-9e469191288c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:04.365321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbbb8fbb-e3d6-4aab-a732-9e469191288c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:04.366442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbbb8fbb-e3d6-4aab-a732-9e469191288c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:04.367157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbbb8fbb-e3d6-4aab-a732-9e469191288c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:04.367826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cbbb8fbb-e3d6-4aab-a732-9e469191288c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:04.400907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cbbb8fbb-e3d6-4aab-a732-9e469191288c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057670 Aug 24 05:14:04.401527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 732/1355] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:05.069640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c81d71df-9e3f-4776-843b-e1250971059c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:05.071856 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c81d71df-9e3f-4776-843b-e1250971059c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:05.078745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c81d71df-9e3f-4776-843b-e1250971059c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:05.079238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c81d71df-9e3f-4776-843b-e1250971059c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:05.079679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c81d71df-9e3f-4776-843b-e1250971059c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:05.080379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c81d71df-9e3f-4776-843b-e1250971059c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:05.080830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c81d71df-9e3f-4776-843b-e1250971059c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:05.081253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c81d71df-9e3f-4776-843b-e1250971059c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:05.112258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c81d71df-9e3f-4776-843b-e1250971059c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046557 Aug 24 05:14:05.112823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 624/1356] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:05.347662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fc1f13d6-8bef-4ca8-ac1a-84daa356a71c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:05.349758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fc1f13d6-8bef-4ca8-ac1a-84daa356a71c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:05.355853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc1f13d6-8bef-4ca8-ac1a-84daa356a71c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:05.356412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc1f13d6-8bef-4ca8-ac1a-84daa356a71c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:05.356739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc1f13d6-8bef-4ca8-ac1a-84daa356a71c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:05.357417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc1f13d6-8bef-4ca8-ac1a-84daa356a71c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:05.357862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc1f13d6-8bef-4ca8-ac1a-84daa356a71c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:05.358279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc1f13d6-8bef-4ca8-ac1a-84daa356a71c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:05.390729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fc1f13d6-8bef-4ca8-ac1a-84daa356a71c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047055 Aug 24 05:14:05.391307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 733/1357] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:05.413658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-45757efb-7b06-4eb3-96e1-01eb0c141ce7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:05.415959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-45757efb-7b06-4eb3-96e1-01eb0c141ce7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:05.422641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-45757efb-7b06-4eb3-96e1-01eb0c141ce7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:05.423192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-45757efb-7b06-4eb3-96e1-01eb0c141ce7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:05.423638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-45757efb-7b06-4eb3-96e1-01eb0c141ce7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:05.424342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-45757efb-7b06-4eb3-96e1-01eb0c141ce7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:05.424794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-45757efb-7b06-4eb3-96e1-01eb0c141ce7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:05.425216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-45757efb-7b06-4eb3-96e1-01eb0c141ce7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:05.457429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-45757efb-7b06-4eb3-96e1-01eb0c141ce7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047864 Aug 24 05:14:05.457986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 625/1358] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:06.125531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b1e6e852-39af-431a-aecb-2d7000be2b8e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:06.127690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b1e6e852-39af-431a-aecb-2d7000be2b8e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:06.134024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1e6e852-39af-431a-aecb-2d7000be2b8e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:06.134509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1e6e852-39af-431a-aecb-2d7000be2b8e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:06.134966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1e6e852-39af-431a-aecb-2d7000be2b8e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:06.136306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1e6e852-39af-431a-aecb-2d7000be2b8e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:06.136822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1e6e852-39af-431a-aecb-2d7000be2b8e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:06.137398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b1e6e852-39af-431a-aecb-2d7000be2b8e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:06.169277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b1e6e852-39af-431a-aecb-2d7000be2b8e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047847 Aug 24 05:14:06.169847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 734/1359] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:06.403570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c644bff2-9f87-42dc-a039-065c32e56af8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:06.405760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c644bff2-9f87-42dc-a039-065c32e56af8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:06.411856 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c644bff2-9f87-42dc-a039-065c32e56af8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:06.412329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c644bff2-9f87-42dc-a039-065c32e56af8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:06.412758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c644bff2-9f87-42dc-a039-065c32e56af8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:06.413446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c644bff2-9f87-42dc-a039-065c32e56af8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:06.413887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c644bff2-9f87-42dc-a039-065c32e56af8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:06.414431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c644bff2-9f87-42dc-a039-065c32e56af8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:06.446439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c644bff2-9f87-42dc-a039-065c32e56af8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047116 Aug 24 05:14:06.447022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 626/1360] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:06.469576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-23dfdee4-7fe3-4209-a80a-15240a0f0e63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:06.471504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-23dfdee4-7fe3-4209-a80a-15240a0f0e63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:06.477469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23dfdee4-7fe3-4209-a80a-15240a0f0e63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:06.477944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23dfdee4-7fe3-4209-a80a-15240a0f0e63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:06.478370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23dfdee4-7fe3-4209-a80a-15240a0f0e63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:06.479068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23dfdee4-7fe3-4209-a80a-15240a0f0e63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:06.480070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23dfdee4-7fe3-4209-a80a-15240a0f0e63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:06.480483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23dfdee4-7fe3-4209-a80a-15240a0f0e63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:06.509997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-23dfdee4-7fe3-4209-a80a-15240a0f0e63 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044347 Aug 24 05:14:06.510594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 735/1361] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:06.724687 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:14:06.724979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:14:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:14:07.181828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-778caf2f-d4eb-4546-a6e2-fb8ebf6b022e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:07.184082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-778caf2f-d4eb-4546-a6e2-fb8ebf6b022e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:07.190229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-778caf2f-d4eb-4546-a6e2-fb8ebf6b022e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:07.190728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-778caf2f-d4eb-4546-a6e2-fb8ebf6b022e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:07.191221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-778caf2f-d4eb-4546-a6e2-fb8ebf6b022e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:07.191914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-778caf2f-d4eb-4546-a6e2-fb8ebf6b022e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:07.192355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-778caf2f-d4eb-4546-a6e2-fb8ebf6b022e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:07.192768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-778caf2f-d4eb-4546-a6e2-fb8ebf6b022e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:07.224122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-778caf2f-d4eb-4546-a6e2-fb8ebf6b022e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046387 Aug 24 05:14:07.224672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 627/1362] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:07.458670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-23fd0fb8-0ffa-4658-aaa8-c90f5e591bfa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:07.460823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-23fd0fb8-0ffa-4658-aaa8-c90f5e591bfa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:07.467501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23fd0fb8-0ffa-4658-aaa8-c90f5e591bfa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:07.467976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23fd0fb8-0ffa-4658-aaa8-c90f5e591bfa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:07.468404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23fd0fb8-0ffa-4658-aaa8-c90f5e591bfa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:07.469093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23fd0fb8-0ffa-4658-aaa8-c90f5e591bfa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:07.469532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23fd0fb8-0ffa-4658-aaa8-c90f5e591bfa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:07.469944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23fd0fb8-0ffa-4658-aaa8-c90f5e591bfa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:07.502420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-23fd0fb8-0ffa-4658-aaa8-c90f5e591bfa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047595 Aug 24 05:14:07.503024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 736/1363] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:07.522336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6a1a1c35-f0b2-4ea6-9e4a-f3365a6c9499 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:07.524573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6a1a1c35-f0b2-4ea6-9e4a-f3365a6c9499 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:07.533149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a1a1c35-f0b2-4ea6-9e4a-f3365a6c9499 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:07.533639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a1a1c35-f0b2-4ea6-9e4a-f3365a6c9499 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:07.534078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a1a1c35-f0b2-4ea6-9e4a-f3365a6c9499 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:07.534893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a1a1c35-f0b2-4ea6-9e4a-f3365a6c9499 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:07.535351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a1a1c35-f0b2-4ea6-9e4a-f3365a6c9499 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:07.535780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a1a1c35-f0b2-4ea6-9e4a-f3365a6c9499 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:07.566940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6a1a1c35-f0b2-4ea6-9e4a-f3365a6c9499 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048574 Aug 24 05:14:07.567498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 628/1364] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:08.237064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-16329f2c-6734-4b60-b2a5-e7aa2e1bb3db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:08.239276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-16329f2c-6734-4b60-b2a5-e7aa2e1bb3db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:08.241201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=86 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:08.247137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16329f2c-6734-4b60-b2a5-e7aa2e1bb3db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:08.247617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16329f2c-6734-4b60-b2a5-e7aa2e1bb3db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:08.248046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16329f2c-6734-4b60-b2a5-e7aa2e1bb3db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:08.248737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16329f2c-6734-4b60-b2a5-e7aa2e1bb3db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:08.249179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16329f2c-6734-4b60-b2a5-e7aa2e1bb3db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:08.249593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16329f2c-6734-4b60-b2a5-e7aa2e1bb3db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:08.279152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-16329f2c-6734-4b60-b2a5-e7aa2e1bb3db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045993 Aug 24 05:14:08.280032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 737/1365] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:08.516119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f2a2b845-c17c-44a2-a65f-01fa3aeb439d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:08.518235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f2a2b845-c17c-44a2-a65f-01fa3aeb439d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:08.524486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a2b845-c17c-44a2-a65f-01fa3aeb439d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:08.525115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a2b845-c17c-44a2-a65f-01fa3aeb439d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:08.525396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a2b845-c17c-44a2-a65f-01fa3aeb439d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:08.526122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a2b845-c17c-44a2-a65f-01fa3aeb439d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:08.526578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a2b845-c17c-44a2-a65f-01fa3aeb439d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:08.527040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2a2b845-c17c-44a2-a65f-01fa3aeb439d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:08.558298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f2a2b845-c17c-44a2-a65f-01fa3aeb439d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046847 Aug 24 05:14:08.558870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 629/1366] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:08.580302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-afa5a502-a8c8-4552-bc13-b6d88e320d70 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:08.582559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-afa5a502-a8c8-4552-bc13-b6d88e320d70 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:08.589752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afa5a502-a8c8-4552-bc13-b6d88e320d70 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:08.590223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afa5a502-a8c8-4552-bc13-b6d88e320d70 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:08.590933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afa5a502-a8c8-4552-bc13-b6d88e320d70 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:08.591589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afa5a502-a8c8-4552-bc13-b6d88e320d70 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:08.592122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afa5a502-a8c8-4552-bc13-b6d88e320d70 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:08.592613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-afa5a502-a8c8-4552-bc13-b6d88e320d70 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:08.625058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-afa5a502-a8c8-4552-bc13-b6d88e320d70 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049532 Aug 24 05:14:08.625624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 738/1367] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:09.291075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bf9c41fe-728b-4269-ab62-ccb93c8984ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:09.293435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bf9c41fe-728b-4269-ab62-ccb93c8984ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:09.299532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf9c41fe-728b-4269-ab62-ccb93c8984ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.300016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf9c41fe-728b-4269-ab62-ccb93c8984ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.300453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf9c41fe-728b-4269-ab62-ccb93c8984ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.301143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf9c41fe-728b-4269-ab62-ccb93c8984ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.301859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf9c41fe-728b-4269-ab62-ccb93c8984ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.302279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf9c41fe-728b-4269-ab62-ccb93c8984ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.334815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bf9c41fe-728b-4269-ab62-ccb93c8984ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047755 Aug 24 05:14:09.335377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 630/1368] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:09.570800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6967fab0-ad95-41cb-b19c-ed7ef664a150 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:09.572874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6967fab0-ad95-41cb-b19c-ed7ef664a150 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:09.579279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6967fab0-ad95-41cb-b19c-ed7ef664a150 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.579754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6967fab0-ad95-41cb-b19c-ed7ef664a150 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.580182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6967fab0-ad95-41cb-b19c-ed7ef664a150 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.580871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6967fab0-ad95-41cb-b19c-ed7ef664a150 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.581407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6967fab0-ad95-41cb-b19c-ed7ef664a150 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.581706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6967fab0-ad95-41cb-b19c-ed7ef664a150 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.613195 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6967fab0-ad95-41cb-b19c-ed7ef664a150 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046454 Aug 24 05:14:09.613761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 739/1369] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:09.637597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d71f87e5-3ca8-4f76-8b34-24a33d4b6112 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:09.639848 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d71f87e5-3ca8-4f76-8b34-24a33d4b6112 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:09.646499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d71f87e5-3ca8-4f76-8b34-24a33d4b6112 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.647015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d71f87e5-3ca8-4f76-8b34-24a33d4b6112 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.647454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d71f87e5-3ca8-4f76-8b34-24a33d4b6112 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.648153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d71f87e5-3ca8-4f76-8b34-24a33d4b6112 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:09.648607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d71f87e5-3ca8-4f76-8b34-24a33d4b6112 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:09.649034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d71f87e5-3ca8-4f76-8b34-24a33d4b6112 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:09.680213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d71f87e5-3ca8-4f76-8b34-24a33d4b6112 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046595 Aug 24 05:14:09.680832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 631/1370] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:10.347507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6a458de2-5bfc-4e98-b422-3e513cf378d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:10.349545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6a458de2-5bfc-4e98-b422-3e513cf378d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:10.355770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a458de2-5bfc-4e98-b422-3e513cf378d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:10.356247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a458de2-5bfc-4e98-b422-3e513cf378d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:10.356680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a458de2-5bfc-4e98-b422-3e513cf378d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:10.357378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a458de2-5bfc-4e98-b422-3e513cf378d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:10.357813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a458de2-5bfc-4e98-b422-3e513cf378d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:10.358227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a458de2-5bfc-4e98-b422-3e513cf378d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:10.389067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6a458de2-5bfc-4e98-b422-3e513cf378d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045521 Aug 24 05:14:10.389634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 740/1371] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:10.626117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b816652a-6813-42ee-bba8-d93505d36dfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:10.628158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b816652a-6813-42ee-bba8-d93505d36dfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:10.634284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b816652a-6813-42ee-bba8-d93505d36dfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:10.634801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b816652a-6813-42ee-bba8-d93505d36dfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:10.635240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b816652a-6813-42ee-bba8-d93505d36dfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:10.636717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b816652a-6813-42ee-bba8-d93505d36dfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:10.637178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b816652a-6813-42ee-bba8-d93505d36dfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:10.637631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b816652a-6813-42ee-bba8-d93505d36dfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:10.668217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b816652a-6813-42ee-bba8-d93505d36dfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046992 Aug 24 05:14:10.668783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 632/1372] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:10.696323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1d24b5c1-b9a5-4ad0-aca1-4e4d7187858b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:10.699267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1d24b5c1-b9a5-4ad0-aca1-4e4d7187858b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:10.705827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d24b5c1-b9a5-4ad0-aca1-4e4d7187858b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:10.706302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d24b5c1-b9a5-4ad0-aca1-4e4d7187858b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:10.706742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d24b5c1-b9a5-4ad0-aca1-4e4d7187858b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:10.707437 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d24b5c1-b9a5-4ad0-aca1-4e4d7187858b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:10.707879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d24b5c1-b9a5-4ad0-aca1-4e4d7187858b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:10.708289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d24b5c1-b9a5-4ad0-aca1-4e4d7187858b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:10.738917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1d24b5c1-b9a5-4ad0-aca1-4e4d7187858b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049402 Aug 24 05:14:10.739486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 741/1373] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:11.402108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-83e25ffa-b001-4501-9799-1f035756c630 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:11.404326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-83e25ffa-b001-4501-9799-1f035756c630 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:11.410417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e25ffa-b001-4501-9799-1f035756c630 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:11.410941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e25ffa-b001-4501-9799-1f035756c630 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:11.411374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e25ffa-b001-4501-9799-1f035756c630 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:11.412065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e25ffa-b001-4501-9799-1f035756c630 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:11.412517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e25ffa-b001-4501-9799-1f035756c630 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:11.412937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83e25ffa-b001-4501-9799-1f035756c630 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:11.444434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-83e25ffa-b001-4501-9799-1f035756c630 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046920 Aug 24 05:14:11.445002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 633/1374] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:11.680303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f1502f0e-4771-4673-a381-cae94758ecc1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:11.682484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f1502f0e-4771-4673-a381-cae94758ecc1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:11.688760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1502f0e-4771-4673-a381-cae94758ecc1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:11.689239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1502f0e-4771-4673-a381-cae94758ecc1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:11.689671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1502f0e-4771-4673-a381-cae94758ecc1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:11.690368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1502f0e-4771-4673-a381-cae94758ecc1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:11.690843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1502f0e-4771-4673-a381-cae94758ecc1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:11.691265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1502f0e-4771-4673-a381-cae94758ecc1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:11.724700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f1502f0e-4771-4673-a381-cae94758ecc1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048687 Aug 24 05:14:11.725398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 742/1375] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:11.750976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3b2a7dd6-d132-4fa7-beeb-ea4ed02cba8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:11.754667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3b2a7dd6-d132-4fa7-beeb-ea4ed02cba8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:11.762086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dd6-d132-4fa7-beeb-ea4ed02cba8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:11.762570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dd6-d132-4fa7-beeb-ea4ed02cba8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:11.763036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dd6-d132-4fa7-beeb-ea4ed02cba8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:11.764600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dd6-d132-4fa7-beeb-ea4ed02cba8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:11.764600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dd6-d132-4fa7-beeb-ea4ed02cba8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:11.764600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b2a7dd6-d132-4fa7-beeb-ea4ed02cba8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:11.797456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3b2a7dd6-d132-4fa7-beeb-ea4ed02cba8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050493 Aug 24 05:14:11.798022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 634/1376] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:12.456824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c8add333-3083-44dd-88a9-b3bf43e2a27b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:12.459107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c8add333-3083-44dd-88a9-b3bf43e2a27b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:12.465827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c8add333-3083-44dd-88a9-b3bf43e2a27b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:12.466300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c8add333-3083-44dd-88a9-b3bf43e2a27b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:12.466750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c8add333-3083-44dd-88a9-b3bf43e2a27b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:12.467436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c8add333-3083-44dd-88a9-b3bf43e2a27b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:12.467877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c8add333-3083-44dd-88a9-b3bf43e2a27b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:12.468284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c8add333-3083-44dd-88a9-b3bf43e2a27b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:12.471981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:12.498314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c8add333-3083-44dd-88a9-b3bf43e2a27b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 Aug 24 05:14:12.498879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 743/1377] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:12.737245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8c99bb43-0a7f-4777-a0e6-6a5bad74ac26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:12.739413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8c99bb43-0a7f-4777-a0e6-6a5bad74ac26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:12.745939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c99bb43-0a7f-4777-a0e6-6a5bad74ac26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:12.746455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c99bb43-0a7f-4777-a0e6-6a5bad74ac26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:12.746938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c99bb43-0a7f-4777-a0e6-6a5bad74ac26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:12.747601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c99bb43-0a7f-4777-a0e6-6a5bad74ac26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:12.748065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c99bb43-0a7f-4777-a0e6-6a5bad74ac26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:12.748464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c99bb43-0a7f-4777-a0e6-6a5bad74ac26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:12.774721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:12.781112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8c99bb43-0a7f-4777-a0e6-6a5bad74ac26 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047780 Aug 24 05:14:12.781689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 635/1378] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:12.810152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a7aefa2b-8818-4634-a1d2-aa7f13b605b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:12.812474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a7aefa2b-8818-4634-a1d2-aa7f13b605b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:12.818949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7aefa2b-8818-4634-a1d2-aa7f13b605b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:12.819421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7aefa2b-8818-4634-a1d2-aa7f13b605b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:12.819944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7aefa2b-8818-4634-a1d2-aa7f13b605b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:12.820627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7aefa2b-8818-4634-a1d2-aa7f13b605b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:12.821068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7aefa2b-8818-4634-a1d2-aa7f13b605b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:12.821481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7aefa2b-8818-4634-a1d2-aa7f13b605b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:12.852860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a7aefa2b-8818-4634-a1d2-aa7f13b605b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047206 Aug 24 05:14:12.853499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 744/1379] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:13.510859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e01c20ee-8840-4e4d-92a0-e4f40c95d3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:13.513094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e01c20ee-8840-4e4d-92a0-e4f40c95d3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:13.519373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e01c20ee-8840-4e4d-92a0-e4f40c95d3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:13.519854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e01c20ee-8840-4e4d-92a0-e4f40c95d3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:13.520287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e01c20ee-8840-4e4d-92a0-e4f40c95d3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:13.520984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e01c20ee-8840-4e4d-92a0-e4f40c95d3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:13.521435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e01c20ee-8840-4e4d-92a0-e4f40c95d3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:13.521858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e01c20ee-8840-4e4d-92a0-e4f40c95d3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:13.554248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e01c20ee-8840-4e4d-92a0-e4f40c95d3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047325 Aug 24 05:14:13.554840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 636/1380] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:13.794323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4ba51f21-ad33-4f75-8dcd-131d15d356eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:13.796504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4ba51f21-ad33-4f75-8dcd-131d15d356eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:13.803063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ba51f21-ad33-4f75-8dcd-131d15d356eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:13.803499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ba51f21-ad33-4f75-8dcd-131d15d356eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:13.803938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ba51f21-ad33-4f75-8dcd-131d15d356eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:13.804634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ba51f21-ad33-4f75-8dcd-131d15d356eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:13.805086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ba51f21-ad33-4f75-8dcd-131d15d356eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:13.805505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ba51f21-ad33-4f75-8dcd-131d15d356eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:13.835997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4ba51f21-ad33-4f75-8dcd-131d15d356eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046403 Aug 24 05:14:13.836752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 745/1381] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:13.865275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4fc1558b-f9bb-4afb-9306-f9c396bafd6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:13.867453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4fc1558b-f9bb-4afb-9306-f9c396bafd6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:13.874351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc1558b-f9bb-4afb-9306-f9c396bafd6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:13.874563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc1558b-f9bb-4afb-9306-f9c396bafd6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:13.875228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc1558b-f9bb-4afb-9306-f9c396bafd6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:13.875921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc1558b-f9bb-4afb-9306-f9c396bafd6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:13.876370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc1558b-f9bb-4afb-9306-f9c396bafd6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:13.876783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fc1558b-f9bb-4afb-9306-f9c396bafd6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:13.908000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4fc1558b-f9bb-4afb-9306-f9c396bafd6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046645 Aug 24 05:14:13.908564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 637/1382] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:14.566731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9e9ba516-3aaa-4511-88d2-13d7b78afb87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:14.568860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9e9ba516-3aaa-4511-88d2-13d7b78afb87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:14.575112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9ba516-3aaa-4511-88d2-13d7b78afb87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:14.575601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9ba516-3aaa-4511-88d2-13d7b78afb87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:14.576100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9ba516-3aaa-4511-88d2-13d7b78afb87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:14.576753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9ba516-3aaa-4511-88d2-13d7b78afb87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:14.577207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9ba516-3aaa-4511-88d2-13d7b78afb87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:14.577625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9ba516-3aaa-4511-88d2-13d7b78afb87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:14.610203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9e9ba516-3aaa-4511-88d2-13d7b78afb87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047409 Aug 24 05:14:14.610792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 746/1383] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:14.849379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c4c173c1-fcfe-4e81-a1fb-68c5e78bbb8c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:14.851556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c4c173c1-fcfe-4e81-a1fb-68c5e78bbb8c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:14.858505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4c173c1-fcfe-4e81-a1fb-68c5e78bbb8c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:14.859054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4c173c1-fcfe-4e81-a1fb-68c5e78bbb8c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:14.859493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4c173c1-fcfe-4e81-a1fb-68c5e78bbb8c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:14.860200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4c173c1-fcfe-4e81-a1fb-68c5e78bbb8c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:14.860650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4c173c1-fcfe-4e81-a1fb-68c5e78bbb8c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:14.861071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4c173c1-fcfe-4e81-a1fb-68c5e78bbb8c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:14.892026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c4c173c1-fcfe-4e81-a1fb-68c5e78bbb8c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046621 Aug 24 05:14:14.892819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 638/1384] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:14 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:14.921973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f6d34a8b-d33a-449b-afc9-d51e5b7ceb16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:14.924146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f6d34a8b-d33a-449b-afc9-d51e5b7ceb16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:14.930749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6d34a8b-d33a-449b-afc9-d51e5b7ceb16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:14.931232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6d34a8b-d33a-449b-afc9-d51e5b7ceb16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:14.931667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6d34a8b-d33a-449b-afc9-d51e5b7ceb16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:14.932636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6d34a8b-d33a-449b-afc9-d51e5b7ceb16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:14.933210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6d34a8b-d33a-449b-afc9-d51e5b7ceb16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:14.933640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6d34a8b-d33a-449b-afc9-d51e5b7ceb16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:14.965710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f6d34a8b-d33a-449b-afc9-d51e5b7ceb16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047657 Aug 24 05:14:14.966356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 747/1385] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:15.622316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-99d20780-ca35-4c5c-8884-95bc6333a104 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:15.624508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-99d20780-ca35-4c5c-8884-95bc6333a104 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:15.630737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99d20780-ca35-4c5c-8884-95bc6333a104 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:15.631232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99d20780-ca35-4c5c-8884-95bc6333a104 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:15.631672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99d20780-ca35-4c5c-8884-95bc6333a104 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:15.632380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99d20780-ca35-4c5c-8884-95bc6333a104 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:15.632836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99d20780-ca35-4c5c-8884-95bc6333a104 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:15.633261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99d20780-ca35-4c5c-8884-95bc6333a104 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:15.663019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-99d20780-ca35-4c5c-8884-95bc6333a104 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Aug 24 05:14:15.663577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 639/1386] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:15.904995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4ffee30f-a270-49cf-b867-54056f857781 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:15.907321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4ffee30f-a270-49cf-b867-54056f857781 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:15.913579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ffee30f-a270-49cf-b867-54056f857781 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:15.914057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ffee30f-a270-49cf-b867-54056f857781 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:15.914490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ffee30f-a270-49cf-b867-54056f857781 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:15.915223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ffee30f-a270-49cf-b867-54056f857781 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:15.915669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ffee30f-a270-49cf-b867-54056f857781 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:15.916117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ffee30f-a270-49cf-b867-54056f857781 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:15.950508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4ffee30f-a270-49cf-b867-54056f857781 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050022 Aug 24 05:14:15.951212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 748/1387] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:15.977561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1c0322f6-0677-46df-bef1-fa65e1a111f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:15.980410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1c0322f6-0677-46df-bef1-fa65e1a111f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:15.986914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c0322f6-0677-46df-bef1-fa65e1a111f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:15.987328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c0322f6-0677-46df-bef1-fa65e1a111f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:15.987761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c0322f6-0677-46df-bef1-fa65e1a111f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:15.988451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c0322f6-0677-46df-bef1-fa65e1a111f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:15.988897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c0322f6-0677-46df-bef1-fa65e1a111f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:15.989317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c0322f6-0677-46df-bef1-fa65e1a111f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:16.018538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1c0322f6-0677-46df-bef1-fa65e1a111f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Aug 24 05:14:16.019353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 640/1388] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:16.675837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c0090b1d-e63e-4e84-853e-969d2dd0971c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:16.678248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c0090b1d-e63e-4e84-853e-969d2dd0971c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:16.686932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0090b1d-e63e-4e84-853e-969d2dd0971c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:16.687432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0090b1d-e63e-4e84-853e-969d2dd0971c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:16.687873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0090b1d-e63e-4e84-853e-969d2dd0971c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:16.688644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0090b1d-e63e-4e84-853e-969d2dd0971c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:16.689099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0090b1d-e63e-4e84-853e-969d2dd0971c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:16.689524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0090b1d-e63e-4e84-853e-969d2dd0971c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:16.721880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c0090b1d-e63e-4e84-853e-969d2dd0971c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049922 Aug 24 05:14:16.722427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 749/1389] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:16 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:16.962992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6c68f2f8-fa48-44ee-b2ba-423ac7125fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:16.965506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6c68f2f8-fa48-44ee-b2ba-423ac7125fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:16.971674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6c68f2f8-fa48-44ee-b2ba-423ac7125fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:16.972159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6c68f2f8-fa48-44ee-b2ba-423ac7125fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:16.972596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6c68f2f8-fa48-44ee-b2ba-423ac7125fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:16.973298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6c68f2f8-fa48-44ee-b2ba-423ac7125fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:16.973772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6c68f2f8-fa48-44ee-b2ba-423ac7125fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:16.974175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6c68f2f8-fa48-44ee-b2ba-423ac7125fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:17.007177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6c68f2f8-fa48-44ee-b2ba-423ac7125fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048068 Aug 24 05:14:17.007876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 641/1390] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:17.031351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a5e31ce9-c7f6-4a8e-82b7-97766acbf3d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:17.033609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a5e31ce9-c7f6-4a8e-82b7-97766acbf3d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:17.043675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5e31ce9-c7f6-4a8e-82b7-97766acbf3d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:17.044163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5e31ce9-c7f6-4a8e-82b7-97766acbf3d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:17.044603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5e31ce9-c7f6-4a8e-82b7-97766acbf3d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:17.045340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5e31ce9-c7f6-4a8e-82b7-97766acbf3d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:17.045790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5e31ce9-c7f6-4a8e-82b7-97766acbf3d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:17.046210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a5e31ce9-c7f6-4a8e-82b7-97766acbf3d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:17.087524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a5e31ce9-c7f6-4a8e-82b7-97766acbf3d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060156 Aug 24 05:14:17.088093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 750/1391] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:17.734335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8647bd9b-343a-4d8c-a080-a1ae63f9c746 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:17.736518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8647bd9b-343a-4d8c-a080-a1ae63f9c746 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:17.742666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8647bd9b-343a-4d8c-a080-a1ae63f9c746 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:17.743176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8647bd9b-343a-4d8c-a080-a1ae63f9c746 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:17.743616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8647bd9b-343a-4d8c-a080-a1ae63f9c746 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:17.744312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8647bd9b-343a-4d8c-a080-a1ae63f9c746 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:17.744905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8647bd9b-343a-4d8c-a080-a1ae63f9c746 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:17.745652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8647bd9b-343a-4d8c-a080-a1ae63f9c746 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:17.779300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8647bd9b-343a-4d8c-a080-a1ae63f9c746 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049015 Aug 24 05:14:17.779856 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 642/1392] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:18.020197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ea194428-fde4-4760-a3da-fc81c751cf27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:18.022296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ea194428-fde4-4760-a3da-fc81c751cf27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:18.029223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea194428-fde4-4760-a3da-fc81c751cf27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:18.029700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea194428-fde4-4760-a3da-fc81c751cf27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:18.030133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea194428-fde4-4760-a3da-fc81c751cf27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:18.030867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea194428-fde4-4760-a3da-fc81c751cf27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:18.031316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea194428-fde4-4760-a3da-fc81c751cf27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:18.031737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea194428-fde4-4760-a3da-fc81c751cf27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:18.063025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ea194428-fde4-4760-a3da-fc81c751cf27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046787 Aug 24 05:14:18.063592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 751/1393] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:18.099867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-32fec369-0719-484b-9f6c-4edc258a3f83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:18.102022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-32fec369-0719-484b-9f6c-4edc258a3f83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:18.108831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fec369-0719-484b-9f6c-4edc258a3f83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:18.109317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fec369-0719-484b-9f6c-4edc258a3f83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:18.109751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fec369-0719-484b-9f6c-4edc258a3f83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:18.110456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fec369-0719-484b-9f6c-4edc258a3f83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:18.110931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fec369-0719-484b-9f6c-4edc258a3f83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:18.111354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32fec369-0719-484b-9f6c-4edc258a3f83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:18.143585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-32fec369-0719-484b-9f6c-4edc258a3f83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047660 Aug 24 05:14:18.144149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 643/1394] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:18.791630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-85658343-ca85-4c5f-92e0-4977068f6aec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:18.793871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-85658343-ca85-4c5f-92e0-4977068f6aec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:18.800011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85658343-ca85-4c5f-92e0-4977068f6aec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:18.800490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85658343-ca85-4c5f-92e0-4977068f6aec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:18.800923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85658343-ca85-4c5f-92e0-4977068f6aec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:18.801881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85658343-ca85-4c5f-92e0-4977068f6aec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:18.802358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85658343-ca85-4c5f-92e0-4977068f6aec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:18.802810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85658343-ca85-4c5f-92e0-4977068f6aec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:18.834490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-85658343-ca85-4c5f-92e0-4977068f6aec tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046867 Aug 24 05:14:18.835090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 752/1395] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:19.075943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ec89a7d8-5670-4264-a7ad-1ae7b412a3be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:19.078109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ec89a7d8-5670-4264-a7ad-1ae7b412a3be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:19.084748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec89a7d8-5670-4264-a7ad-1ae7b412a3be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:19.085231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec89a7d8-5670-4264-a7ad-1ae7b412a3be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:19.085667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec89a7d8-5670-4264-a7ad-1ae7b412a3be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:19.086367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec89a7d8-5670-4264-a7ad-1ae7b412a3be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:19.086861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec89a7d8-5670-4264-a7ad-1ae7b412a3be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:19.087284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec89a7d8-5670-4264-a7ad-1ae7b412a3be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:19.120523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ec89a7d8-5670-4264-a7ad-1ae7b412a3be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048661 Aug 24 05:14:19.121511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 644/1396] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:19.156059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c0c1eabb-cb6a-40c7-ab94-2579fcebfbb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:19.158229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c0c1eabb-cb6a-40c7-ab94-2579fcebfbb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:19.164986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0c1eabb-cb6a-40c7-ab94-2579fcebfbb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:19.165468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0c1eabb-cb6a-40c7-ab94-2579fcebfbb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:19.165899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0c1eabb-cb6a-40c7-ab94-2579fcebfbb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:19.167214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0c1eabb-cb6a-40c7-ab94-2579fcebfbb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:19.167909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0c1eabb-cb6a-40c7-ab94-2579fcebfbb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:19.168334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0c1eabb-cb6a-40c7-ab94-2579fcebfbb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:19.199211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c0c1eabb-cb6a-40c7-ab94-2579fcebfbb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047250 Aug 24 05:14:19.200158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 753/1397] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:19.846821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2eae654b-865e-41b4-a1a7-268d5a53f0a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:19.848868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2eae654b-865e-41b4-a1a7-268d5a53f0a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:19.856038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2eae654b-865e-41b4-a1a7-268d5a53f0a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:19.856521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2eae654b-865e-41b4-a1a7-268d5a53f0a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:19.856961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2eae654b-865e-41b4-a1a7-268d5a53f0a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:19.857689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2eae654b-865e-41b4-a1a7-268d5a53f0a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:19.858140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2eae654b-865e-41b4-a1a7-268d5a53f0a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:19.858567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2eae654b-865e-41b4-a1a7-268d5a53f0a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:19.889310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2eae654b-865e-41b4-a1a7-268d5a53f0a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046546 Aug 24 05:14:19.889877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 645/1398] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:20.132188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1b15d0ed-6eb9-4507-916a-cc8226bdb00a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:20.134440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1b15d0ed-6eb9-4507-916a-cc8226bdb00a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:20.141411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b15d0ed-6eb9-4507-916a-cc8226bdb00a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:20.141886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b15d0ed-6eb9-4507-916a-cc8226bdb00a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:20.142319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b15d0ed-6eb9-4507-916a-cc8226bdb00a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:20.143044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b15d0ed-6eb9-4507-916a-cc8226bdb00a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:20.143492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b15d0ed-6eb9-4507-916a-cc8226bdb00a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:20.143911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b15d0ed-6eb9-4507-916a-cc8226bdb00a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:20.173987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1b15d0ed-6eb9-4507-916a-cc8226bdb00a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Aug 24 05:14:20.174608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 754/1399] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:20.211521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7338cead-de3f-4491-9c0e-53004c28e4e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:20.214299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7338cead-de3f-4491-9c0e-53004c28e4e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:20.221024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7338cead-de3f-4491-9c0e-53004c28e4e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:20.221500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7338cead-de3f-4491-9c0e-53004c28e4e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:20.221926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7338cead-de3f-4491-9c0e-53004c28e4e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:20.222613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7338cead-de3f-4491-9c0e-53004c28e4e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:20.223081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7338cead-de3f-4491-9c0e-53004c28e4e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:20.223495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7338cead-de3f-4491-9c0e-53004c28e4e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:20.254135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7338cead-de3f-4491-9c0e-53004c28e4e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046500 Aug 24 05:14:20.254946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 646/1400] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:20.599597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:14:20.599844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:14:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:14:20.902088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7bbcf36b-98d8-4184-b116-859c42c8bb36 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:20.904170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7bbcf36b-98d8-4184-b116-859c42c8bb36 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:20.910540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bbcf36b-98d8-4184-b116-859c42c8bb36 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:20.911053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bbcf36b-98d8-4184-b116-859c42c8bb36 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:20.911489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bbcf36b-98d8-4184-b116-859c42c8bb36 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:20.912183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bbcf36b-98d8-4184-b116-859c42c8bb36 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:20.912632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bbcf36b-98d8-4184-b116-859c42c8bb36 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:20.913054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7bbcf36b-98d8-4184-b116-859c42c8bb36 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:20.945447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7bbcf36b-98d8-4184-b116-859c42c8bb36 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047629 Aug 24 05:14:20.946004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 755/1401] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:21.187308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-67348b79-6b7e-4afb-8429-5fd9c72cce47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:21.189419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-67348b79-6b7e-4afb-8429-5fd9c72cce47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:21.195592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67348b79-6b7e-4afb-8429-5fd9c72cce47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:21.196075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67348b79-6b7e-4afb-8429-5fd9c72cce47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:21.196503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67348b79-6b7e-4afb-8429-5fd9c72cce47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:21.197194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67348b79-6b7e-4afb-8429-5fd9c72cce47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:21.197637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67348b79-6b7e-4afb-8429-5fd9c72cce47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:21.198271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67348b79-6b7e-4afb-8429-5fd9c72cce47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:21.228783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-67348b79-6b7e-4afb-8429-5fd9c72cce47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046147 Aug 24 05:14:21.230094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 647/1402] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:21.267007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a2c9ab25-c37f-4e06-86c4-39b57f725863 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:21.269132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a2c9ab25-c37f-4e06-86c4-39b57f725863 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:21.275514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2c9ab25-c37f-4e06-86c4-39b57f725863 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:21.276518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2c9ab25-c37f-4e06-86c4-39b57f725863 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:21.276951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2c9ab25-c37f-4e06-86c4-39b57f725863 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:21.277750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2c9ab25-c37f-4e06-86c4-39b57f725863 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:21.278190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2c9ab25-c37f-4e06-86c4-39b57f725863 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:21.278602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2c9ab25-c37f-4e06-86c4-39b57f725863 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:21.311356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a2c9ab25-c37f-4e06-86c4-39b57f725863 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048330 Aug 24 05:14:21.311940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 756/1403] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:21.957605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3daf0e46-b0a8-44ae-a758-b1b446527545 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:21.959776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3daf0e46-b0a8-44ae-a758-b1b446527545 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:21.966310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3daf0e46-b0a8-44ae-a758-b1b446527545 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:21.966818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3daf0e46-b0a8-44ae-a758-b1b446527545 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:21.967256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3daf0e46-b0a8-44ae-a758-b1b446527545 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:21.967973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3daf0e46-b0a8-44ae-a758-b1b446527545 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:21.968424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3daf0e46-b0a8-44ae-a758-b1b446527545 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:21.968841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3daf0e46-b0a8-44ae-a758-b1b446527545 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:22.001617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3daf0e46-b0a8-44ae-a758-b1b446527545 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047834 Aug 24 05:14:22.002098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 648/1404] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:22.243800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5c697afe-4c39-4032-b605-8123bce2e01f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:22.246200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5c697afe-4c39-4032-b605-8123bce2e01f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:22.252588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c697afe-4c39-4032-b605-8123bce2e01f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:22.253004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c697afe-4c39-4032-b605-8123bce2e01f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:22.253439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c697afe-4c39-4032-b605-8123bce2e01f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:22.254142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c697afe-4c39-4032-b605-8123bce2e01f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:22.254592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c697afe-4c39-4032-b605-8123bce2e01f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:22.255043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c697afe-4c39-4032-b605-8123bce2e01f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:22.290405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5c697afe-4c39-4032-b605-8123bce2e01f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050510 Aug 24 05:14:22.291208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 757/1405] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:22 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:22.328047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-26ce0e1a-bf10-4d4a-8c0c-e2550596ecec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:22.331444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-26ce0e1a-bf10-4d4a-8c0c-e2550596ecec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:22.338268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26ce0e1a-bf10-4d4a-8c0c-e2550596ecec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:22.339504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26ce0e1a-bf10-4d4a-8c0c-e2550596ecec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:22.339935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26ce0e1a-bf10-4d4a-8c0c-e2550596ecec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:22.340631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26ce0e1a-bf10-4d4a-8c0c-e2550596ecec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:22.341081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26ce0e1a-bf10-4d4a-8c0c-e2550596ecec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:22.341502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26ce0e1a-bf10-4d4a-8c0c-e2550596ecec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:22.374590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-26ce0e1a-bf10-4d4a-8c0c-e2550596ecec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053920 Aug 24 05:14:22.375227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 649/1406] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:23.016417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-efb2314d-3f1f-47cd-912f-61c62a587383 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:23.019127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-efb2314d-3f1f-47cd-912f-61c62a587383 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:23.025436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efb2314d-3f1f-47cd-912f-61c62a587383 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:23.026603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efb2314d-3f1f-47cd-912f-61c62a587383 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:23.027162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efb2314d-3f1f-47cd-912f-61c62a587383 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:23.028061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efb2314d-3f1f-47cd-912f-61c62a587383 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:23.028514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efb2314d-3f1f-47cd-912f-61c62a587383 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:23.028941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efb2314d-3f1f-47cd-912f-61c62a587383 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:23.060127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-efb2314d-3f1f-47cd-912f-61c62a587383 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050034 Aug 24 05:14:23.060862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 758/1407] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:23.303135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2ba8d0e0-5d80-4b2d-9037-43d118241152 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:23.305188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2ba8d0e0-5d80-4b2d-9037-43d118241152 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:23.311969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba8d0e0-5d80-4b2d-9037-43d118241152 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:23.312455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba8d0e0-5d80-4b2d-9037-43d118241152 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:23.312891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba8d0e0-5d80-4b2d-9037-43d118241152 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:23.313592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba8d0e0-5d80-4b2d-9037-43d118241152 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:23.314045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba8d0e0-5d80-4b2d-9037-43d118241152 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:23.314629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba8d0e0-5d80-4b2d-9037-43d118241152 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:23.346585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2ba8d0e0-5d80-4b2d-9037-43d118241152 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047835 Aug 24 05:14:23.347393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 650/1408] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:23.387775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0536f660-8633-464b-aa7c-0a6f07041118 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:23.389979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0536f660-8633-464b-aa7c-0a6f07041118 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:23.396552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0536f660-8633-464b-aa7c-0a6f07041118 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:23.397029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0536f660-8633-464b-aa7c-0a6f07041118 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:23.397466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0536f660-8633-464b-aa7c-0a6f07041118 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:23.398461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0536f660-8633-464b-aa7c-0a6f07041118 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:23.398616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0536f660-8633-464b-aa7c-0a6f07041118 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:23.399154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0536f660-8633-464b-aa7c-0a6f07041118 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:23.425103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:23.434402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0536f660-8633-464b-aa7c-0a6f07041118 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050800 Aug 24 05:14:23.435108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 759/1409] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:24.072821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-62bfb1eb-f42a-4416-ab7c-6ce98de404d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:24.075219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-62bfb1eb-f42a-4416-ab7c-6ce98de404d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:24.081241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62bfb1eb-f42a-4416-ab7c-6ce98de404d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:24.081712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62bfb1eb-f42a-4416-ab7c-6ce98de404d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:24.082139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62bfb1eb-f42a-4416-ab7c-6ce98de404d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:24.082847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62bfb1eb-f42a-4416-ab7c-6ce98de404d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:24.083295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62bfb1eb-f42a-4416-ab7c-6ce98de404d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:24.083710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62bfb1eb-f42a-4416-ab7c-6ce98de404d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:24.114943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-62bfb1eb-f42a-4416-ab7c-6ce98de404d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046177 Aug 24 05:14:24.115500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 651/1410] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:24.360113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d1b3180a-5b41-4b09-a66c-3dc06914b4d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:24.362152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d1b3180a-5b41-4b09-a66c-3dc06914b4d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:24.368599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1b3180a-5b41-4b09-a66c-3dc06914b4d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:24.369076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1b3180a-5b41-4b09-a66c-3dc06914b4d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:24.369583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1b3180a-5b41-4b09-a66c-3dc06914b4d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:24.370280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1b3180a-5b41-4b09-a66c-3dc06914b4d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:24.370750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1b3180a-5b41-4b09-a66c-3dc06914b4d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:24.371175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1b3180a-5b41-4b09-a66c-3dc06914b4d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:24.401696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d1b3180a-5b41-4b09-a66c-3dc06914b4d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044972 Aug 24 05:14:24.402377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 760/1411] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:24 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:24.446565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c2aa2fb0-3310-4eba-9611-af0be64dc703 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:24.449375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c2aa2fb0-3310-4eba-9611-af0be64dc703 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:24.456442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fb0-3310-4eba-9611-af0be64dc703 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:24.456926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fb0-3310-4eba-9611-af0be64dc703 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:24.457365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fb0-3310-4eba-9611-af0be64dc703 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:24.458067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fb0-3310-4eba-9611-af0be64dc703 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:24.458595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fb0-3310-4eba-9611-af0be64dc703 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:24.459096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2aa2fb0-3310-4eba-9611-af0be64dc703 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:24.477318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:24.492579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c2aa2fb0-3310-4eba-9611-af0be64dc703 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049952 Aug 24 05:14:24.493144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 652/1412] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:25.126905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-13271a3b-798e-421d-ae7c-214e47f4c52f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:25.129019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-13271a3b-798e-421d-ae7c-214e47f4c52f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:25.135401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13271a3b-798e-421d-ae7c-214e47f4c52f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:25.136303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13271a3b-798e-421d-ae7c-214e47f4c52f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:25.136532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13271a3b-798e-421d-ae7c-214e47f4c52f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:25.137227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13271a3b-798e-421d-ae7c-214e47f4c52f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:25.137676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13271a3b-798e-421d-ae7c-214e47f4c52f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:25.138101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13271a3b-798e-421d-ae7c-214e47f4c52f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:25.171874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-13271a3b-798e-421d-ae7c-214e47f4c52f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048967 Aug 24 05:14:25.172447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 761/1413] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:25.414443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-389dd024-d815-4816-9f6b-0d5b1e8289fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:25.416635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-389dd024-d815-4816-9f6b-0d5b1e8289fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:25.423095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-389dd024-d815-4816-9f6b-0d5b1e8289fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:25.423585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-389dd024-d815-4816-9f6b-0d5b1e8289fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:25.424054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-389dd024-d815-4816-9f6b-0d5b1e8289fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:25.424758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-389dd024-d815-4816-9f6b-0d5b1e8289fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:25.425211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-389dd024-d815-4816-9f6b-0d5b1e8289fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:25.425636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-389dd024-d815-4816-9f6b-0d5b1e8289fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:25.457090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-389dd024-d815-4816-9f6b-0d5b1e8289fe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046749 Aug 24 05:14:25.457893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 653/1414] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:25.505960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a53c4148-04a7-457f-ac87-8a65471a2fb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:25.508287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a53c4148-04a7-457f-ac87-8a65471a2fb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:25.516374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a53c4148-04a7-457f-ac87-8a65471a2fb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:25.516847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a53c4148-04a7-457f-ac87-8a65471a2fb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:25.517277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a53c4148-04a7-457f-ac87-8a65471a2fb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:25.517968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a53c4148-04a7-457f-ac87-8a65471a2fb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:25.518414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a53c4148-04a7-457f-ac87-8a65471a2fb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:25.518868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a53c4148-04a7-457f-ac87-8a65471a2fb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:25.550206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a53c4148-04a7-457f-ac87-8a65471a2fb8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048398 Aug 24 05:14:25.551803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 762/1415] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:26.120757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:14:26.120968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:14:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:14:26.184976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-be98969e-d4ed-4ba6-b590-ba24689f8a51 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:26.187180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-be98969e-d4ed-4ba6-b590-ba24689f8a51 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:26.193390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be98969e-d4ed-4ba6-b590-ba24689f8a51 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:26.193939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be98969e-d4ed-4ba6-b590-ba24689f8a51 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:26.194372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be98969e-d4ed-4ba6-b590-ba24689f8a51 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:26.195128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be98969e-d4ed-4ba6-b590-ba24689f8a51 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:26.195578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be98969e-d4ed-4ba6-b590-ba24689f8a51 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:26.196000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be98969e-d4ed-4ba6-b590-ba24689f8a51 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:26.226087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-be98969e-d4ed-4ba6-b590-ba24689f8a51 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045863 Aug 24 05:14:26.226649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 654/1416] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:26 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:26.470178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-263edae4-356c-457b-b3d6-660d58531c73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:26.472315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-263edae4-356c-457b-b3d6-660d58531c73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:26.478456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263edae4-356c-457b-b3d6-660d58531c73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:26.479652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263edae4-356c-457b-b3d6-660d58531c73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:26.480230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263edae4-356c-457b-b3d6-660d58531c73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:26.480926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263edae4-356c-457b-b3d6-660d58531c73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:26.481369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263edae4-356c-457b-b3d6-660d58531c73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:26.481784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263edae4-356c-457b-b3d6-660d58531c73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:26.514756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-263edae4-356c-457b-b3d6-660d58531c73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048462 Aug 24 05:14:26.515606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 763/1417] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:26.564080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-73af6f89-4bc3-41f8-9dd0-d4b6343573fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:26.566238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-73af6f89-4bc3-41f8-9dd0-d4b6343573fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:26.572381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73af6f89-4bc3-41f8-9dd0-d4b6343573fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:26.573074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73af6f89-4bc3-41f8-9dd0-d4b6343573fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:26.573521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73af6f89-4bc3-41f8-9dd0-d4b6343573fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:26.574223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73af6f89-4bc3-41f8-9dd0-d4b6343573fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:26.574671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73af6f89-4bc3-41f8-9dd0-d4b6343573fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:26.575125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73af6f89-4bc3-41f8-9dd0-d4b6343573fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:26.607173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-73af6f89-4bc3-41f8-9dd0-d4b6343573fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047777 Aug 24 05:14:26.607738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 655/1418] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:27.239814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-59a68523-917f-41ea-9de0-2b226ede3d42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:27.241957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-59a68523-917f-41ea-9de0-2b226ede3d42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:27.248966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59a68523-917f-41ea-9de0-2b226ede3d42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:27.249490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59a68523-917f-41ea-9de0-2b226ede3d42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:27.249891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59a68523-917f-41ea-9de0-2b226ede3d42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:27.250599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59a68523-917f-41ea-9de0-2b226ede3d42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:27.251078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59a68523-917f-41ea-9de0-2b226ede3d42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:27.251500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59a68523-917f-41ea-9de0-2b226ede3d42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:27.282911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-59a68523-917f-41ea-9de0-2b226ede3d42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046995 Aug 24 05:14:27.283490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 764/1419] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:27.527514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c9e35da4-4ed7-4e3a-8877-7c2423c132b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:27.529773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c9e35da4-4ed7-4e3a-8877-7c2423c132b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:27.535841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9e35da4-4ed7-4e3a-8877-7c2423c132b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:27.536347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9e35da4-4ed7-4e3a-8877-7c2423c132b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:27.536790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9e35da4-4ed7-4e3a-8877-7c2423c132b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:27.537490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9e35da4-4ed7-4e3a-8877-7c2423c132b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:27.537946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9e35da4-4ed7-4e3a-8877-7c2423c132b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:27.538369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c9e35da4-4ed7-4e3a-8877-7c2423c132b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:27.573173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c9e35da4-4ed7-4e3a-8877-7c2423c132b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049682 Aug 24 05:14:27.574017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 656/1420] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:27 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:27.620242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a36d1fe3-95b3-4721-a875-ebbc8e9f6fca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:27.622538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a36d1fe3-95b3-4721-a875-ebbc8e9f6fca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:27.629092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d1fe3-95b3-4721-a875-ebbc8e9f6fca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:27.629570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d1fe3-95b3-4721-a875-ebbc8e9f6fca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:27.630004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d1fe3-95b3-4721-a875-ebbc8e9f6fca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:27.630712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d1fe3-95b3-4721-a875-ebbc8e9f6fca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:27.631169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d1fe3-95b3-4721-a875-ebbc8e9f6fca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:27.631600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d1fe3-95b3-4721-a875-ebbc8e9f6fca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:27.662410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a36d1fe3-95b3-4721-a875-ebbc8e9f6fca tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046672 Aug 24 05:14:27.663012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 765/1421] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:27 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:28.295094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-72755da0-ec24-4a26-bd3c-eaba9c9e3d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:28.297573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-72755da0-ec24-4a26-bd3c-eaba9c9e3d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:28.304155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72755da0-ec24-4a26-bd3c-eaba9c9e3d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:28.304635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72755da0-ec24-4a26-bd3c-eaba9c9e3d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:28.305068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72755da0-ec24-4a26-bd3c-eaba9c9e3d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:28.305756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72755da0-ec24-4a26-bd3c-eaba9c9e3d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:28.306199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72755da0-ec24-4a26-bd3c-eaba9c9e3d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:28.306614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72755da0-ec24-4a26-bd3c-eaba9c9e3d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:28.338040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-72755da0-ec24-4a26-bd3c-eaba9c9e3d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047464 Aug 24 05:14:28.338621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 657/1422] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:28.585183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cf6a7cba-f542-4886-b2df-e5cbeb65a20f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:28.587487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cf6a7cba-f542-4886-b2df-e5cbeb65a20f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:28.594517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf6a7cba-f542-4886-b2df-e5cbeb65a20f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:28.595034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf6a7cba-f542-4886-b2df-e5cbeb65a20f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:28.595473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf6a7cba-f542-4886-b2df-e5cbeb65a20f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:28.596168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf6a7cba-f542-4886-b2df-e5cbeb65a20f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:28.596618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf6a7cba-f542-4886-b2df-e5cbeb65a20f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:28.597036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf6a7cba-f542-4886-b2df-e5cbeb65a20f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:28.629494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cf6a7cba-f542-4886-b2df-e5cbeb65a20f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048238 Aug 24 05:14:28.630196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 766/1423] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:28.677224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-17d711ce-dece-48e9-a464-ef2e8345a2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:28.679581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-17d711ce-dece-48e9-a464-ef2e8345a2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:28.686279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17d711ce-dece-48e9-a464-ef2e8345a2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:28.686802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17d711ce-dece-48e9-a464-ef2e8345a2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:28.687247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17d711ce-dece-48e9-a464-ef2e8345a2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:28.687975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17d711ce-dece-48e9-a464-ef2e8345a2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:28.688432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17d711ce-dece-48e9-a464-ef2e8345a2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:28.688856 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17d711ce-dece-48e9-a464-ef2e8345a2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:28.720813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-17d711ce-dece-48e9-a464-ef2e8345a2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047604 Aug 24 05:14:28.721375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 658/1424] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:29.350628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e5720d34-6f97-4838-8ef7-108065a70d0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:29.352763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e5720d34-6f97-4838-8ef7-108065a70d0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:29.358936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5720d34-6f97-4838-8ef7-108065a70d0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:29.359415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5720d34-6f97-4838-8ef7-108065a70d0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:29.359845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5720d34-6f97-4838-8ef7-108065a70d0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:29.360535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5720d34-6f97-4838-8ef7-108065a70d0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:29.360971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5720d34-6f97-4838-8ef7-108065a70d0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:29.361384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5720d34-6f97-4838-8ef7-108065a70d0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:29.393378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e5720d34-6f97-4838-8ef7-108065a70d0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046731 Aug 24 05:14:29.393915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 767/1425] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:29.643596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c403ff90-d53a-4942-aca2-bf523f491f30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:29.645661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c403ff90-d53a-4942-aca2-bf523f491f30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:29.651993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c403ff90-d53a-4942-aca2-bf523f491f30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:29.652470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c403ff90-d53a-4942-aca2-bf523f491f30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:29.652906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c403ff90-d53a-4942-aca2-bf523f491f30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:29.653607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c403ff90-d53a-4942-aca2-bf523f491f30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:29.654056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c403ff90-d53a-4942-aca2-bf523f491f30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:29.654479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c403ff90-d53a-4942-aca2-bf523f491f30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:29.686733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c403ff90-d53a-4942-aca2-bf523f491f30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047311 Aug 24 05:14:29.687447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 659/1426] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:29.734279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-25f29918-92a3-48b7-af51-91a3bc59e991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:29.736952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-25f29918-92a3-48b7-af51-91a3bc59e991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:29.743707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25f29918-92a3-48b7-af51-91a3bc59e991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:29.744181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25f29918-92a3-48b7-af51-91a3bc59e991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:29.745220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25f29918-92a3-48b7-af51-91a3bc59e991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:29.745871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25f29918-92a3-48b7-af51-91a3bc59e991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:29.746311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25f29918-92a3-48b7-af51-91a3bc59e991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:29.746742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25f29918-92a3-48b7-af51-91a3bc59e991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:29.778347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-25f29918-92a3-48b7-af51-91a3bc59e991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048024 Aug 24 05:14:29.778929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 768/1427] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:30.405651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-89ff3657-2206-41fc-ba9d-ccbd0e378ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:30.407834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-89ff3657-2206-41fc-ba9d-ccbd0e378ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:30.413995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89ff3657-2206-41fc-ba9d-ccbd0e378ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:30.414486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89ff3657-2206-41fc-ba9d-ccbd0e378ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:30.414954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89ff3657-2206-41fc-ba9d-ccbd0e378ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:30.415656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89ff3657-2206-41fc-ba9d-ccbd0e378ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:30.416112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89ff3657-2206-41fc-ba9d-ccbd0e378ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:30.417086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89ff3657-2206-41fc-ba9d-ccbd0e378ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:30.448675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-89ff3657-2206-41fc-ba9d-ccbd0e378ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046921 Aug 24 05:14:30.449443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 660/1428] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:30.699438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-807fc4e0-7ab4-4d73-8c63-5e54b0e79fc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:30.701564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-807fc4e0-7ab4-4d73-8c63-5e54b0e79fc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:30.707611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-807fc4e0-7ab4-4d73-8c63-5e54b0e79fc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:30.708082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-807fc4e0-7ab4-4d73-8c63-5e54b0e79fc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:30.708507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-807fc4e0-7ab4-4d73-8c63-5e54b0e79fc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:30.709191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-807fc4e0-7ab4-4d73-8c63-5e54b0e79fc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:30.709636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-807fc4e0-7ab4-4d73-8c63-5e54b0e79fc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:30.710047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-807fc4e0-7ab4-4d73-8c63-5e54b0e79fc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:30.747428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-807fc4e0-7ab4-4d73-8c63-5e54b0e79fc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052133 Aug 24 05:14:30.748116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 769/1429] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:30.790664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c7fb266a-52dc-4d7f-afb9-0dfc925b4d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:30.793536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c7fb266a-52dc-4d7f-afb9-0dfc925b4d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:30.800049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7fb266a-52dc-4d7f-afb9-0dfc925b4d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:30.800524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7fb266a-52dc-4d7f-afb9-0dfc925b4d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:30.800957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7fb266a-52dc-4d7f-afb9-0dfc925b4d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:30.802476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7fb266a-52dc-4d7f-afb9-0dfc925b4d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:30.803007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7fb266a-52dc-4d7f-afb9-0dfc925b4d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:30.803898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7fb266a-52dc-4d7f-afb9-0dfc925b4d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:30.834200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c7fb266a-52dc-4d7f-afb9-0dfc925b4d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047496 Aug 24 05:14:30.834786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 661/1430] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:31.461081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4d72668d-ba9e-4ffe-b3f6-e1de0caa1800 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:31.463270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4d72668d-ba9e-4ffe-b3f6-e1de0caa1800 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:31.469419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d72668d-ba9e-4ffe-b3f6-e1de0caa1800 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:31.469903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d72668d-ba9e-4ffe-b3f6-e1de0caa1800 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:31.470337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d72668d-ba9e-4ffe-b3f6-e1de0caa1800 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:31.471062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d72668d-ba9e-4ffe-b3f6-e1de0caa1800 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:31.471528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d72668d-ba9e-4ffe-b3f6-e1de0caa1800 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:31.471927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d72668d-ba9e-4ffe-b3f6-e1de0caa1800 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:31.504716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4d72668d-ba9e-4ffe-b3f6-e1de0caa1800 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047584 Aug 24 05:14:31.505284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 770/1431] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:31.760111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5ca0e70a-893a-4355-b21e-12e85dc8f76a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:31.762273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5ca0e70a-893a-4355-b21e-12e85dc8f76a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:31.769006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ca0e70a-893a-4355-b21e-12e85dc8f76a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:31.769495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ca0e70a-893a-4355-b21e-12e85dc8f76a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:31.769935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ca0e70a-893a-4355-b21e-12e85dc8f76a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:31.770672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ca0e70a-893a-4355-b21e-12e85dc8f76a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:31.771154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ca0e70a-893a-4355-b21e-12e85dc8f76a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:31.771577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ca0e70a-893a-4355-b21e-12e85dc8f76a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:31.806070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5ca0e70a-893a-4355-b21e-12e85dc8f76a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049911 Aug 24 05:14:31.806793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 662/1432] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:31.847755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4db2273d-c523-4f3d-bedc-d96137775b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:31.849938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4db2273d-c523-4f3d-bedc-d96137775b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:31.857653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4db2273d-c523-4f3d-bedc-d96137775b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:31.858129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4db2273d-c523-4f3d-bedc-d96137775b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:31.858574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4db2273d-c523-4f3d-bedc-d96137775b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:31.859306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4db2273d-c523-4f3d-bedc-d96137775b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:31.859755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4db2273d-c523-4f3d-bedc-d96137775b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:31.860176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4db2273d-c523-4f3d-bedc-d96137775b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:31.896698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4db2273d-c523-4f3d-bedc-d96137775b8e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053255 Aug 24 05:14:31.897284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 771/1433] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:32.517407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a81639f6-ffd4-4a0e-af74-ec672454f9af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:32.519574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a81639f6-ffd4-4a0e-af74-ec672454f9af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:32.526175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81639f6-ffd4-4a0e-af74-ec672454f9af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:32.526808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81639f6-ffd4-4a0e-af74-ec672454f9af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:32.527425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81639f6-ffd4-4a0e-af74-ec672454f9af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:32.528134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81639f6-ffd4-4a0e-af74-ec672454f9af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:32.528585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81639f6-ffd4-4a0e-af74-ec672454f9af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:32.529006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a81639f6-ffd4-4a0e-af74-ec672454f9af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:32.560852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a81639f6-ffd4-4a0e-af74-ec672454f9af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047398 Aug 24 05:14:32.561410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 663/1434] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:32.819039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8a4463a4-2cfb-40a9-9463-befdb2a6cf93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:32.821345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8a4463a4-2cfb-40a9-9463-befdb2a6cf93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:32.828054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a4463a4-2cfb-40a9-9463-befdb2a6cf93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:32.828580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a4463a4-2cfb-40a9-9463-befdb2a6cf93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:32.829038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a4463a4-2cfb-40a9-9463-befdb2a6cf93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:32.829790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a4463a4-2cfb-40a9-9463-befdb2a6cf93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:32.830218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a4463a4-2cfb-40a9-9463-befdb2a6cf93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:32.830994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a4463a4-2cfb-40a9-9463-befdb2a6cf93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:32.862790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8a4463a4-2cfb-40a9-9463-befdb2a6cf93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047769 Aug 24 05:14:32.863530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 772/1435] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:32.909698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-01728368-2995-4aa4-bd93-19e918c7055f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:32.912372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-01728368-2995-4aa4-bd93-19e918c7055f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:32.919407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01728368-2995-4aa4-bd93-19e918c7055f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:32.919920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01728368-2995-4aa4-bd93-19e918c7055f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:32.920345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01728368-2995-4aa4-bd93-19e918c7055f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:32.921045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01728368-2995-4aa4-bd93-19e918c7055f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:32.921490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01728368-2995-4aa4-bd93-19e918c7055f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:32.921915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01728368-2995-4aa4-bd93-19e918c7055f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:32.954504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-01728368-2995-4aa4-bd93-19e918c7055f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049690 Aug 24 05:14:32.955312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 664/1436] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:33.573566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-12b418cd-dc83-42e9-b2a4-693e7300a606 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:33.575713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-12b418cd-dc83-42e9-b2a4-693e7300a606 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:33.581774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12b418cd-dc83-42e9-b2a4-693e7300a606 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:33.582248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12b418cd-dc83-42e9-b2a4-693e7300a606 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:33.582673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12b418cd-dc83-42e9-b2a4-693e7300a606 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:33.583376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12b418cd-dc83-42e9-b2a4-693e7300a606 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:33.583820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12b418cd-dc83-42e9-b2a4-693e7300a606 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:33.584229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12b418cd-dc83-42e9-b2a4-693e7300a606 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:33.615452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-12b418cd-dc83-42e9-b2a4-693e7300a606 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045922 Aug 24 05:14:33.616010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 773/1437] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:33.874913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e0d495fa-1895-4970-bdbd-08fc7084bb0d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:33.877073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e0d495fa-1895-4970-bdbd-08fc7084bb0d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:33.879046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=88 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:33.885754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0d495fa-1895-4970-bdbd-08fc7084bb0d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:33.886361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0d495fa-1895-4970-bdbd-08fc7084bb0d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:33.886844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0d495fa-1895-4970-bdbd-08fc7084bb0d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:33.887998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0d495fa-1895-4970-bdbd-08fc7084bb0d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:33.888780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0d495fa-1895-4970-bdbd-08fc7084bb0d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:33.889558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0d495fa-1895-4970-bdbd-08fc7084bb0d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:33.921767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e0d495fa-1895-4970-bdbd-08fc7084bb0d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050849 Aug 24 05:14:33.922452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 665/1438] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:33 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:33.968448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1d49a033-b2ef-4631-b8cd-ddeae23dbc58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:33.970586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1d49a033-b2ef-4631-b8cd-ddeae23dbc58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:33.976998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d49a033-b2ef-4631-b8cd-ddeae23dbc58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:33.977458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d49a033-b2ef-4631-b8cd-ddeae23dbc58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:33.977886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d49a033-b2ef-4631-b8cd-ddeae23dbc58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:33.978564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d49a033-b2ef-4631-b8cd-ddeae23dbc58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:33.979831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d49a033-b2ef-4631-b8cd-ddeae23dbc58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:33.980459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d49a033-b2ef-4631-b8cd-ddeae23dbc58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:34.010631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1d49a033-b2ef-4631-b8cd-ddeae23dbc58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046197 Aug 24 05:14:34.011379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 774/1439] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:34.628445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-63897082-217f-4973-8078-3a92cb982f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:34.630624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-63897082-217f-4973-8078-3a92cb982f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:34.639080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63897082-217f-4973-8078-3a92cb982f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:34.639574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63897082-217f-4973-8078-3a92cb982f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:34.640017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63897082-217f-4973-8078-3a92cb982f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:34.640728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63897082-217f-4973-8078-3a92cb982f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:34.641182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63897082-217f-4973-8078-3a92cb982f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:34.641610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63897082-217f-4973-8078-3a92cb982f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:34.672616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-63897082-217f-4973-8078-3a92cb982f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Aug 24 05:14:34.673191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 666/1440] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:34.934867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-71ac5201-eb93-4650-b734-db9f57a5c794 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:34.936982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-71ac5201-eb93-4650-b734-db9f57a5c794 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:34.943176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71ac5201-eb93-4650-b734-db9f57a5c794 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:34.943662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71ac5201-eb93-4650-b734-db9f57a5c794 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:34.944094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71ac5201-eb93-4650-b734-db9f57a5c794 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:34.944795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71ac5201-eb93-4650-b734-db9f57a5c794 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:34.945243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71ac5201-eb93-4650-b734-db9f57a5c794 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:34.945665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71ac5201-eb93-4650-b734-db9f57a5c794 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:34.976759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-71ac5201-eb93-4650-b734-db9f57a5c794 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046905 Aug 24 05:14:34.977467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 775/1441] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:35.025117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2953b7de-6053-433b-8480-eb2aa79e2f4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:35.027399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2953b7de-6053-433b-8480-eb2aa79e2f4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:35.034953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2953b7de-6053-433b-8480-eb2aa79e2f4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:35.035445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2953b7de-6053-433b-8480-eb2aa79e2f4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:35.035887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2953b7de-6053-433b-8480-eb2aa79e2f4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:35.036597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2953b7de-6053-433b-8480-eb2aa79e2f4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:35.037049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2953b7de-6053-433b-8480-eb2aa79e2f4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:35.037474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2953b7de-6053-433b-8480-eb2aa79e2f4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:35.069916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2953b7de-6053-433b-8480-eb2aa79e2f4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050220 Aug 24 05:14:35.070483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 667/1442] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:35.685420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-391e9108-178f-48dd-bd17-8ddcd04fb90a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:35.687602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-391e9108-178f-48dd-bd17-8ddcd04fb90a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:35.693730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-391e9108-178f-48dd-bd17-8ddcd04fb90a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:35.694202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-391e9108-178f-48dd-bd17-8ddcd04fb90a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:35.694628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-391e9108-178f-48dd-bd17-8ddcd04fb90a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:35.695333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-391e9108-178f-48dd-bd17-8ddcd04fb90a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:35.695774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-391e9108-178f-48dd-bd17-8ddcd04fb90a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:35.696187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-391e9108-178f-48dd-bd17-8ddcd04fb90a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:35.714438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:35.728293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-391e9108-178f-48dd-bd17-8ddcd04fb90a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046990 Aug 24 05:14:35.729068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 776/1443] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:35.989002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-62a27452-75eb-4e54-8f63-c0ce45919186 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:35.991209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-62a27452-75eb-4e54-8f63-c0ce45919186 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:35.997546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a27452-75eb-4e54-8f63-c0ce45919186 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:35.998028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a27452-75eb-4e54-8f63-c0ce45919186 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:35.998464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a27452-75eb-4e54-8f63-c0ce45919186 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:35.999192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a27452-75eb-4e54-8f63-c0ce45919186 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:35.999645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a27452-75eb-4e54-8f63-c0ce45919186 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:36.000065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a27452-75eb-4e54-8f63-c0ce45919186 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:36.032819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-62a27452-75eb-4e54-8f63-c0ce45919186 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047760 Aug 24 05:14:36.033515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 668/1444] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:35 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:36.082630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c0e80b64-b690-4ddb-bc02-64e8672327a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:36.084802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c0e80b64-b690-4ddb-bc02-64e8672327a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:36.091451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0e80b64-b690-4ddb-bc02-64e8672327a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:36.091935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0e80b64-b690-4ddb-bc02-64e8672327a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:36.092392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0e80b64-b690-4ddb-bc02-64e8672327a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:36.093089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0e80b64-b690-4ddb-bc02-64e8672327a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:36.093533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0e80b64-b690-4ddb-bc02-64e8672327a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:36.093948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0e80b64-b690-4ddb-bc02-64e8672327a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:36.124811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c0e80b64-b690-4ddb-bc02-64e8672327a9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046055 Aug 24 05:14:36.125381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 777/1445] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:36.741140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3a334709-7c3a-4da0-b289-964244588920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:36.743277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3a334709-7c3a-4da0-b289-964244588920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:36.750279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a334709-7c3a-4da0-b289-964244588920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:36.750831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a334709-7c3a-4da0-b289-964244588920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:36.751261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a334709-7c3a-4da0-b289-964244588920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:36.751956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a334709-7c3a-4da0-b289-964244588920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:36.752405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a334709-7c3a-4da0-b289-964244588920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:36.752821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a334709-7c3a-4da0-b289-964244588920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:36.756801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:36.785998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3a334709-7c3a-4da0-b289-964244588920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048773 Aug 24 05:14:36.786715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 669/1446] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:37.046051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-864b759c-5a7a-4dd7-9e9c-5733ff2ebf41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:37.048410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-864b759c-5a7a-4dd7-9e9c-5733ff2ebf41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:37.058329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-864b759c-5a7a-4dd7-9e9c-5733ff2ebf41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:37.058854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-864b759c-5a7a-4dd7-9e9c-5733ff2ebf41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:37.059293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-864b759c-5a7a-4dd7-9e9c-5733ff2ebf41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:37.059999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-864b759c-5a7a-4dd7-9e9c-5733ff2ebf41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:37.060452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-864b759c-5a7a-4dd7-9e9c-5733ff2ebf41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:37.060875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-864b759c-5a7a-4dd7-9e9c-5733ff2ebf41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:37.092368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-864b759c-5a7a-4dd7-9e9c-5733ff2ebf41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050965 Aug 24 05:14:37.093183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 778/1447] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:37.137379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-17eab3cd-8466-4ffe-91ea-9ba3378c1143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:37.139545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-17eab3cd-8466-4ffe-91ea-9ba3378c1143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:37.146052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17eab3cd-8466-4ffe-91ea-9ba3378c1143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:37.146533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17eab3cd-8466-4ffe-91ea-9ba3378c1143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:37.146989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17eab3cd-8466-4ffe-91ea-9ba3378c1143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:37.147681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17eab3cd-8466-4ffe-91ea-9ba3378c1143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:37.148126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17eab3cd-8466-4ffe-91ea-9ba3378c1143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:37.148631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17eab3cd-8466-4ffe-91ea-9ba3378c1143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:37.180684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-17eab3cd-8466-4ffe-91ea-9ba3378c1143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047405 Aug 24 05:14:37.181254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 670/1448] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:37.798405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-88340f6b-9cc5-4f72-99ff-cbf8f7ce3916 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:37.800588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-88340f6b-9cc5-4f72-99ff-cbf8f7ce3916 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:37.807948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88340f6b-9cc5-4f72-99ff-cbf8f7ce3916 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:37.808382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88340f6b-9cc5-4f72-99ff-cbf8f7ce3916 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:37.808659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88340f6b-9cc5-4f72-99ff-cbf8f7ce3916 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:37.809354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88340f6b-9cc5-4f72-99ff-cbf8f7ce3916 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:37.809801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88340f6b-9cc5-4f72-99ff-cbf8f7ce3916 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:37.810221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88340f6b-9cc5-4f72-99ff-cbf8f7ce3916 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:37.841316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-88340f6b-9cc5-4f72-99ff-cbf8f7ce3916 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046801 Aug 24 05:14:37.841871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 779/1449] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:38.105241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f71b3c5e-f88d-4fd5-a0c7-315cc4dcb187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:38.107306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f71b3c5e-f88d-4fd5-a0c7-315cc4dcb187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:38.114326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f71b3c5e-f88d-4fd5-a0c7-315cc4dcb187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:38.114844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f71b3c5e-f88d-4fd5-a0c7-315cc4dcb187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:38.115285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f71b3c5e-f88d-4fd5-a0c7-315cc4dcb187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:38.115982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f71b3c5e-f88d-4fd5-a0c7-315cc4dcb187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:38.116437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f71b3c5e-f88d-4fd5-a0c7-315cc4dcb187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:38.116862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f71b3c5e-f88d-4fd5-a0c7-315cc4dcb187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:38.146973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f71b3c5e-f88d-4fd5-a0c7-315cc4dcb187 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Aug 24 05:14:38.147650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 671/1450] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:38.193217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7eda2967-a540-4b33-bcd5-02a4830195cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:38.195408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7eda2967-a540-4b33-bcd5-02a4830195cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:38.202303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eda2967-a540-4b33-bcd5-02a4830195cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:38.202806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eda2967-a540-4b33-bcd5-02a4830195cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:38.203239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eda2967-a540-4b33-bcd5-02a4830195cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:38.203919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eda2967-a540-4b33-bcd5-02a4830195cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:38.204367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eda2967-a540-4b33-bcd5-02a4830195cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:38.204786 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eda2967-a540-4b33-bcd5-02a4830195cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:38.235185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7eda2967-a540-4b33-bcd5-02a4830195cb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045846 Aug 24 05:14:38.235734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 780/1451] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:38.854139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a344e0cd-43bd-4f94-affc-1fa4d10f9220 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:38.856432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a344e0cd-43bd-4f94-affc-1fa4d10f9220 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:38.862667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a344e0cd-43bd-4f94-affc-1fa4d10f9220 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:38.863174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a344e0cd-43bd-4f94-affc-1fa4d10f9220 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:38.863605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a344e0cd-43bd-4f94-affc-1fa4d10f9220 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:38.864286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a344e0cd-43bd-4f94-affc-1fa4d10f9220 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:38.864731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a344e0cd-43bd-4f94-affc-1fa4d10f9220 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:38.865146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a344e0cd-43bd-4f94-affc-1fa4d10f9220 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:38.896790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a344e0cd-43bd-4f94-affc-1fa4d10f9220 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047134 Aug 24 05:14:38.897345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 672/1452] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:39.159988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9ef12b4c-ed2d-4fe6-98e3-b4958ddc6954 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:39.162161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9ef12b4c-ed2d-4fe6-98e3-b4958ddc6954 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:39.164197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=88 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:39.170086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ef12b4c-ed2d-4fe6-98e3-b4958ddc6954 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:39.170563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ef12b4c-ed2d-4fe6-98e3-b4958ddc6954 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:39.171022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ef12b4c-ed2d-4fe6-98e3-b4958ddc6954 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:39.171713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ef12b4c-ed2d-4fe6-98e3-b4958ddc6954 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:39.172168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ef12b4c-ed2d-4fe6-98e3-b4958ddc6954 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:39.172586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ef12b4c-ed2d-4fe6-98e3-b4958ddc6954 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:39.202813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9ef12b4c-ed2d-4fe6-98e3-b4958ddc6954 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046779 Aug 24 05:14:39.203551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 781/1453] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:39.247399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3a953510-a780-4e63-bedf-517a48e04458 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:39.249527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3a953510-a780-4e63-bedf-517a48e04458 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:39.256141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a953510-a780-4e63-bedf-517a48e04458 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:39.256623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a953510-a780-4e63-bedf-517a48e04458 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:39.257050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a953510-a780-4e63-bedf-517a48e04458 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:39.257743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a953510-a780-4e63-bedf-517a48e04458 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:39.258197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a953510-a780-4e63-bedf-517a48e04458 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:39.258716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a953510-a780-4e63-bedf-517a48e04458 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:39.288875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3a953510-a780-4e63-bedf-517a48e04458 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Aug 24 05:14:39.289350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 673/1454] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:39.909402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2056b470-31b1-4ad6-8f80-ed9811264475 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:39.911576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2056b470-31b1-4ad6-8f80-ed9811264475 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:39.918441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2056b470-31b1-4ad6-8f80-ed9811264475 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:39.918963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2056b470-31b1-4ad6-8f80-ed9811264475 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:39.919399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2056b470-31b1-4ad6-8f80-ed9811264475 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:39.920094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2056b470-31b1-4ad6-8f80-ed9811264475 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:39.920544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2056b470-31b1-4ad6-8f80-ed9811264475 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:39.920967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2056b470-31b1-4ad6-8f80-ed9811264475 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:39.951540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2056b470-31b1-4ad6-8f80-ed9811264475 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Aug 24 05:14:39.952106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 782/1455] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:40.216278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b9e4a196-748a-4325-b25b-ed96230cb2b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:40.218414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b9e4a196-748a-4325-b25b-ed96230cb2b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:40.224621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9e4a196-748a-4325-b25b-ed96230cb2b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:40.225103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9e4a196-748a-4325-b25b-ed96230cb2b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:40.225540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9e4a196-748a-4325-b25b-ed96230cb2b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:40.226235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9e4a196-748a-4325-b25b-ed96230cb2b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:40.226711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9e4a196-748a-4325-b25b-ed96230cb2b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:40.227213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9e4a196-748a-4325-b25b-ed96230cb2b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:40.257548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b9e4a196-748a-4325-b25b-ed96230cb2b2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045900 Aug 24 05:14:40.258326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 674/1456] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:40.302248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-197d634c-4be5-4f6f-bc52-cb9fa7281c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:40.304404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-197d634c-4be5-4f6f-bc52-cb9fa7281c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:40.311372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-197d634c-4be5-4f6f-bc52-cb9fa7281c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:40.311846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-197d634c-4be5-4f6f-bc52-cb9fa7281c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:40.312371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-197d634c-4be5-4f6f-bc52-cb9fa7281c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:40.313176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-197d634c-4be5-4f6f-bc52-cb9fa7281c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:40.313616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-197d634c-4be5-4f6f-bc52-cb9fa7281c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:40.314031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-197d634c-4be5-4f6f-bc52-cb9fa7281c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:40.345515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-197d634c-4be5-4f6f-bc52-cb9fa7281c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047511 Aug 24 05:14:40.346071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 783/1457] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:40.964648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6afd67f8-0734-4a0a-8a2d-9a8a14170cce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:40.966829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6afd67f8-0734-4a0a-8a2d-9a8a14170cce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:40.973265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afd67f8-0734-4a0a-8a2d-9a8a14170cce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:40.973750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afd67f8-0734-4a0a-8a2d-9a8a14170cce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:40.974191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afd67f8-0734-4a0a-8a2d-9a8a14170cce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:40.974913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afd67f8-0734-4a0a-8a2d-9a8a14170cce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:40.975374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afd67f8-0734-4a0a-8a2d-9a8a14170cce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:40.975797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afd67f8-0734-4a0a-8a2d-9a8a14170cce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:41.006272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6afd67f8-0734-4a0a-8a2d-9a8a14170cce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046040 Aug 24 05:14:41.006767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 675/1458] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:41.271879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-697fff71-5e82-4e8b-bafe-efa3b5e0a3f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:41.273992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-697fff71-5e82-4e8b-bafe-efa3b5e0a3f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:41.280699 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-697fff71-5e82-4e8b-bafe-efa3b5e0a3f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:41.281169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-697fff71-5e82-4e8b-bafe-efa3b5e0a3f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:41.281592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-697fff71-5e82-4e8b-bafe-efa3b5e0a3f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:41.282264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-697fff71-5e82-4e8b-bafe-efa3b5e0a3f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:41.282730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-697fff71-5e82-4e8b-bafe-efa3b5e0a3f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:41.283143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-697fff71-5e82-4e8b-bafe-efa3b5e0a3f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:41.313583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-697fff71-5e82-4e8b-bafe-efa3b5e0a3f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045668 Aug 24 05:14:41.314244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 784/1459] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:41.357692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-51873176-91e0-46de-8486-6075d4378182 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:41.359852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-51873176-91e0-46de-8486-6075d4378182 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:41.366253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51873176-91e0-46de-8486-6075d4378182 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:41.366762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51873176-91e0-46de-8486-6075d4378182 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:41.367202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51873176-91e0-46de-8486-6075d4378182 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:41.367890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51873176-91e0-46de-8486-6075d4378182 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:41.368345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51873176-91e0-46de-8486-6075d4378182 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:41.368766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51873176-91e0-46de-8486-6075d4378182 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:41.401450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-51873176-91e0-46de-8486-6075d4378182 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047863 Aug 24 05:14:41.401982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 676/1460] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:41 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:42.019782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e640fed0-0212-4416-9d01-3485b6ed8dd8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:42.021915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e640fed0-0212-4416-9d01-3485b6ed8dd8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:42.028727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e640fed0-0212-4416-9d01-3485b6ed8dd8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.029210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e640fed0-0212-4416-9d01-3485b6ed8dd8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.029644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e640fed0-0212-4416-9d01-3485b6ed8dd8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:42.030341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e640fed0-0212-4416-9d01-3485b6ed8dd8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.030822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e640fed0-0212-4416-9d01-3485b6ed8dd8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.031245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e640fed0-0212-4416-9d01-3485b6ed8dd8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:42.065082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e640fed0-0212-4416-9d01-3485b6ed8dd8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049034 Aug 24 05:14:42.065701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 785/1461] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:42.326180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-62fd95cc-2730-4be1-bb7d-b174a1c88250 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:42.328223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-62fd95cc-2730-4be1-bb7d-b174a1c88250 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:42.334337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62fd95cc-2730-4be1-bb7d-b174a1c88250 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.334847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62fd95cc-2730-4be1-bb7d-b174a1c88250 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.335277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62fd95cc-2730-4be1-bb7d-b174a1c88250 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:42.335971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62fd95cc-2730-4be1-bb7d-b174a1c88250 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.336416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62fd95cc-2730-4be1-bb7d-b174a1c88250 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.336832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62fd95cc-2730-4be1-bb7d-b174a1c88250 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:42.369261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-62fd95cc-2730-4be1-bb7d-b174a1c88250 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047041 Aug 24 05:14:42.370002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 677/1462] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:42.413813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-eae4f930-2946-47c5-8d9f-789fe7afcbce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:42.416803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-eae4f930-2946-47c5-8d9f-789fe7afcbce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:42.423436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae4f930-2946-47c5-8d9f-789fe7afcbce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.423914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae4f930-2946-47c5-8d9f-789fe7afcbce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.424349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae4f930-2946-47c5-8d9f-789fe7afcbce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:42.425043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae4f930-2946-47c5-8d9f-789fe7afcbce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:42.425493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae4f930-2946-47c5-8d9f-789fe7afcbce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:42.426028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae4f930-2946-47c5-8d9f-789fe7afcbce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:42.458065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-eae4f930-2946-47c5-8d9f-789fe7afcbce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048323 Aug 24 05:14:42.458615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 786/1463] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:43.077923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b7b1211b-cf08-4b5c-b177-fec23b4e7b19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:43.080105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b7b1211b-cf08-4b5c-b177-fec23b4e7b19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:43.086037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7b1211b-cf08-4b5c-b177-fec23b4e7b19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:43.086519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7b1211b-cf08-4b5c-b177-fec23b4e7b19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:43.086989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7b1211b-cf08-4b5c-b177-fec23b4e7b19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:43.087679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7b1211b-cf08-4b5c-b177-fec23b4e7b19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:43.088350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7b1211b-cf08-4b5c-b177-fec23b4e7b19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:43.088783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7b1211b-cf08-4b5c-b177-fec23b4e7b19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:43.117030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b7b1211b-cf08-4b5c-b177-fec23b4e7b19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043126 Aug 24 05:14:43.117576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 678/1464] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:43.381993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8d11ff0c-fea5-4232-971c-8a1bfa03e849 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:43.384064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8d11ff0c-fea5-4232-971c-8a1bfa03e849 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:43.390951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d11ff0c-fea5-4232-971c-8a1bfa03e849 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:43.391428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d11ff0c-fea5-4232-971c-8a1bfa03e849 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:43.391858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d11ff0c-fea5-4232-971c-8a1bfa03e849 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:43.392549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d11ff0c-fea5-4232-971c-8a1bfa03e849 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:43.393054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d11ff0c-fea5-4232-971c-8a1bfa03e849 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:43.393472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d11ff0c-fea5-4232-971c-8a1bfa03e849 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:43.430527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8d11ff0c-fea5-4232-971c-8a1bfa03e849 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052697 Aug 24 05:14:43.431278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 787/1465] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:43 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:43.475040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d63a42aa-efb2-4aee-b536-789744a948ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:43.478858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d63a42aa-efb2-4aee-b536-789744a948ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:43.490140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d63a42aa-efb2-4aee-b536-789744a948ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:43.490958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d63a42aa-efb2-4aee-b536-789744a948ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:43.491407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d63a42aa-efb2-4aee-b536-789744a948ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:43.492126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d63a42aa-efb2-4aee-b536-789744a948ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:43.492587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d63a42aa-efb2-4aee-b536-789744a948ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:43.493016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d63a42aa-efb2-4aee-b536-789744a948ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:43.524663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d63a42aa-efb2-4aee-b536-789744a948ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057117 Aug 24 05:14:43.525252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 679/1466] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:44.129496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c4108420-4ecf-41b0-8ae8-49f7bb916386 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:44.131646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c4108420-4ecf-41b0-8ae8-49f7bb916386 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:44.138270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4108420-4ecf-41b0-8ae8-49f7bb916386 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:44.138775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4108420-4ecf-41b0-8ae8-49f7bb916386 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:44.139209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4108420-4ecf-41b0-8ae8-49f7bb916386 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:44.139897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4108420-4ecf-41b0-8ae8-49f7bb916386 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:44.140343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4108420-4ecf-41b0-8ae8-49f7bb916386 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:44.140759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4108420-4ecf-41b0-8ae8-49f7bb916386 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:44.171888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c4108420-4ecf-41b0-8ae8-49f7bb916386 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046258 Aug 24 05:14:44.172444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 788/1467] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:44.443511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d693a3d4-1110-4e6b-a81d-662f7d259120 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:44.445587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d693a3d4-1110-4e6b-a81d-662f7d259120 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:44.452074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d693a3d4-1110-4e6b-a81d-662f7d259120 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:44.452547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d693a3d4-1110-4e6b-a81d-662f7d259120 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:44.452982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d693a3d4-1110-4e6b-a81d-662f7d259120 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:44.453669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d693a3d4-1110-4e6b-a81d-662f7d259120 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:44.454128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d693a3d4-1110-4e6b-a81d-662f7d259120 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:44.454619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d693a3d4-1110-4e6b-a81d-662f7d259120 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:44.486862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d693a3d4-1110-4e6b-a81d-662f7d259120 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047367 Aug 24 05:14:44.487564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 680/1468] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:44.536824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-53fac59b-db33-40d9-ae19-fe6656a5e83a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:44.538972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-53fac59b-db33-40d9-ae19-fe6656a5e83a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:44.546044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53fac59b-db33-40d9-ae19-fe6656a5e83a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:44.546516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53fac59b-db33-40d9-ae19-fe6656a5e83a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:44.546974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53fac59b-db33-40d9-ae19-fe6656a5e83a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:44.547665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53fac59b-db33-40d9-ae19-fe6656a5e83a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:44.548110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53fac59b-db33-40d9-ae19-fe6656a5e83a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:44.548525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53fac59b-db33-40d9-ae19-fe6656a5e83a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:44.578662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-53fac59b-db33-40d9-ae19-fe6656a5e83a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045684 Aug 24 05:14:44.579249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 789/1469] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:45.184913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1cd86d7c-4281-4e85-a0c0-0f879b6f6776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:45.187126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1cd86d7c-4281-4e85-a0c0-0f879b6f6776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:45.193410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cd86d7c-4281-4e85-a0c0-0f879b6f6776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:45.193892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cd86d7c-4281-4e85-a0c0-0f879b6f6776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:45.194373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cd86d7c-4281-4e85-a0c0-0f879b6f6776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:45.195172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cd86d7c-4281-4e85-a0c0-0f879b6f6776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:45.195490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cd86d7c-4281-4e85-a0c0-0f879b6f6776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:45.195916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cd86d7c-4281-4e85-a0c0-0f879b6f6776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:45.226736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1cd86d7c-4281-4e85-a0c0-0f879b6f6776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045780 Aug 24 05:14:45.227291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 681/1470] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:45.499818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-36ebdc96-2aa6-4c22-ac56-82784b774391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:45.502057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-36ebdc96-2aa6-4c22-ac56-82784b774391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:45.508121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ebdc96-2aa6-4c22-ac56-82784b774391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:45.508595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ebdc96-2aa6-4c22-ac56-82784b774391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:45.509026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ebdc96-2aa6-4c22-ac56-82784b774391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:45.509737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ebdc96-2aa6-4c22-ac56-82784b774391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:45.510188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ebdc96-2aa6-4c22-ac56-82784b774391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:45.510603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36ebdc96-2aa6-4c22-ac56-82784b774391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:45.539770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-36ebdc96-2aa6-4c22-ac56-82784b774391 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044018 Aug 24 05:14:45.540450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 790/1471] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:45 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:45.590994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-81e44f19-fe72-4e59-967c-d3efa852a4f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:45.593197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-81e44f19-fe72-4e59-967c-d3efa852a4f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:45.600522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81e44f19-fe72-4e59-967c-d3efa852a4f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:45.601006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81e44f19-fe72-4e59-967c-d3efa852a4f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:45.601444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81e44f19-fe72-4e59-967c-d3efa852a4f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:45.602144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81e44f19-fe72-4e59-967c-d3efa852a4f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:45.602596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81e44f19-fe72-4e59-967c-d3efa852a4f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:45.603041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81e44f19-fe72-4e59-967c-d3efa852a4f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:45.634045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-81e44f19-fe72-4e59-967c-d3efa852a4f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047276 Aug 24 05:14:45.634668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 682/1472] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:46.239880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7d7ea6c6-084c-4792-a8bd-f5d00138c6f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:46.242045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7d7ea6c6-084c-4792-a8bd-f5d00138c6f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:46.248308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d7ea6c6-084c-4792-a8bd-f5d00138c6f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:46.248804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d7ea6c6-084c-4792-a8bd-f5d00138c6f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:46.249213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d7ea6c6-084c-4792-a8bd-f5d00138c6f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:46.249903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d7ea6c6-084c-4792-a8bd-f5d00138c6f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:46.250347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d7ea6c6-084c-4792-a8bd-f5d00138c6f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:46.250787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d7ea6c6-084c-4792-a8bd-f5d00138c6f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:46.281520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7d7ea6c6-084c-4792-a8bd-f5d00138c6f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Aug 24 05:14:46.282080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 791/1473] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:46.553856 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4c683b36-7418-4799-b480-9f13c4889620 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:46.556021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4c683b36-7418-4799-b480-9f13c4889620 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:46.562912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c683b36-7418-4799-b480-9f13c4889620 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:46.563401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c683b36-7418-4799-b480-9f13c4889620 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:46.563842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c683b36-7418-4799-b480-9f13c4889620 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:46.564554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c683b36-7418-4799-b480-9f13c4889620 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:46.565011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c683b36-7418-4799-b480-9f13c4889620 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:46.565541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c683b36-7418-4799-b480-9f13c4889620 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:46.597338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4c683b36-7418-4799-b480-9f13c4889620 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047653 Aug 24 05:14:46.597985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 683/1474] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:46.648202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9536c0e1-b101-4a0a-a8db-5f6f1d7cdd12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:46.650364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9536c0e1-b101-4a0a-a8db-5f6f1d7cdd12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:46.658453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9536c0e1-b101-4a0a-a8db-5f6f1d7cdd12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:46.658955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9536c0e1-b101-4a0a-a8db-5f6f1d7cdd12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:46.659386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9536c0e1-b101-4a0a-a8db-5f6f1d7cdd12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:46.660070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9536c0e1-b101-4a0a-a8db-5f6f1d7cdd12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:46.660512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9536c0e1-b101-4a0a-a8db-5f6f1d7cdd12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:46.660922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9536c0e1-b101-4a0a-a8db-5f6f1d7cdd12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:46.694335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9536c0e1-b101-4a0a-a8db-5f6f1d7cdd12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050467 Aug 24 05:14:46.694928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 792/1475] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:47.295570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-61d4e453-1bb2-4a3a-accf-4c943ed5a1fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:47.302444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-61d4e453-1bb2-4a3a-accf-4c943ed5a1fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:47.308893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61d4e453-1bb2-4a3a-accf-4c943ed5a1fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:47.309387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61d4e453-1bb2-4a3a-accf-4c943ed5a1fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:47.310061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61d4e453-1bb2-4a3a-accf-4c943ed5a1fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:47.311058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61d4e453-1bb2-4a3a-accf-4c943ed5a1fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:47.311834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61d4e453-1bb2-4a3a-accf-4c943ed5a1fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:47.312324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61d4e453-1bb2-4a3a-accf-4c943ed5a1fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:47.345007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-61d4e453-1bb2-4a3a-accf-4c943ed5a1fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055359 Aug 24 05:14:47.345583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 684/1476] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:47.610411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dfa7c364-ef27-4c5f-96f0-b65b2610d46c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:47.612480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dfa7c364-ef27-4c5f-96f0-b65b2610d46c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:47.618528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa7c364-ef27-4c5f-96f0-b65b2610d46c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:47.619073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa7c364-ef27-4c5f-96f0-b65b2610d46c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:47.619501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa7c364-ef27-4c5f-96f0-b65b2610d46c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:47.620184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa7c364-ef27-4c5f-96f0-b65b2610d46c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:47.620635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa7c364-ef27-4c5f-96f0-b65b2610d46c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:47.621051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa7c364-ef27-4c5f-96f0-b65b2610d46c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:47.624845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:47.651522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dfa7c364-ef27-4c5f-96f0-b65b2610d46c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Aug 24 05:14:47.652207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 793/1477] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:47.707359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8a7518fe-7574-478a-a146-6a18aaaf329c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:47.709473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8a7518fe-7574-478a-a146-6a18aaaf329c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:47.715555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a7518fe-7574-478a-a146-6a18aaaf329c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:47.717409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a7518fe-7574-478a-a146-6a18aaaf329c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:47.717853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a7518fe-7574-478a-a146-6a18aaaf329c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:47.718542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a7518fe-7574-478a-a146-6a18aaaf329c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:47.719024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a7518fe-7574-478a-a146-6a18aaaf329c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:47.719442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a7518fe-7574-478a-a146-6a18aaaf329c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:47.746060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:47.752005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8a7518fe-7574-478a-a146-6a18aaaf329c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048706 Aug 24 05:14:47.752933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 685/1478] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:48.357998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bae7e290-60f8-4955-af81-7f3189718e90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:48.360167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bae7e290-60f8-4955-af81-7f3189718e90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:48.366725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bae7e290-60f8-4955-af81-7f3189718e90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:48.367197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bae7e290-60f8-4955-af81-7f3189718e90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:48.367624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bae7e290-60f8-4955-af81-7f3189718e90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:48.368302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bae7e290-60f8-4955-af81-7f3189718e90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:48.368740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bae7e290-60f8-4955-af81-7f3189718e90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:48.369818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bae7e290-60f8-4955-af81-7f3189718e90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:48.399423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bae7e290-60f8-4955-af81-7f3189718e90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045753 Aug 24 05:14:48.399967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 794/1479] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:48.663893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bcdb38bc-73ba-4490-b6cd-7cda4eac1b15 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:48.666673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bcdb38bc-73ba-4490-b6cd-7cda4eac1b15 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:48.673536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcdb38bc-73ba-4490-b6cd-7cda4eac1b15 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:48.674020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcdb38bc-73ba-4490-b6cd-7cda4eac1b15 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:48.674459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcdb38bc-73ba-4490-b6cd-7cda4eac1b15 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:48.675192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcdb38bc-73ba-4490-b6cd-7cda4eac1b15 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:48.675647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcdb38bc-73ba-4490-b6cd-7cda4eac1b15 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:48.676072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcdb38bc-73ba-4490-b6cd-7cda4eac1b15 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:48.706055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bcdb38bc-73ba-4490-b6cd-7cda4eac1b15 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046222 Aug 24 05:14:48.706600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 686/1480] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:48.764177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dc0f0ac7-ccb1-4abc-b9b6-c31168671c6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:48.766307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dc0f0ac7-ccb1-4abc-b9b6-c31168671c6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:48.772800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0f0ac7-ccb1-4abc-b9b6-c31168671c6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:48.773266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0f0ac7-ccb1-4abc-b9b6-c31168671c6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:48.773693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0f0ac7-ccb1-4abc-b9b6-c31168671c6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:48.774392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0f0ac7-ccb1-4abc-b9b6-c31168671c6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:48.774856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0f0ac7-ccb1-4abc-b9b6-c31168671c6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:48.776169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc0f0ac7-ccb1-4abc-b9b6-c31168671c6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:48.807013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dc0f0ac7-ccb1-4abc-b9b6-c31168671c6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046789 Aug 24 05:14:48.807592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 795/1481] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:49.411075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7e2adeca-43ec-40f0-838f-a53eaefc042e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:49.413200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7e2adeca-43ec-40f0-838f-a53eaefc042e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:49.419426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2adeca-43ec-40f0-838f-a53eaefc042e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:49.419905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2adeca-43ec-40f0-838f-a53eaefc042e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:49.420347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2adeca-43ec-40f0-838f-a53eaefc042e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:49.421036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2adeca-43ec-40f0-838f-a53eaefc042e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:49.421488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2adeca-43ec-40f0-838f-a53eaefc042e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:49.421904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2adeca-43ec-40f0-838f-a53eaefc042e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:49.451244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7e2adeca-43ec-40f0-838f-a53eaefc042e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Aug 24 05:14:49.451779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 687/1482] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:49.717950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7226b197-151f-45f9-8b6c-a28e9a44a122 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:49.720150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7226b197-151f-45f9-8b6c-a28e9a44a122 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:49.726521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7226b197-151f-45f9-8b6c-a28e9a44a122 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:49.727025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7226b197-151f-45f9-8b6c-a28e9a44a122 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:49.727459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7226b197-151f-45f9-8b6c-a28e9a44a122 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:49.728134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7226b197-151f-45f9-8b6c-a28e9a44a122 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:49.728908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7226b197-151f-45f9-8b6c-a28e9a44a122 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:49.729331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7226b197-151f-45f9-8b6c-a28e9a44a122 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:49.760847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7226b197-151f-45f9-8b6c-a28e9a44a122 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046790 Aug 24 05:14:49.761409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 796/1483] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:49.818850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1675ddc4-a375-426a-8339-8770ac0459af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:49.820974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1675ddc4-a375-426a-8339-8770ac0459af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:49.828057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1675ddc4-a375-426a-8339-8770ac0459af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:49.828532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1675ddc4-a375-426a-8339-8770ac0459af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:49.828968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1675ddc4-a375-426a-8339-8770ac0459af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:49.829651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1675ddc4-a375-426a-8339-8770ac0459af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:49.830100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1675ddc4-a375-426a-8339-8770ac0459af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:49.830517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1675ddc4-a375-426a-8339-8770ac0459af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:49.858922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1675ddc4-a375-426a-8339-8770ac0459af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044064 Aug 24 05:14:49.859467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 688/1484] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:50.462397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a4b3c572-194a-44ed-bd02-898b480d29e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:50.465159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a4b3c572-194a-44ed-bd02-898b480d29e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:50.471367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b3c572-194a-44ed-bd02-898b480d29e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:50.471841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b3c572-194a-44ed-bd02-898b480d29e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:50.472279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b3c572-194a-44ed-bd02-898b480d29e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:50.473079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b3c572-194a-44ed-bd02-898b480d29e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:50.473614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b3c572-194a-44ed-bd02-898b480d29e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:50.474051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b3c572-194a-44ed-bd02-898b480d29e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:50.503357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a4b3c572-194a-44ed-bd02-898b480d29e4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044868 Aug 24 05:14:50.503902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 797/1485] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:50.775891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5a261d69-c645-43e3-b00a-edefe6f0df2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:50.778003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5a261d69-c645-43e3-b00a-edefe6f0df2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:50.785501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a261d69-c645-43e3-b00a-edefe6f0df2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:50.785975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a261d69-c645-43e3-b00a-edefe6f0df2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:50.786404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a261d69-c645-43e3-b00a-edefe6f0df2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:50.787121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a261d69-c645-43e3-b00a-edefe6f0df2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:50.787568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a261d69-c645-43e3-b00a-edefe6f0df2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:50.787983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a261d69-c645-43e3-b00a-edefe6f0df2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:50.818273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5a261d69-c645-43e3-b00a-edefe6f0df2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046880 Aug 24 05:14:50.818907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 689/1486] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:50.871581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0304d4f3-1dd9-4267-b3b9-15ce9e8b650b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:50.873685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0304d4f3-1dd9-4267-b3b9-15ce9e8b650b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:50.880082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0304d4f3-1dd9-4267-b3b9-15ce9e8b650b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:50.880556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0304d4f3-1dd9-4267-b3b9-15ce9e8b650b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:50.880985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0304d4f3-1dd9-4267-b3b9-15ce9e8b650b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:50.881663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0304d4f3-1dd9-4267-b3b9-15ce9e8b650b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:50.882106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0304d4f3-1dd9-4267-b3b9-15ce9e8b650b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:50.882522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0304d4f3-1dd9-4267-b3b9-15ce9e8b650b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:50.912168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0304d4f3-1dd9-4267-b3b9-15ce9e8b650b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Aug 24 05:14:50.912711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 798/1487] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:51.515703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f7731c9a-83c0-40fc-a04c-0da8b75dbb98 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:51.517857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f7731c9a-83c0-40fc-a04c-0da8b75dbb98 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:51.524213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7731c9a-83c0-40fc-a04c-0da8b75dbb98 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:51.524691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7731c9a-83c0-40fc-a04c-0da8b75dbb98 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:51.525148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7731c9a-83c0-40fc-a04c-0da8b75dbb98 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:51.525923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7731c9a-83c0-40fc-a04c-0da8b75dbb98 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:51.526388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7731c9a-83c0-40fc-a04c-0da8b75dbb98 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:51.526841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7731c9a-83c0-40fc-a04c-0da8b75dbb98 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:51.557464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f7731c9a-83c0-40fc-a04c-0da8b75dbb98 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Aug 24 05:14:51.558004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 690/1488] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:51.833565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b986fb2c-7a3f-46b8-95f5-3d73117e7acb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:51.836955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b986fb2c-7a3f-46b8-95f5-3d73117e7acb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:51.844646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b986fb2c-7a3f-46b8-95f5-3d73117e7acb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:51.845118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b986fb2c-7a3f-46b8-95f5-3d73117e7acb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:51.845616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b986fb2c-7a3f-46b8-95f5-3d73117e7acb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:51.846240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b986fb2c-7a3f-46b8-95f5-3d73117e7acb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:51.846819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b986fb2c-7a3f-46b8-95f5-3d73117e7acb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:51.847154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b986fb2c-7a3f-46b8-95f5-3d73117e7acb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:51.878283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b986fb2c-7a3f-46b8-95f5-3d73117e7acb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050557 Aug 24 05:14:51.878857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 799/1489] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:51.924672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b172a862-60f2-4fb8-9ace-735a07aa60b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:51.927117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b172a862-60f2-4fb8-9ace-735a07aa60b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:51.933710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b172a862-60f2-4fb8-9ace-735a07aa60b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:51.934189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b172a862-60f2-4fb8-9ace-735a07aa60b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:51.934623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b172a862-60f2-4fb8-9ace-735a07aa60b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:51.935335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b172a862-60f2-4fb8-9ace-735a07aa60b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:51.935823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b172a862-60f2-4fb8-9ace-735a07aa60b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:51.936243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b172a862-60f2-4fb8-9ace-735a07aa60b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:51.965731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b172a862-60f2-4fb8-9ace-735a07aa60b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045084 Aug 24 05:14:51.966287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 691/1490] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:52.569352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f4e632bc-596f-408f-b3b3-6e1dd03d2a1f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:52.571523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f4e632bc-596f-408f-b3b3-6e1dd03d2a1f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:52.577981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4e632bc-596f-408f-b3b3-6e1dd03d2a1f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:52.578463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4e632bc-596f-408f-b3b3-6e1dd03d2a1f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:52.578920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4e632bc-596f-408f-b3b3-6e1dd03d2a1f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:52.579611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4e632bc-596f-408f-b3b3-6e1dd03d2a1f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:52.580063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4e632bc-596f-408f-b3b3-6e1dd03d2a1f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:52.580484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4e632bc-596f-408f-b3b3-6e1dd03d2a1f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:52.611075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f4e632bc-596f-408f-b3b3-6e1dd03d2a1f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045581 Aug 24 05:14:52.611618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 800/1491] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:52.891195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-00d20376-a82b-42a3-95d6-03573fd06f8d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:52.893236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-00d20376-a82b-42a3-95d6-03573fd06f8d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:52.899869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00d20376-a82b-42a3-95d6-03573fd06f8d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:52.900864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00d20376-a82b-42a3-95d6-03573fd06f8d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:52.901299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00d20376-a82b-42a3-95d6-03573fd06f8d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:52.902019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00d20376-a82b-42a3-95d6-03573fd06f8d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:52.902472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00d20376-a82b-42a3-95d6-03573fd06f8d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:52.902934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00d20376-a82b-42a3-95d6-03573fd06f8d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:52.933739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-00d20376-a82b-42a3-95d6-03573fd06f8d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046651 Aug 24 05:14:52.934372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 692/1492] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:52.977466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2656691c-e87b-448d-ad88-b5b26c1085d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:52.980202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2656691c-e87b-448d-ad88-b5b26c1085d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:52.986675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2656691c-e87b-448d-ad88-b5b26c1085d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:52.987180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2656691c-e87b-448d-ad88-b5b26c1085d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:52.987610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2656691c-e87b-448d-ad88-b5b26c1085d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:52.988289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2656691c-e87b-448d-ad88-b5b26c1085d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:52.988730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2656691c-e87b-448d-ad88-b5b26c1085d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:52.989161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2656691c-e87b-448d-ad88-b5b26c1085d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:53.019648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2656691c-e87b-448d-ad88-b5b26c1085d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046183 Aug 24 05:14:53.020191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 801/1493] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:53.623198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-78f1c777-af9d-4e7c-85e8-4dd2a9fd024f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:53.625316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-78f1c777-af9d-4e7c-85e8-4dd2a9fd024f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:53.631439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78f1c777-af9d-4e7c-85e8-4dd2a9fd024f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:53.631795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78f1c777-af9d-4e7c-85e8-4dd2a9fd024f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:53.632223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78f1c777-af9d-4e7c-85e8-4dd2a9fd024f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:53.632904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78f1c777-af9d-4e7c-85e8-4dd2a9fd024f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:53.633347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78f1c777-af9d-4e7c-85e8-4dd2a9fd024f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:53.633761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78f1c777-af9d-4e7c-85e8-4dd2a9fd024f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:53.663233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-78f1c777-af9d-4e7c-85e8-4dd2a9fd024f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044050 Aug 24 05:14:53.663775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 693/1494] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:53.945879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d0468c49-04dd-4afc-9f98-0d539a8d6d51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:53.948759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d0468c49-04dd-4afc-9f98-0d539a8d6d51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:53.954808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0468c49-04dd-4afc-9f98-0d539a8d6d51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:53.955276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0468c49-04dd-4afc-9f98-0d539a8d6d51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:53.955701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0468c49-04dd-4afc-9f98-0d539a8d6d51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:53.956376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0468c49-04dd-4afc-9f98-0d539a8d6d51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:53.956815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0468c49-04dd-4afc-9f98-0d539a8d6d51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:53.957225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0468c49-04dd-4afc-9f98-0d539a8d6d51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:53.987270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d0468c49-04dd-4afc-9f98-0d539a8d6d51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045481 Aug 24 05:14:53.987906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 802/1495] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:54.032351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-16cf2ad1-06ff-4605-b415-6b3ecdfa5ebd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:54.034488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-16cf2ad1-06ff-4605-b415-6b3ecdfa5ebd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:54.041458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16cf2ad1-06ff-4605-b415-6b3ecdfa5ebd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:54.042109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16cf2ad1-06ff-4605-b415-6b3ecdfa5ebd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:54.042542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16cf2ad1-06ff-4605-b415-6b3ecdfa5ebd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:54.043245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16cf2ad1-06ff-4605-b415-6b3ecdfa5ebd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:54.043690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16cf2ad1-06ff-4605-b415-6b3ecdfa5ebd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:54.044105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16cf2ad1-06ff-4605-b415-6b3ecdfa5ebd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:54.073072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-16cf2ad1-06ff-4605-b415-6b3ecdfa5ebd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044653 Aug 24 05:14:54.073605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 694/1496] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:54.678179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2ce18303-7370-47c8-ad30-21c9f90c0f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:54.680273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2ce18303-7370-47c8-ad30-21c9f90c0f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:54.687147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ce18303-7370-47c8-ad30-21c9f90c0f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:54.687619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ce18303-7370-47c8-ad30-21c9f90c0f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:54.688046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ce18303-7370-47c8-ad30-21c9f90c0f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:54.688738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ce18303-7370-47c8-ad30-21c9f90c0f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:54.689182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ce18303-7370-47c8-ad30-21c9f90c0f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:54.689595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ce18303-7370-47c8-ad30-21c9f90c0f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:54.719702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2ce18303-7370-47c8-ad30-21c9f90c0f38 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045817 Aug 24 05:14:54.720224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 803/1497] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:55.000128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-80f05b0e-a933-4a03-b040-e12dab8b0569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:55.002364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-80f05b0e-a933-4a03-b040-e12dab8b0569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:55.008479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f05b0e-a933-4a03-b040-e12dab8b0569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:55.008959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f05b0e-a933-4a03-b040-e12dab8b0569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:55.009484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f05b0e-a933-4a03-b040-e12dab8b0569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:55.010319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f05b0e-a933-4a03-b040-e12dab8b0569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:55.010807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f05b0e-a933-4a03-b040-e12dab8b0569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:55.011234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f05b0e-a933-4a03-b040-e12dab8b0569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:55.043519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-80f05b0e-a933-4a03-b040-e12dab8b0569 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047328 Aug 24 05:14:55.044116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 695/1498] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:55.088924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-845cbbcf-d115-48fd-996f-a1af86ea8580 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:55.091654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-845cbbcf-d115-48fd-996f-a1af86ea8580 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:55.099481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-845cbbcf-d115-48fd-996f-a1af86ea8580 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:55.100076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-845cbbcf-d115-48fd-996f-a1af86ea8580 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:55.100632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-845cbbcf-d115-48fd-996f-a1af86ea8580 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:55.101464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-845cbbcf-d115-48fd-996f-a1af86ea8580 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:55.102004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-845cbbcf-d115-48fd-996f-a1af86ea8580 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:55.102581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-845cbbcf-d115-48fd-996f-a1af86ea8580 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:55.134726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-845cbbcf-d115-48fd-996f-a1af86ea8580 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051279 Aug 24 05:14:55.135328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 804/1499] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:55.730958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b59833cd-a2e2-4084-af2a-b84ffa0be6d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:55.733353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b59833cd-a2e2-4084-af2a-b84ffa0be6d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:55.739532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b59833cd-a2e2-4084-af2a-b84ffa0be6d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:55.740013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b59833cd-a2e2-4084-af2a-b84ffa0be6d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:55.740447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b59833cd-a2e2-4084-af2a-b84ffa0be6d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:55.741149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b59833cd-a2e2-4084-af2a-b84ffa0be6d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:55.741596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b59833cd-a2e2-4084-af2a-b84ffa0be6d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:55.742014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b59833cd-a2e2-4084-af2a-b84ffa0be6d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:55.772599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b59833cd-a2e2-4084-af2a-b84ffa0be6d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045583 Aug 24 05:14:55.773149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 696/1500] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:56.055920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-eeb8a55e-e6ac-49cd-828c-b7528daf1c19 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:56.058870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-eeb8a55e-e6ac-49cd-828c-b7528daf1c19 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:56.064828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eeb8a55e-e6ac-49cd-828c-b7528daf1c19 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:56.065304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eeb8a55e-e6ac-49cd-828c-b7528daf1c19 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:56.065739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eeb8a55e-e6ac-49cd-828c-b7528daf1c19 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:56.066422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eeb8a55e-e6ac-49cd-828c-b7528daf1c19 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:56.066976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eeb8a55e-e6ac-49cd-828c-b7528daf1c19 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:56.067400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eeb8a55e-e6ac-49cd-828c-b7528daf1c19 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:56.098239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-eeb8a55e-e6ac-49cd-828c-b7528daf1c19 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046647 Aug 24 05:14:56.099164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 805/1501] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:56.147316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e87376b9-74ad-4b2c-bd28-b6860d496b5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:56.149482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e87376b9-74ad-4b2c-bd28-b6860d496b5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:56.155962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e87376b9-74ad-4b2c-bd28-b6860d496b5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:56.156436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e87376b9-74ad-4b2c-bd28-b6860d496b5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:56.156869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e87376b9-74ad-4b2c-bd28-b6860d496b5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:56.157551 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e87376b9-74ad-4b2c-bd28-b6860d496b5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:56.158001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e87376b9-74ad-4b2c-bd28-b6860d496b5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:56.158419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e87376b9-74ad-4b2c-bd28-b6860d496b5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:56.188255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e87376b9-74ad-4b2c-bd28-b6860d496b5a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044926 Aug 24 05:14:56.188799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 697/1502] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:56.784071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3683632f-5607-45e7-a0d8-1357b4e55838 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:56.786207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3683632f-5607-45e7-a0d8-1357b4e55838 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:56.793042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3683632f-5607-45e7-a0d8-1357b4e55838 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:56.793523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3683632f-5607-45e7-a0d8-1357b4e55838 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:56.793956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3683632f-5607-45e7-a0d8-1357b4e55838 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:56.794648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3683632f-5607-45e7-a0d8-1357b4e55838 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:56.795121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3683632f-5607-45e7-a0d8-1357b4e55838 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:56.795569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3683632f-5607-45e7-a0d8-1357b4e55838 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:56.826180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3683632f-5607-45e7-a0d8-1357b4e55838 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 Aug 24 05:14:56.826748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 806/1503] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:57.110577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d870f949-fa22-45b0-991f-c2657154fb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:57.112700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d870f949-fa22-45b0-991f-c2657154fb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:57.118722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d870f949-fa22-45b0-991f-c2657154fb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:57.119355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d870f949-fa22-45b0-991f-c2657154fb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:57.119782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d870f949-fa22-45b0-991f-c2657154fb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:57.120459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d870f949-fa22-45b0-991f-c2657154fb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:57.120901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d870f949-fa22-45b0-991f-c2657154fb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:57.121316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d870f949-fa22-45b0-991f-c2657154fb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:57.149396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d870f949-fa22-45b0-991f-c2657154fb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042721 Aug 24 05:14:57.150514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 698/1504] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:57.199993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-28df9b43-0ed7-4eaa-b1a0-f83e5b3afb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:57.202111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-28df9b43-0ed7-4eaa-b1a0-f83e5b3afb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:57.208465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28df9b43-0ed7-4eaa-b1a0-f83e5b3afb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:57.208937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28df9b43-0ed7-4eaa-b1a0-f83e5b3afb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:57.209365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28df9b43-0ed7-4eaa-b1a0-f83e5b3afb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:57.210042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28df9b43-0ed7-4eaa-b1a0-f83e5b3afb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:57.210486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28df9b43-0ed7-4eaa-b1a0-f83e5b3afb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:57.210933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28df9b43-0ed7-4eaa-b1a0-f83e5b3afb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:57.240591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-28df9b43-0ed7-4eaa-b1a0-f83e5b3afb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044602 Aug 24 05:14:57.241127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 807/1505] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:57.838782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ff1849c4-0074-4878-9d01-4c684f29714c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:57.841023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ff1849c4-0074-4878-9d01-4c684f29714c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:57.847440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff1849c4-0074-4878-9d01-4c684f29714c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:57.847927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff1849c4-0074-4878-9d01-4c684f29714c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:57.848368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff1849c4-0074-4878-9d01-4c684f29714c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:57.849071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff1849c4-0074-4878-9d01-4c684f29714c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:57.849527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff1849c4-0074-4878-9d01-4c684f29714c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:57.849951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff1849c4-0074-4878-9d01-4c684f29714c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:57.880047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ff1849c4-0074-4878-9d01-4c684f29714c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045495 Aug 24 05:14:57.880679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 699/1506] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:58.161604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1e0b4377-aa80-4cd2-b736-d87127c01f2a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:58.163693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1e0b4377-aa80-4cd2-b736-d87127c01f2a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:58.170221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e0b4377-aa80-4cd2-b736-d87127c01f2a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:58.170711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e0b4377-aa80-4cd2-b736-d87127c01f2a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:58.171139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e0b4377-aa80-4cd2-b736-d87127c01f2a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:58.171811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e0b4377-aa80-4cd2-b736-d87127c01f2a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:58.172249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e0b4377-aa80-4cd2-b736-d87127c01f2a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:58.172660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1e0b4377-aa80-4cd2-b736-d87127c01f2a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:58.207602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1e0b4377-aa80-4cd2-b736-d87127c01f2a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049947 Aug 24 05:14:58.208300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 808/1507] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:58.253340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7626c6c2-8761-473a-986f-f1c9331fc0e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:58.255537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7626c6c2-8761-473a-986f-f1c9331fc0e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:58.262091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7626c6c2-8761-473a-986f-f1c9331fc0e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:58.262573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7626c6c2-8761-473a-986f-f1c9331fc0e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:58.263038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7626c6c2-8761-473a-986f-f1c9331fc0e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:58.263726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7626c6c2-8761-473a-986f-f1c9331fc0e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:58.264175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7626c6c2-8761-473a-986f-f1c9331fc0e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:58.264593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7626c6c2-8761-473a-986f-f1c9331fc0e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:58.293827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7626c6c2-8761-473a-986f-f1c9331fc0e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044483 Aug 24 05:14:58.294366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 700/1508] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:14:58.892495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-931c4880-ac4f-4a61-ad37-4417bff4fd19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:58.894726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-931c4880-ac4f-4a61-ad37-4417bff4fd19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:58.901203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931c4880-ac4f-4a61-ad37-4417bff4fd19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:58.901692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931c4880-ac4f-4a61-ad37-4417bff4fd19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:58.902136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931c4880-ac4f-4a61-ad37-4417bff4fd19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:58.902860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931c4880-ac4f-4a61-ad37-4417bff4fd19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:58.903541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931c4880-ac4f-4a61-ad37-4417bff4fd19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:58.903990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-931c4880-ac4f-4a61-ad37-4417bff4fd19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:58.943098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:14:58.949802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-931c4880-ac4f-4a61-ad37-4417bff4fd19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061243 Aug 24 05:14:58.950374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 809/1509] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:59.219864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-59165312-fc50-459c-b5c1-e9eee4fb7948 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:59.222021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-59165312-fc50-459c-b5c1-e9eee4fb7948 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:59.229169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59165312-fc50-459c-b5c1-e9eee4fb7948 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:59.229632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59165312-fc50-459c-b5c1-e9eee4fb7948 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:59.230068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59165312-fc50-459c-b5c1-e9eee4fb7948 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:59.230788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59165312-fc50-459c-b5c1-e9eee4fb7948 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:59.231243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59165312-fc50-459c-b5c1-e9eee4fb7948 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:59.231665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59165312-fc50-459c-b5c1-e9eee4fb7948 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:59.262105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-59165312-fc50-459c-b5c1-e9eee4fb7948 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046196 Aug 24 05:14:59.262762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 701/1510] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:59 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:59.307219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0f43c083-0f69-41e7-a50a-c99d54a12c2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:59.309280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0f43c083-0f69-41e7-a50a-c99d54a12c2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:59.315612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f43c083-0f69-41e7-a50a-c99d54a12c2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:59.316082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f43c083-0f69-41e7-a50a-c99d54a12c2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:59.316543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f43c083-0f69-41e7-a50a-c99d54a12c2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:59.317222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f43c083-0f69-41e7-a50a-c99d54a12c2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:59.317663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f43c083-0f69-41e7-a50a-c99d54a12c2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:59.318083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f43c083-0f69-41e7-a50a-c99d54a12c2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:59.347520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0f43c083-0f69-41e7-a50a-c99d54a12c2e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045456 Aug 24 05:14:59.348131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 810/1511] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:14:59.961718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d42d7cc4-9dc4-4eaf-98d0-10dd633fff07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:14:59.963854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d42d7cc4-9dc4-4eaf-98d0-10dd633fff07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:14:59.969772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d42d7cc4-9dc4-4eaf-98d0-10dd633fff07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:59.970245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d42d7cc4-9dc4-4eaf-98d0-10dd633fff07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:59.970673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d42d7cc4-9dc4-4eaf-98d0-10dd633fff07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:59.971370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d42d7cc4-9dc4-4eaf-98d0-10dd633fff07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:14:59.971811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d42d7cc4-9dc4-4eaf-98d0-10dd633fff07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:14:59.972224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d42d7cc4-9dc4-4eaf-98d0-10dd633fff07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:14:59.989566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:00.004164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d42d7cc4-9dc4-4eaf-98d0-10dd633fff07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046412 Aug 24 05:15:00.004707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 702/1512] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:14:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:00.274461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f9dec418-0968-4057-9fd6-7f2071800556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:00.277047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f9dec418-0968-4057-9fd6-7f2071800556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:00.283110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9dec418-0968-4057-9fd6-7f2071800556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:00.283582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9dec418-0968-4057-9fd6-7f2071800556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:00.284041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9dec418-0968-4057-9fd6-7f2071800556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:00.284730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9dec418-0968-4057-9fd6-7f2071800556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:00.285176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9dec418-0968-4057-9fd6-7f2071800556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:00.285589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9dec418-0968-4057-9fd6-7f2071800556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:00.316253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f9dec418-0968-4057-9fd6-7f2071800556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Aug 24 05:15:00.318945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 811/1513] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:00.360406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-13e343a6-39e8-4398-91b8-50f861b8cbf7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:00.362563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-13e343a6-39e8-4398-91b8-50f861b8cbf7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:00.369203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e343a6-39e8-4398-91b8-50f861b8cbf7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:00.369778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e343a6-39e8-4398-91b8-50f861b8cbf7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:00.370216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e343a6-39e8-4398-91b8-50f861b8cbf7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:00.370947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e343a6-39e8-4398-91b8-50f861b8cbf7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:00.371400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e343a6-39e8-4398-91b8-50f861b8cbf7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:00.371825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e343a6-39e8-4398-91b8-50f861b8cbf7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:00.402768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-13e343a6-39e8-4398-91b8-50f861b8cbf7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046256 Aug 24 05:15:00.403332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 703/1514] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:01.016433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-20983f2c-777f-4bb5-8d60-08fa11aecdd4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:01.018584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-20983f2c-777f-4bb5-8d60-08fa11aecdd4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:01.024748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20983f2c-777f-4bb5-8d60-08fa11aecdd4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:01.025272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20983f2c-777f-4bb5-8d60-08fa11aecdd4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:01.025714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20983f2c-777f-4bb5-8d60-08fa11aecdd4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:01.026413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20983f2c-777f-4bb5-8d60-08fa11aecdd4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:01.026894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20983f2c-777f-4bb5-8d60-08fa11aecdd4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:01.027315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20983f2c-777f-4bb5-8d60-08fa11aecdd4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:01.059173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-20983f2c-777f-4bb5-8d60-08fa11aecdd4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046722 Aug 24 05:15:01.059745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 812/1515] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:01.329357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dd69f348-e24b-407f-8d4a-6e58e7a30422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:01.331444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dd69f348-e24b-407f-8d4a-6e58e7a30422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:01.337601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd69f348-e24b-407f-8d4a-6e58e7a30422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:01.338081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd69f348-e24b-407f-8d4a-6e58e7a30422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:01.338522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd69f348-e24b-407f-8d4a-6e58e7a30422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:01.339256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd69f348-e24b-407f-8d4a-6e58e7a30422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:01.339706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd69f348-e24b-407f-8d4a-6e58e7a30422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:01.340126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd69f348-e24b-407f-8d4a-6e58e7a30422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:01.371920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dd69f348-e24b-407f-8d4a-6e58e7a30422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Aug 24 05:15:01.372578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 704/1516] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:01.415290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-434abf3d-7c29-4782-8603-65575720cb40 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:01.418455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-434abf3d-7c29-4782-8603-65575720cb40 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:01.425040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-434abf3d-7c29-4782-8603-65575720cb40 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:01.425514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-434abf3d-7c29-4782-8603-65575720cb40 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:01.425945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-434abf3d-7c29-4782-8603-65575720cb40 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:01.426637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-434abf3d-7c29-4782-8603-65575720cb40 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:01.427375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-434abf3d-7c29-4782-8603-65575720cb40 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:01.427797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-434abf3d-7c29-4782-8603-65575720cb40 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:01.458802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-434abf3d-7c29-4782-8603-65575720cb40 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047368 Aug 24 05:15:01.459364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 813/1517] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:02.072479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-060a70f1-5a70-4834-8a90-35a477a4edc1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:02.074710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-060a70f1-5a70-4834-8a90-35a477a4edc1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:02.081006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-060a70f1-5a70-4834-8a90-35a477a4edc1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:02.081484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-060a70f1-5a70-4834-8a90-35a477a4edc1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:02.081942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-060a70f1-5a70-4834-8a90-35a477a4edc1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:02.082630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-060a70f1-5a70-4834-8a90-35a477a4edc1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:02.083241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-060a70f1-5a70-4834-8a90-35a477a4edc1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:02.083586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-060a70f1-5a70-4834-8a90-35a477a4edc1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:02.114958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-060a70f1-5a70-4834-8a90-35a477a4edc1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046835 Aug 24 05:15:02.115869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 705/1518] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:02.383594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bf9c330e-3f2e-4ccc-850d-28df12192ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:02.386213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bf9c330e-3f2e-4ccc-850d-28df12192ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:02.392227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9c330e-3f2e-4ccc-850d-28df12192ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:02.392832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9c330e-3f2e-4ccc-850d-28df12192ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:02.393273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9c330e-3f2e-4ccc-850d-28df12192ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:02.393955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9c330e-3f2e-4ccc-850d-28df12192ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:02.394400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9c330e-3f2e-4ccc-850d-28df12192ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:02.394853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf9c330e-3f2e-4ccc-850d-28df12192ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:02.424700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bf9c330e-3f2e-4ccc-850d-28df12192ba3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Aug 24 05:15:02.425265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 814/1519] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:02.471501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3244ad89-7e3c-464e-89b2-c42a2692a8e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:02.473656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3244ad89-7e3c-464e-89b2-c42a2692a8e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:02.480290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3244ad89-7e3c-464e-89b2-c42a2692a8e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:02.480767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3244ad89-7e3c-464e-89b2-c42a2692a8e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:02.481208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3244ad89-7e3c-464e-89b2-c42a2692a8e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:02.481897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3244ad89-7e3c-464e-89b2-c42a2692a8e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:02.482349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3244ad89-7e3c-464e-89b2-c42a2692a8e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:02.482795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3244ad89-7e3c-464e-89b2-c42a2692a8e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:02.513216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3244ad89-7e3c-464e-89b2-c42a2692a8e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045679 Aug 24 05:15:02.513783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 706/1520] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:03.126760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e5424c40-f7e4-4473-ae61-eb5a04451307 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:03.128952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e5424c40-f7e4-4473-ae61-eb5a04451307 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:03.136500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5424c40-f7e4-4473-ae61-eb5a04451307 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:03.136983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5424c40-f7e4-4473-ae61-eb5a04451307 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:03.137421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5424c40-f7e4-4473-ae61-eb5a04451307 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:03.138114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5424c40-f7e4-4473-ae61-eb5a04451307 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:03.138558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5424c40-f7e4-4473-ae61-eb5a04451307 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:03.139201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5424c40-f7e4-4473-ae61-eb5a04451307 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:03.170700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e5424c40-f7e4-4473-ae61-eb5a04451307 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047833 Aug 24 05:15:03.171257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 815/1521] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:03 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:03.437546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4d83f8a7-11eb-4fe9-a9cd-93c704295450 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:03.439622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4d83f8a7-11eb-4fe9-a9cd-93c704295450 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:03.445656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d83f8a7-11eb-4fe9-a9cd-93c704295450 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:03.446134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d83f8a7-11eb-4fe9-a9cd-93c704295450 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:03.446564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d83f8a7-11eb-4fe9-a9cd-93c704295450 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:03.447820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d83f8a7-11eb-4fe9-a9cd-93c704295450 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:03.448267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d83f8a7-11eb-4fe9-a9cd-93c704295450 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:03.448687 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d83f8a7-11eb-4fe9-a9cd-93c704295450 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:03.479630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4d83f8a7-11eb-4fe9-a9cd-93c704295450 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046073 Aug 24 05:15:03.480354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 707/1522] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:03 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:03.525957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8a0c7d6b-d7c1-4f93-ae36-a61bb7f01861 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:03.528125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8a0c7d6b-d7c1-4f93-ae36-a61bb7f01861 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:03.534415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a0c7d6b-d7c1-4f93-ae36-a61bb7f01861 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:03.534919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a0c7d6b-d7c1-4f93-ae36-a61bb7f01861 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:03.535356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a0c7d6b-d7c1-4f93-ae36-a61bb7f01861 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:03.536033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a0c7d6b-d7c1-4f93-ae36-a61bb7f01861 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:03.536474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a0c7d6b-d7c1-4f93-ae36-a61bb7f01861 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:03.536890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a0c7d6b-d7c1-4f93-ae36-a61bb7f01861 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:03.566314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8a0c7d6b-d7c1-4f93-ae36-a61bb7f01861 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044934 Aug 24 05:15:03.566874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 816/1523] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:04.183707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ccfe6a7a-cf47-49dd-b528-3b36c827ab20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:04.185854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ccfe6a7a-cf47-49dd-b528-3b36c827ab20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:04.187742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=86 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:04.194145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ccfe6a7a-cf47-49dd-b528-3b36c827ab20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:04.194541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ccfe6a7a-cf47-49dd-b528-3b36c827ab20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:04.195015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ccfe6a7a-cf47-49dd-b528-3b36c827ab20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:04.195720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ccfe6a7a-cf47-49dd-b528-3b36c827ab20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:04.196177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ccfe6a7a-cf47-49dd-b528-3b36c827ab20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:04.196602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ccfe6a7a-cf47-49dd-b528-3b36c827ab20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:04.227740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ccfe6a7a-cf47-49dd-b528-3b36c827ab20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048576 Aug 24 05:15:04.229080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 708/1524] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:04.491249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8ed28e91-745e-45b8-8cd2-005e2545d015 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:04.493346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8ed28e91-745e-45b8-8cd2-005e2545d015 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:04.499928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ed28e91-745e-45b8-8cd2-005e2545d015 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:04.500399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ed28e91-745e-45b8-8cd2-005e2545d015 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:04.500829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ed28e91-745e-45b8-8cd2-005e2545d015 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:04.501508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ed28e91-745e-45b8-8cd2-005e2545d015 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:04.501951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ed28e91-745e-45b8-8cd2-005e2545d015 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:04.502367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ed28e91-745e-45b8-8cd2-005e2545d015 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:04.531430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8ed28e91-745e-45b8-8cd2-005e2545d015 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Aug 24 05:15:04.532034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 817/1525] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:04.578112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8925f918-4116-4af5-b1b4-ec0ecebe4d6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:04.580264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8925f918-4116-4af5-b1b4-ec0ecebe4d6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:04.586555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8925f918-4116-4af5-b1b4-ec0ecebe4d6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:04.587051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8925f918-4116-4af5-b1b4-ec0ecebe4d6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:04.588015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8925f918-4116-4af5-b1b4-ec0ecebe4d6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:04.588779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8925f918-4116-4af5-b1b4-ec0ecebe4d6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:04.589220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8925f918-4116-4af5-b1b4-ec0ecebe4d6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:04.589638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8925f918-4116-4af5-b1b4-ec0ecebe4d6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:04.618913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8925f918-4116-4af5-b1b4-ec0ecebe4d6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Aug 24 05:15:04.619451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 709/1526] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:05.240933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e68f29ac-10f9-4d5e-b4ec-fb48c8fef4c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:05.243248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e68f29ac-10f9-4d5e-b4ec-fb48c8fef4c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:05.249899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e68f29ac-10f9-4d5e-b4ec-fb48c8fef4c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:05.250379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e68f29ac-10f9-4d5e-b4ec-fb48c8fef4c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:05.250843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e68f29ac-10f9-4d5e-b4ec-fb48c8fef4c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:05.251529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e68f29ac-10f9-4d5e-b4ec-fb48c8fef4c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:05.251975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e68f29ac-10f9-4d5e-b4ec-fb48c8fef4c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:05.252389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e68f29ac-10f9-4d5e-b4ec-fb48c8fef4c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:05.283506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e68f29ac-10f9-4d5e-b4ec-fb48c8fef4c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046475 Aug 24 05:15:05.284065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 818/1527] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:05.543921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-11de69a4-5775-4e5c-be5e-0a025291bbf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:05.546189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-11de69a4-5775-4e5c-be5e-0a025291bbf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:05.552610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11de69a4-5775-4e5c-be5e-0a025291bbf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:05.553094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11de69a4-5775-4e5c-be5e-0a025291bbf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:05.553531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11de69a4-5775-4e5c-be5e-0a025291bbf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:05.554229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11de69a4-5775-4e5c-be5e-0a025291bbf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:05.554700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11de69a4-5775-4e5c-be5e-0a025291bbf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:05.555129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11de69a4-5775-4e5c-be5e-0a025291bbf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:05.586664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-11de69a4-5775-4e5c-be5e-0a025291bbf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046834 Aug 24 05:15:05.587252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 710/1528] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:05.630839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-babc646f-98f5-4809-9f34-91708c0acb92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:05.633218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-babc646f-98f5-4809-9f34-91708c0acb92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:05.642170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-babc646f-98f5-4809-9f34-91708c0acb92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:05.642653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-babc646f-98f5-4809-9f34-91708c0acb92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:05.643111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-babc646f-98f5-4809-9f34-91708c0acb92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:05.643805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-babc646f-98f5-4809-9f34-91708c0acb92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:05.644255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-babc646f-98f5-4809-9f34-91708c0acb92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:05.644678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-babc646f-98f5-4809-9f34-91708c0acb92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:05.676238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-babc646f-98f5-4809-9f34-91708c0acb92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049272 Aug 24 05:15:05.677059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 819/1529] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:06.295737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d00ade27-9982-4f64-9fe6-9bbcc49d63a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:06.297870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d00ade27-9982-4f64-9fe6-9bbcc49d63a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:06.304098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d00ade27-9982-4f64-9fe6-9bbcc49d63a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:06.304570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d00ade27-9982-4f64-9fe6-9bbcc49d63a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:06.304999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d00ade27-9982-4f64-9fe6-9bbcc49d63a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:06.305677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d00ade27-9982-4f64-9fe6-9bbcc49d63a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:06.306907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d00ade27-9982-4f64-9fe6-9bbcc49d63a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:06.307338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d00ade27-9982-4f64-9fe6-9bbcc49d63a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:06.336998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d00ade27-9982-4f64-9fe6-9bbcc49d63a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045835 Aug 24 05:15:06.337670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 711/1530] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:06.598404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-579d89fc-f7c5-431a-8b30-db5de16dd88d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:06.600572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-579d89fc-f7c5-431a-8b30-db5de16dd88d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:06.607516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-579d89fc-f7c5-431a-8b30-db5de16dd88d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:06.607991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-579d89fc-f7c5-431a-8b30-db5de16dd88d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:06.608420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-579d89fc-f7c5-431a-8b30-db5de16dd88d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:06.609096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-579d89fc-f7c5-431a-8b30-db5de16dd88d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:06.609541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-579d89fc-f7c5-431a-8b30-db5de16dd88d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:06.610030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-579d89fc-f7c5-431a-8b30-db5de16dd88d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:06.639614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-579d89fc-f7c5-431a-8b30-db5de16dd88d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045264 Aug 24 05:15:06.640215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 820/1531] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:06.688772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d8a94757-6b31-4ab1-909a-9d6e90837233 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:06.690949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d8a94757-6b31-4ab1-909a-9d6e90837233 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:06.697344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8a94757-6b31-4ab1-909a-9d6e90837233 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:06.697812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8a94757-6b31-4ab1-909a-9d6e90837233 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:06.698290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8a94757-6b31-4ab1-909a-9d6e90837233 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:06.698977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8a94757-6b31-4ab1-909a-9d6e90837233 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:06.699422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8a94757-6b31-4ab1-909a-9d6e90837233 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:06.699837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8a94757-6b31-4ab1-909a-9d6e90837233 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:06.729357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d8a94757-6b31-4ab1-909a-9d6e90837233 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044604 Aug 24 05:15:06.729906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 712/1532] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:07.349346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a179f6fb-9f3c-435c-9798-c84add98885a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:07.351489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a179f6fb-9f3c-435c-9798-c84add98885a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:07.357554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a179f6fb-9f3c-435c-9798-c84add98885a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:07.358025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a179f6fb-9f3c-435c-9798-c84add98885a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:07.358454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a179f6fb-9f3c-435c-9798-c84add98885a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:07.359169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a179f6fb-9f3c-435c-9798-c84add98885a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:07.359611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a179f6fb-9f3c-435c-9798-c84add98885a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:07.360028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a179f6fb-9f3c-435c-9798-c84add98885a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:07.391076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a179f6fb-9f3c-435c-9798-c84add98885a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Aug 24 05:15:07.391631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 821/1533] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:07.652470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-03e7c569-8ed8-442f-83d3-d43ac94b4eca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:07.655106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-03e7c569-8ed8-442f-83d3-d43ac94b4eca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:07.661886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e7c569-8ed8-442f-83d3-d43ac94b4eca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:07.662365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e7c569-8ed8-442f-83d3-d43ac94b4eca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:07.662871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e7c569-8ed8-442f-83d3-d43ac94b4eca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:07.663568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e7c569-8ed8-442f-83d3-d43ac94b4eca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:07.664016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e7c569-8ed8-442f-83d3-d43ac94b4eca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:07.664438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e7c569-8ed8-442f-83d3-d43ac94b4eca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:07.694119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-03e7c569-8ed8-442f-83d3-d43ac94b4eca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046298 Aug 24 05:15:07.694774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 713/1534] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:07.741416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c93b12b2-110c-4c3d-bd08-42b2444c5917 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:07.744126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c93b12b2-110c-4c3d-bd08-42b2444c5917 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:07.750557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93b12b2-110c-4c3d-bd08-42b2444c5917 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:07.751073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93b12b2-110c-4c3d-bd08-42b2444c5917 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:07.751504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93b12b2-110c-4c3d-bd08-42b2444c5917 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:07.752182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93b12b2-110c-4c3d-bd08-42b2444c5917 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:07.752625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93b12b2-110c-4c3d-bd08-42b2444c5917 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:07.753038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c93b12b2-110c-4c3d-bd08-42b2444c5917 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:07.782698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c93b12b2-110c-4c3d-bd08-42b2444c5917 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045196 Aug 24 05:15:07.783249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 822/1535] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:08.403433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5c9826ce-73fd-4d77-beea-2a0c4c762a19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:08.405533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5c9826ce-73fd-4d77-beea-2a0c4c762a19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:08.411594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c9826ce-73fd-4d77-beea-2a0c4c762a19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:08.412068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c9826ce-73fd-4d77-beea-2a0c4c762a19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:08.412499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c9826ce-73fd-4d77-beea-2a0c4c762a19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:08.413175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c9826ce-73fd-4d77-beea-2a0c4c762a19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:08.413618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c9826ce-73fd-4d77-beea-2a0c4c762a19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:08.414035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5c9826ce-73fd-4d77-beea-2a0c4c762a19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:08.444508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5c9826ce-73fd-4d77-beea-2a0c4c762a19 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Aug 24 05:15:08.445062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 714/1536] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:08.706674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-07fa1101-53f8-4ef8-9c51-d26f84406a5d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:08.708794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-07fa1101-53f8-4ef8-9c51-d26f84406a5d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:08.714778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07fa1101-53f8-4ef8-9c51-d26f84406a5d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:08.715249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07fa1101-53f8-4ef8-9c51-d26f84406a5d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:08.715674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07fa1101-53f8-4ef8-9c51-d26f84406a5d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:08.716343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07fa1101-53f8-4ef8-9c51-d26f84406a5d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:08.716782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07fa1101-53f8-4ef8-9c51-d26f84406a5d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:08.717191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07fa1101-53f8-4ef8-9c51-d26f84406a5d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:08.747147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-07fa1101-53f8-4ef8-9c51-d26f84406a5d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044423 Aug 24 05:15:08.747699 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 823/1537] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:08.795596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a1578da5-a943-48de-9241-5893488fb7db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:08.797771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a1578da5-a943-48de-9241-5893488fb7db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:08.804595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1578da5-a943-48de-9241-5893488fb7db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:08.805096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1578da5-a943-48de-9241-5893488fb7db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:08.805525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1578da5-a943-48de-9241-5893488fb7db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:08.806965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1578da5-a943-48de-9241-5893488fb7db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:08.807414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1578da5-a943-48de-9241-5893488fb7db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:08.807860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1578da5-a943-48de-9241-5893488fb7db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:08.836214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a1578da5-a943-48de-9241-5893488fb7db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044858 Aug 24 05:15:08.836748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 715/1538] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:09.457299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ab796cac-276d-4291-802b-46d900074905 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:09.460156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ab796cac-276d-4291-802b-46d900074905 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:09.463728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=86 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:09.469062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab796cac-276d-4291-802b-46d900074905 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:09.469539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab796cac-276d-4291-802b-46d900074905 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:09.469975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab796cac-276d-4291-802b-46d900074905 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:09.470669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab796cac-276d-4291-802b-46d900074905 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:09.471146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab796cac-276d-4291-802b-46d900074905 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:09.471571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab796cac-276d-4291-802b-46d900074905 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:09.501822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ab796cac-276d-4291-802b-46d900074905 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048271 Aug 24 05:15:09.502191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 824/1539] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:09.758508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7900f2fd-3730-4c36-b9e3-224bb26952fa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:09.761163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7900f2fd-3730-4c36-b9e3-224bb26952fa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:09.767184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7900f2fd-3730-4c36-b9e3-224bb26952fa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:09.767665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7900f2fd-3730-4c36-b9e3-224bb26952fa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:09.768111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7900f2fd-3730-4c36-b9e3-224bb26952fa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:09.768799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7900f2fd-3730-4c36-b9e3-224bb26952fa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:09.769250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7900f2fd-3730-4c36-b9e3-224bb26952fa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:09.769674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7900f2fd-3730-4c36-b9e3-224bb26952fa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:09.800419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7900f2fd-3730-4c36-b9e3-224bb26952fa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045847 Aug 24 05:15:09.801266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 716/1540] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:09.848817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-61976ac9-cebd-4e11-8cd2-ca3f56f860d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:09.851463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-61976ac9-cebd-4e11-8cd2-ca3f56f860d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:09.857915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61976ac9-cebd-4e11-8cd2-ca3f56f860d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:09.858387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61976ac9-cebd-4e11-8cd2-ca3f56f860d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:09.858865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61976ac9-cebd-4e11-8cd2-ca3f56f860d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:09.859553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61976ac9-cebd-4e11-8cd2-ca3f56f860d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:09.859993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61976ac9-cebd-4e11-8cd2-ca3f56f860d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:09.860401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61976ac9-cebd-4e11-8cd2-ca3f56f860d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:09.891127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-61976ac9-cebd-4e11-8cd2-ca3f56f860d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046188 Aug 24 05:15:09.891682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 825/1541] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:10.513912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bef12d7f-9308-4dc4-8c90-5ea93821dee5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:10.516061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bef12d7f-9308-4dc4-8c90-5ea93821dee5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:10.522447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bef12d7f-9308-4dc4-8c90-5ea93821dee5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:10.522954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bef12d7f-9308-4dc4-8c90-5ea93821dee5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:10.523391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bef12d7f-9308-4dc4-8c90-5ea93821dee5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:10.524073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bef12d7f-9308-4dc4-8c90-5ea93821dee5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:10.524519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bef12d7f-9308-4dc4-8c90-5ea93821dee5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:10.525659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bef12d7f-9308-4dc4-8c90-5ea93821dee5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:10.557279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bef12d7f-9308-4dc4-8c90-5ea93821dee5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047247 Aug 24 05:15:10.558049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 717/1542] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:10.812524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-637c7ecd-1b19-4332-a960-1c584679c72c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:10.814635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-637c7ecd-1b19-4332-a960-1c584679c72c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:10.821100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637c7ecd-1b19-4332-a960-1c584679c72c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:10.821851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637c7ecd-1b19-4332-a960-1c584679c72c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:10.822356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637c7ecd-1b19-4332-a960-1c584679c72c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:10.823072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637c7ecd-1b19-4332-a960-1c584679c72c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:10.823522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637c7ecd-1b19-4332-a960-1c584679c72c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:10.823942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-637c7ecd-1b19-4332-a960-1c584679c72c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:10.841266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:10.855875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-637c7ecd-1b19-4332-a960-1c584679c72c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047312 Aug 24 05:15:10.856520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 826/1543] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:10.903245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2f02df14-2044-40c7-b208-5d2e7deff715 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:10.905406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2f02df14-2044-40c7-b208-5d2e7deff715 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:10.911354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f02df14-2044-40c7-b208-5d2e7deff715 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:10.911830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f02df14-2044-40c7-b208-5d2e7deff715 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:10.912260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f02df14-2044-40c7-b208-5d2e7deff715 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:10.912944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f02df14-2044-40c7-b208-5d2e7deff715 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:10.913393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f02df14-2044-40c7-b208-5d2e7deff715 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:10.913812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f02df14-2044-40c7-b208-5d2e7deff715 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:10.950263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2f02df14-2044-40c7-b208-5d2e7deff715 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051631 Aug 24 05:15:10.950827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 718/1544] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:11.569481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3fadae53-0681-45ba-9040-8efb5bc39a20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:11.572539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3fadae53-0681-45ba-9040-8efb5bc39a20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:11.578847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fadae53-0681-45ba-9040-8efb5bc39a20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:11.579325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fadae53-0681-45ba-9040-8efb5bc39a20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:11.579761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fadae53-0681-45ba-9040-8efb5bc39a20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:11.580452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fadae53-0681-45ba-9040-8efb5bc39a20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:11.580901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fadae53-0681-45ba-9040-8efb5bc39a20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:11.581321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3fadae53-0681-45ba-9040-8efb5bc39a20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:11.612931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3fadae53-0681-45ba-9040-8efb5bc39a20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047254 Aug 24 05:15:11.613680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 827/1545] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:11.869811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0074f243-3d80-4611-97d6-74b7d4db232e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:11.871972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0074f243-3d80-4611-97d6-74b7d4db232e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:11.878331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0074f243-3d80-4611-97d6-74b7d4db232e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:11.878893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0074f243-3d80-4611-97d6-74b7d4db232e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:11.879264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0074f243-3d80-4611-97d6-74b7d4db232e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:11.879941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0074f243-3d80-4611-97d6-74b7d4db232e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:11.880385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0074f243-3d80-4611-97d6-74b7d4db232e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:11.880799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0074f243-3d80-4611-97d6-74b7d4db232e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:11.884606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:11.910700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0074f243-3d80-4611-97d6-74b7d4db232e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045622 Aug 24 05:15:11.911385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 719/1546] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:11.961581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ee4fa8ad-5b81-41d8-8e6d-b2a55b53d9a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:11.963815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ee4fa8ad-5b81-41d8-8e6d-b2a55b53d9a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:11.970242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4fa8ad-5b81-41d8-8e6d-b2a55b53d9a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:11.970746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4fa8ad-5b81-41d8-8e6d-b2a55b53d9a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:11.971179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4fa8ad-5b81-41d8-8e6d-b2a55b53d9a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:11.971872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4fa8ad-5b81-41d8-8e6d-b2a55b53d9a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:11.972345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4fa8ad-5b81-41d8-8e6d-b2a55b53d9a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:11.972768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4fa8ad-5b81-41d8-8e6d-b2a55b53d9a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:12.003639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ee4fa8ad-5b81-41d8-8e6d-b2a55b53d9a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046057 Aug 24 05:15:12.004187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 828/1547] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:12.625821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a9532d79-7906-44aa-a6b5-84b4a0a0c4a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:12.628000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a9532d79-7906-44aa-a6b5-84b4a0a0c4a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:12.634654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9532d79-7906-44aa-a6b5-84b4a0a0c4a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:12.635140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9532d79-7906-44aa-a6b5-84b4a0a0c4a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:12.635578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9532d79-7906-44aa-a6b5-84b4a0a0c4a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:12.636282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9532d79-7906-44aa-a6b5-84b4a0a0c4a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:12.636737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9532d79-7906-44aa-a6b5-84b4a0a0c4a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:12.637195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9532d79-7906-44aa-a6b5-84b4a0a0c4a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:12.668441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a9532d79-7906-44aa-a6b5-84b4a0a0c4a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046550 Aug 24 05:15:12.668993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 720/1548] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:12.923191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7b684780-ccbc-4685-9433-718814635fa8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:12.925281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7b684780-ccbc-4685-9433-718814635fa8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:12.931637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b684780-ccbc-4685-9433-718814635fa8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:12.932107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b684780-ccbc-4685-9433-718814635fa8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:12.932536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b684780-ccbc-4685-9433-718814635fa8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:12.933216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b684780-ccbc-4685-9433-718814635fa8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:12.933659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b684780-ccbc-4685-9433-718814635fa8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:12.934070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b684780-ccbc-4685-9433-718814635fa8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:12.965296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7b684780-ccbc-4685-9433-718814635fa8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045914 Aug 24 05:15:12.965985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 829/1549] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:13.018259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4261536e-0c37-4eac-9166-97a8892ba769 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:13.020494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4261536e-0c37-4eac-9166-97a8892ba769 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:13.027742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4261536e-0c37-4eac-9166-97a8892ba769 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:13.028224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4261536e-0c37-4eac-9166-97a8892ba769 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:13.028659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4261536e-0c37-4eac-9166-97a8892ba769 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:13.029360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4261536e-0c37-4eac-9166-97a8892ba769 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:13.029891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4261536e-0c37-4eac-9166-97a8892ba769 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:13.030317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4261536e-0c37-4eac-9166-97a8892ba769 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:13.061747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4261536e-0c37-4eac-9166-97a8892ba769 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047747 Aug 24 05:15:13.062309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 721/1550] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:13.682024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-129658ec-de69-487f-bb06-5414035d3ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:13.684142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-129658ec-de69-487f-bb06-5414035d3ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:13.690554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-129658ec-de69-487f-bb06-5414035d3ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:13.691052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-129658ec-de69-487f-bb06-5414035d3ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:13.691480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-129658ec-de69-487f-bb06-5414035d3ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:13.692153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-129658ec-de69-487f-bb06-5414035d3ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:13.692591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-129658ec-de69-487f-bb06-5414035d3ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:13.693001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-129658ec-de69-487f-bb06-5414035d3ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:13.723400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-129658ec-de69-487f-bb06-5414035d3ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046420 Aug 24 05:15:13.723973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 830/1551] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:13.978644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-198d141e-b09b-4934-8de9-6f9694032283 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:13.980812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-198d141e-b09b-4934-8de9-6f9694032283 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:13.987095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-198d141e-b09b-4934-8de9-6f9694032283 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:13.987579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-198d141e-b09b-4934-8de9-6f9694032283 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:13.988014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-198d141e-b09b-4934-8de9-6f9694032283 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:13.988739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-198d141e-b09b-4934-8de9-6f9694032283 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:13.989161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-198d141e-b09b-4934-8de9-6f9694032283 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:13.989591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-198d141e-b09b-4934-8de9-6f9694032283 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:14.020239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-198d141e-b09b-4934-8de9-6f9694032283 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Aug 24 05:15:14.020917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 722/1552] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:14.074532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8ee23853-7297-48d3-9683-8ab47094ee01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:14.076806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8ee23853-7297-48d3-9683-8ab47094ee01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:14.084657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee23853-7297-48d3-9683-8ab47094ee01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:14.085134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee23853-7297-48d3-9683-8ab47094ee01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:14.085567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee23853-7297-48d3-9683-8ab47094ee01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:14.086252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee23853-7297-48d3-9683-8ab47094ee01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:14.086720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee23853-7297-48d3-9683-8ab47094ee01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:14.087191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee23853-7297-48d3-9683-8ab47094ee01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:14.119623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8ee23853-7297-48d3-9683-8ab47094ee01 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048646 Aug 24 05:15:14.120190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 831/1553] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:14.736009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-18bad2bc-443d-42a7-9445-50f0ce66e133 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:14.737930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-18bad2bc-443d-42a7-9445-50f0ce66e133 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:14.745072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bad2bc-443d-42a7-9445-50f0ce66e133 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:14.745559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bad2bc-443d-42a7-9445-50f0ce66e133 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:14.746000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bad2bc-443d-42a7-9445-50f0ce66e133 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:14.746979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bad2bc-443d-42a7-9445-50f0ce66e133 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:14.747448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bad2bc-443d-42a7-9445-50f0ce66e133 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:14.747873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bad2bc-443d-42a7-9445-50f0ce66e133 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:14.784211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-18bad2bc-443d-42a7-9445-50f0ce66e133 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052633 Aug 24 05:15:14.784776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 723/1554] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:15.032889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-12aec010-897a-4025-a18e-772969ac21ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:15.034953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-12aec010-897a-4025-a18e-772969ac21ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:15.041088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12aec010-897a-4025-a18e-772969ac21ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:15.041559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12aec010-897a-4025-a18e-772969ac21ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:15.041991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12aec010-897a-4025-a18e-772969ac21ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:15.042676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12aec010-897a-4025-a18e-772969ac21ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:15.043385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12aec010-897a-4025-a18e-772969ac21ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:15.043545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12aec010-897a-4025-a18e-772969ac21ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:15.074314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-12aec010-897a-4025-a18e-772969ac21ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045596 Aug 24 05:15:15.074891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 832/1555] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:15.132109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-20b545ca-4992-43bc-9042-6f089793e1db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:15.134941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-20b545ca-4992-43bc-9042-6f089793e1db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:15.141425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b545ca-4992-43bc-9042-6f089793e1db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:15.141911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b545ca-4992-43bc-9042-6f089793e1db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:15.142341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b545ca-4992-43bc-9042-6f089793e1db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:15.143064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b545ca-4992-43bc-9042-6f089793e1db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:15.143519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b545ca-4992-43bc-9042-6f089793e1db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:15.143929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b545ca-4992-43bc-9042-6f089793e1db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:15.173635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-20b545ca-4992-43bc-9042-6f089793e1db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045546 Aug 24 05:15:15.174186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 724/1556] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:15.798138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-388d875e-934a-4c3d-b37a-b3cf44eaeb77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:15.800302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-388d875e-934a-4c3d-b37a-b3cf44eaeb77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:15.806891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-388d875e-934a-4c3d-b37a-b3cf44eaeb77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:15.807364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-388d875e-934a-4c3d-b37a-b3cf44eaeb77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:15.807790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-388d875e-934a-4c3d-b37a-b3cf44eaeb77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:15.808465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-388d875e-934a-4c3d-b37a-b3cf44eaeb77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:15.808903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-388d875e-934a-4c3d-b37a-b3cf44eaeb77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:15.809325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-388d875e-934a-4c3d-b37a-b3cf44eaeb77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:15.839166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-388d875e-934a-4c3d-b37a-b3cf44eaeb77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045009 Aug 24 05:15:15.839982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 833/1557] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:16.085721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b9f5b299-1cf7-465a-913b-b688674153d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:16.088380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b9f5b299-1cf7-465a-913b-b688674153d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:16.095005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9f5b299-1cf7-465a-913b-b688674153d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:16.095491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9f5b299-1cf7-465a-913b-b688674153d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:16.096020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9f5b299-1cf7-465a-913b-b688674153d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:16.096723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9f5b299-1cf7-465a-913b-b688674153d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:16.097178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9f5b299-1cf7-465a-913b-b688674153d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:16.097604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b9f5b299-1cf7-465a-913b-b688674153d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:16.128616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b9f5b299-1cf7-465a-913b-b688674153d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046907 Aug 24 05:15:16.129164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 725/1558] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:16.186150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-73543321-1fbf-4723-8fcd-119e8ea49eb2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:16.188314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-73543321-1fbf-4723-8fcd-119e8ea49eb2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:16.194883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-73543321-1fbf-4723-8fcd-119e8ea49eb2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:16.195359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-73543321-1fbf-4723-8fcd-119e8ea49eb2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:16.195823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-73543321-1fbf-4723-8fcd-119e8ea49eb2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:16.197037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-73543321-1fbf-4723-8fcd-119e8ea49eb2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:16.197584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-73543321-1fbf-4723-8fcd-119e8ea49eb2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:16.198010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-73543321-1fbf-4723-8fcd-119e8ea49eb2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:16.227633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-73543321-1fbf-4723-8fcd-119e8ea49eb2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045372 Aug 24 05:15:16.228345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 834/1559] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:16 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:16.851567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-87e03999-2703-4894-8a73-c909c5ea7904 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:16.853970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-87e03999-2703-4894-8a73-c909c5ea7904 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:16.860915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87e03999-2703-4894-8a73-c909c5ea7904 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:16.861393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87e03999-2703-4894-8a73-c909c5ea7904 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:16.861827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87e03999-2703-4894-8a73-c909c5ea7904 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:16.862522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87e03999-2703-4894-8a73-c909c5ea7904 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:16.862996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87e03999-2703-4894-8a73-c909c5ea7904 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:16.863412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87e03999-2703-4894-8a73-c909c5ea7904 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:16.894732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-87e03999-2703-4894-8a73-c909c5ea7904 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047164 Aug 24 05:15:16.895790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 726/1560] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:16 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:17.141154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1c31b15e-8898-440f-87a2-1cce1727a317 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:17.143477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1c31b15e-8898-440f-87a2-1cce1727a317 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:17.149406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c31b15e-8898-440f-87a2-1cce1727a317 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:17.149982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c31b15e-8898-440f-87a2-1cce1727a317 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:17.150529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c31b15e-8898-440f-87a2-1cce1727a317 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:17.151262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c31b15e-8898-440f-87a2-1cce1727a317 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:17.151718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c31b15e-8898-440f-87a2-1cce1727a317 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:17.152139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c31b15e-8898-440f-87a2-1cce1727a317 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:17.184649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1c31b15e-8898-440f-87a2-1cce1727a317 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047390 Aug 24 05:15:17.185218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 835/1561] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:17 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:17.240360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d235858d-a840-4d72-a0ce-11b74dee15ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:17.242456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d235858d-a840-4d72-a0ce-11b74dee15ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:17.249622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d235858d-a840-4d72-a0ce-11b74dee15ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:17.250328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d235858d-a840-4d72-a0ce-11b74dee15ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:17.250782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d235858d-a840-4d72-a0ce-11b74dee15ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:17.251471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d235858d-a840-4d72-a0ce-11b74dee15ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:17.251924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d235858d-a840-4d72-a0ce-11b74dee15ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:17.252331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d235858d-a840-4d72-a0ce-11b74dee15ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:17.282391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d235858d-a840-4d72-a0ce-11b74dee15ab tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046039 Aug 24 05:15:17.282992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 727/1562] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:17.907208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d559d7bf-0fc9-4f0d-a827-f436f7b91b2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:17.909260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d559d7bf-0fc9-4f0d-a827-f436f7b91b2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:17.916041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d559d7bf-0fc9-4f0d-a827-f436f7b91b2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:17.916523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d559d7bf-0fc9-4f0d-a827-f436f7b91b2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:17.916960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d559d7bf-0fc9-4f0d-a827-f436f7b91b2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:17.917652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d559d7bf-0fc9-4f0d-a827-f436f7b91b2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:17.918102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d559d7bf-0fc9-4f0d-a827-f436f7b91b2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:17.918525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d559d7bf-0fc9-4f0d-a827-f436f7b91b2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:17.949843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d559d7bf-0fc9-4f0d-a827-f436f7b91b2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046634 Aug 24 05:15:17.950401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 836/1563] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:18.197883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-83635823-c20d-4509-994a-b0714f2f9485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:18.200108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-83635823-c20d-4509-994a-b0714f2f9485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:18.206657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83635823-c20d-4509-994a-b0714f2f9485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:18.207220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83635823-c20d-4509-994a-b0714f2f9485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:18.207655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83635823-c20d-4509-994a-b0714f2f9485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:18.208441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83635823-c20d-4509-994a-b0714f2f9485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:18.208898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83635823-c20d-4509-994a-b0714f2f9485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:18.209369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-83635823-c20d-4509-994a-b0714f2f9485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:18.241652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-83635823-c20d-4509-994a-b0714f2f9485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048605 Aug 24 05:15:18.242274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 728/1564] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:18.295125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4748995f-fa69-489b-b0af-fc7606b5c49f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:18.297350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4748995f-fa69-489b-b0af-fc7606b5c49f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:18.303747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4748995f-fa69-489b-b0af-fc7606b5c49f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:18.304214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4748995f-fa69-489b-b0af-fc7606b5c49f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:18.304640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4748995f-fa69-489b-b0af-fc7606b5c49f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:18.305314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4748995f-fa69-489b-b0af-fc7606b5c49f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:18.306257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4748995f-fa69-489b-b0af-fc7606b5c49f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:18.306795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4748995f-fa69-489b-b0af-fc7606b5c49f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:18.344836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4748995f-fa69-489b-b0af-fc7606b5c49f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053718 Aug 24 05:15:18.345379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 837/1565] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:18.962183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7128a6ed-c2bf-4dd9-9450-106b7a5b20f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:18.964475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7128a6ed-c2bf-4dd9-9450-106b7a5b20f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:18.970918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7128a6ed-c2bf-4dd9-9450-106b7a5b20f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:18.971397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7128a6ed-c2bf-4dd9-9450-106b7a5b20f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:18.971837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7128a6ed-c2bf-4dd9-9450-106b7a5b20f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:18.972526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7128a6ed-c2bf-4dd9-9450-106b7a5b20f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:18.972976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7128a6ed-c2bf-4dd9-9450-106b7a5b20f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:18.973397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7128a6ed-c2bf-4dd9-9450-106b7a5b20f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:19.005468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7128a6ed-c2bf-4dd9-9450-106b7a5b20f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047228 Aug 24 05:15:19.006005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 729/1566] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:19.255620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d5f93018-c592-4c21-ae65-1039cc6f774a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:19.258258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d5f93018-c592-4c21-ae65-1039cc6f774a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:19.265701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5f93018-c592-4c21-ae65-1039cc6f774a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:19.266265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5f93018-c592-4c21-ae65-1039cc6f774a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:19.266760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5f93018-c592-4c21-ae65-1039cc6f774a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:19.267504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5f93018-c592-4c21-ae65-1039cc6f774a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:19.267955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5f93018-c592-4c21-ae65-1039cc6f774a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:19.268375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5f93018-c592-4c21-ae65-1039cc6f774a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:19.298640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d5f93018-c592-4c21-ae65-1039cc6f774a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047914 Aug 24 05:15:19.299295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 838/1567] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:19.357023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b23f36c6-fff9-4c29-bfc6-2f9b1f99c4e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:19.359208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b23f36c6-fff9-4c29-bfc6-2f9b1f99c4e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:19.365188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b23f36c6-fff9-4c29-bfc6-2f9b1f99c4e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:19.365666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b23f36c6-fff9-4c29-bfc6-2f9b1f99c4e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:19.366101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b23f36c6-fff9-4c29-bfc6-2f9b1f99c4e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:19.366817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b23f36c6-fff9-4c29-bfc6-2f9b1f99c4e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:19.367268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b23f36c6-fff9-4c29-bfc6-2f9b1f99c4e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:19.367697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b23f36c6-fff9-4c29-bfc6-2f9b1f99c4e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:19.397396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b23f36c6-fff9-4c29-bfc6-2f9b1f99c4e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044895 Aug 24 05:15:19.397940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 730/1568] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:20.017932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-208874fd-87bc-4e50-b729-cd3af6b68ef1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:20.020081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-208874fd-87bc-4e50-b729-cd3af6b68ef1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:20.027096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-208874fd-87bc-4e50-b729-cd3af6b68ef1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:20.027572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-208874fd-87bc-4e50-b729-cd3af6b68ef1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:20.028032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-208874fd-87bc-4e50-b729-cd3af6b68ef1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:20.028718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-208874fd-87bc-4e50-b729-cd3af6b68ef1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:20.029163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-208874fd-87bc-4e50-b729-cd3af6b68ef1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:20.029592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-208874fd-87bc-4e50-b729-cd3af6b68ef1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:20.063020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-208874fd-87bc-4e50-b729-cd3af6b68ef1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049157 Aug 24 05:15:20.063572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 839/1569] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:20.312556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-159b3c07-9362-4eb0-b70e-1f19ebe7137d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:20.314672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-159b3c07-9362-4eb0-b70e-1f19ebe7137d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:20.323430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159b3c07-9362-4eb0-b70e-1f19ebe7137d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:20.323913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159b3c07-9362-4eb0-b70e-1f19ebe7137d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:20.324344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159b3c07-9362-4eb0-b70e-1f19ebe7137d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:20.325071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159b3c07-9362-4eb0-b70e-1f19ebe7137d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:20.325507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159b3c07-9362-4eb0-b70e-1f19ebe7137d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:20.325928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159b3c07-9362-4eb0-b70e-1f19ebe7137d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:20.355953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-159b3c07-9362-4eb0-b70e-1f19ebe7137d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047489 Aug 24 05:15:20.356500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 731/1570] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:20.410085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4ca91260-4c3e-416f-bc29-a3fc93ef5aaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:20.412320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4ca91260-4c3e-416f-bc29-a3fc93ef5aaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:20.419089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ca91260-4c3e-416f-bc29-a3fc93ef5aaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:20.419606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ca91260-4c3e-416f-bc29-a3fc93ef5aaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:20.420071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ca91260-4c3e-416f-bc29-a3fc93ef5aaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:20.420759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ca91260-4c3e-416f-bc29-a3fc93ef5aaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:20.421207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ca91260-4c3e-416f-bc29-a3fc93ef5aaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:20.421626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4ca91260-4c3e-416f-bc29-a3fc93ef5aaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:20.452837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4ca91260-4c3e-416f-bc29-a3fc93ef5aaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046680 Aug 24 05:15:20.453483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 840/1571] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:21.076113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fde0b27a-acf8-42b2-8b3a-21e1299e429b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:21.078250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fde0b27a-acf8-42b2-8b3a-21e1299e429b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:21.084268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fde0b27a-acf8-42b2-8b3a-21e1299e429b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:21.084739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fde0b27a-acf8-42b2-8b3a-21e1299e429b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:21.085166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fde0b27a-acf8-42b2-8b3a-21e1299e429b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:21.085841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fde0b27a-acf8-42b2-8b3a-21e1299e429b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:21.086284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fde0b27a-acf8-42b2-8b3a-21e1299e429b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:21.086711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fde0b27a-acf8-42b2-8b3a-21e1299e429b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:21.115221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fde0b27a-acf8-42b2-8b3a-21e1299e429b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043744 Aug 24 05:15:21.115760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 732/1572] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:21.369654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-31a1ab54-3c22-4549-8437-8b86c5cc2ccc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:21.371923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-31a1ab54-3c22-4549-8437-8b86c5cc2ccc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:21.378202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31a1ab54-3c22-4549-8437-8b86c5cc2ccc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:21.378701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31a1ab54-3c22-4549-8437-8b86c5cc2ccc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:21.379159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31a1ab54-3c22-4549-8437-8b86c5cc2ccc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:21.379859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31a1ab54-3c22-4549-8437-8b86c5cc2ccc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:21.380306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31a1ab54-3c22-4549-8437-8b86c5cc2ccc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:21.380728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31a1ab54-3c22-4549-8437-8b86c5cc2ccc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:21.411125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-31a1ab54-3c22-4549-8437-8b86c5cc2ccc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Aug 24 05:15:21.411944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 841/1573] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:21.465828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-be8222b6-d639-4902-ac73-43ecf9247e9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:21.468024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-be8222b6-d639-4902-ac73-43ecf9247e9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:21.474420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be8222b6-d639-4902-ac73-43ecf9247e9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:21.474934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be8222b6-d639-4902-ac73-43ecf9247e9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:21.475370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be8222b6-d639-4902-ac73-43ecf9247e9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:21.476058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be8222b6-d639-4902-ac73-43ecf9247e9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:21.476509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be8222b6-d639-4902-ac73-43ecf9247e9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:21.476934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-be8222b6-d639-4902-ac73-43ecf9247e9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:21.506146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-be8222b6-d639-4902-ac73-43ecf9247e9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045006 Aug 24 05:15:21.506850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 733/1574] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:22.128962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-58a1464d-212a-40c0-81f0-4b9e3521c34d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:22.131014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-58a1464d-212a-40c0-81f0-4b9e3521c34d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:22.138300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58a1464d-212a-40c0-81f0-4b9e3521c34d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:22.138852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58a1464d-212a-40c0-81f0-4b9e3521c34d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:22.139310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58a1464d-212a-40c0-81f0-4b9e3521c34d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:22.140079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58a1464d-212a-40c0-81f0-4b9e3521c34d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:22.140575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58a1464d-212a-40c0-81f0-4b9e3521c34d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:22.140995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58a1464d-212a-40c0-81f0-4b9e3521c34d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:22.172281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-58a1464d-212a-40c0-81f0-4b9e3521c34d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047530 Aug 24 05:15:22.172815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 842/1575] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:22.424524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e89b0fb4-8c7e-452d-9c01-77ce192b0427 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:22.426570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e89b0fb4-8c7e-452d-9c01-77ce192b0427 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:22.433653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e89b0fb4-8c7e-452d-9c01-77ce192b0427 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:22.434148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e89b0fb4-8c7e-452d-9c01-77ce192b0427 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:22.434716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e89b0fb4-8c7e-452d-9c01-77ce192b0427 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:22.435294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e89b0fb4-8c7e-452d-9c01-77ce192b0427 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:22.435747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e89b0fb4-8c7e-452d-9c01-77ce192b0427 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:22.436170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e89b0fb4-8c7e-452d-9c01-77ce192b0427 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:22.465687 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e89b0fb4-8c7e-452d-9c01-77ce192b0427 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045238 Aug 24 05:15:22.466240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 734/1576] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:22 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:22.519340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9dbb45a6-bdbf-4854-b012-377b83239014 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:22.521508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9dbb45a6-bdbf-4854-b012-377b83239014 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:22.528176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dbb45a6-bdbf-4854-b012-377b83239014 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:22.528653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dbb45a6-bdbf-4854-b012-377b83239014 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:22.529112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dbb45a6-bdbf-4854-b012-377b83239014 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:22.529792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dbb45a6-bdbf-4854-b012-377b83239014 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:22.530265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dbb45a6-bdbf-4854-b012-377b83239014 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:22.530704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dbb45a6-bdbf-4854-b012-377b83239014 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:22.534243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:22.561570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9dbb45a6-bdbf-4854-b012-377b83239014 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046193 Aug 24 05:15:22.562133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 843/1577] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:23.184662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c95f1ce7-0a6a-42e8-ac23-0dfa7fcc3d0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:23.186830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c95f1ce7-0a6a-42e8-ac23-0dfa7fcc3d0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:23.193430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c95f1ce7-0a6a-42e8-ac23-0dfa7fcc3d0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:23.193912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c95f1ce7-0a6a-42e8-ac23-0dfa7fcc3d0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:23.194350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c95f1ce7-0a6a-42e8-ac23-0dfa7fcc3d0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:23.195088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c95f1ce7-0a6a-42e8-ac23-0dfa7fcc3d0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:23.195543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c95f1ce7-0a6a-42e8-ac23-0dfa7fcc3d0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:23.195971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c95f1ce7-0a6a-42e8-ac23-0dfa7fcc3d0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:23.220769 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:23.226185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c95f1ce7-0a6a-42e8-ac23-0dfa7fcc3d0b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046155 Aug 24 05:15:23.226756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 735/1578] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:23.478315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c383ee3e-de92-4c9b-930d-478f028e80d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:23.480460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c383ee3e-de92-4c9b-930d-478f028e80d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:23.486932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c383ee3e-de92-4c9b-930d-478f028e80d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:23.487402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c383ee3e-de92-4c9b-930d-478f028e80d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:23.487831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c383ee3e-de92-4c9b-930d-478f028e80d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:23.488509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c383ee3e-de92-4c9b-930d-478f028e80d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:23.488978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c383ee3e-de92-4c9b-930d-478f028e80d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:23.489394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c383ee3e-de92-4c9b-930d-478f028e80d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:23.519412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c383ee3e-de92-4c9b-930d-478f028e80d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045132 Aug 24 05:15:23.520157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 844/1579] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:23.574378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3bd4f271-4211-43b4-9c28-e07ccc6f8902 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:23.576518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3bd4f271-4211-43b4-9c28-e07ccc6f8902 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:23.582629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3bd4f271-4211-43b4-9c28-e07ccc6f8902 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:23.583133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3bd4f271-4211-43b4-9c28-e07ccc6f8902 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:23.583560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3bd4f271-4211-43b4-9c28-e07ccc6f8902 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:23.584239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3bd4f271-4211-43b4-9c28-e07ccc6f8902 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:23.584680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3bd4f271-4211-43b4-9c28-e07ccc6f8902 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:23.585101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3bd4f271-4211-43b4-9c28-e07ccc6f8902 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:23.615325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3bd4f271-4211-43b4-9c28-e07ccc6f8902 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045737 Aug 24 05:15:23.615869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 736/1580] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:24.239304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0c55669b-0211-4f1d-a93e-7af94fa6fdda tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:24.241447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0c55669b-0211-4f1d-a93e-7af94fa6fdda tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:24.247759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c55669b-0211-4f1d-a93e-7af94fa6fdda tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:24.248230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c55669b-0211-4f1d-a93e-7af94fa6fdda tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:24.248657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c55669b-0211-4f1d-a93e-7af94fa6fdda tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:24.249334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c55669b-0211-4f1d-a93e-7af94fa6fdda tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:24.249774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c55669b-0211-4f1d-a93e-7af94fa6fdda tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:24.250187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c55669b-0211-4f1d-a93e-7af94fa6fdda tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:24.282904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0c55669b-0211-4f1d-a93e-7af94fa6fdda tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047487 Aug 24 05:15:24.283454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 845/1581] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:24.534086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-11414592-85d4-48d1-9ad8-830dfcc2382f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:24.536142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-11414592-85d4-48d1-9ad8-830dfcc2382f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:24.544724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11414592-85d4-48d1-9ad8-830dfcc2382f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:24.545216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11414592-85d4-48d1-9ad8-830dfcc2382f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:24.545657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11414592-85d4-48d1-9ad8-830dfcc2382f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:24.546362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11414592-85d4-48d1-9ad8-830dfcc2382f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:24.547768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11414592-85d4-48d1-9ad8-830dfcc2382f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:24.548362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11414592-85d4-48d1-9ad8-830dfcc2382f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:24.582548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-11414592-85d4-48d1-9ad8-830dfcc2382f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053736 Aug 24 05:15:24.583505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 737/1582] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:24 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:24.628844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9e9206fe-54a7-4004-a5e0-06b637d62b34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:24.632199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9e9206fe-54a7-4004-a5e0-06b637d62b34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:24.641237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9206fe-54a7-4004-a5e0-06b637d62b34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:24.642559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9206fe-54a7-4004-a5e0-06b637d62b34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:24.642559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9206fe-54a7-4004-a5e0-06b637d62b34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:24.643166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9206fe-54a7-4004-a5e0-06b637d62b34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:24.643680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9206fe-54a7-4004-a5e0-06b637d62b34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:24.644157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e9206fe-54a7-4004-a5e0-06b637d62b34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:24.678182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9e9206fe-54a7-4004-a5e0-06b637d62b34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053258 Aug 24 05:15:24.678759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 846/1583] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:25.296204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2cf26a74-98db-4297-9971-fccacbf0383f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:25.298315 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2cf26a74-98db-4297-9971-fccacbf0383f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:25.305081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cf26a74-98db-4297-9971-fccacbf0383f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:25.305684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cf26a74-98db-4297-9971-fccacbf0383f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:25.306667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cf26a74-98db-4297-9971-fccacbf0383f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:25.307439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cf26a74-98db-4297-9971-fccacbf0383f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:25.307946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cf26a74-98db-4297-9971-fccacbf0383f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:25.308413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cf26a74-98db-4297-9971-fccacbf0383f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:25.338077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2cf26a74-98db-4297-9971-fccacbf0383f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045790 Aug 24 05:15:25.338631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 738/1584] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:25.598119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-26ec16c9-efaa-4a1a-aa29-dd0244c32bb6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:25.600205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-26ec16c9-efaa-4a1a-aa29-dd0244c32bb6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:25.606922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26ec16c9-efaa-4a1a-aa29-dd0244c32bb6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:25.607393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26ec16c9-efaa-4a1a-aa29-dd0244c32bb6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:25.607821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26ec16c9-efaa-4a1a-aa29-dd0244c32bb6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:25.608502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26ec16c9-efaa-4a1a-aa29-dd0244c32bb6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:25.608946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26ec16c9-efaa-4a1a-aa29-dd0244c32bb6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:25.609364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26ec16c9-efaa-4a1a-aa29-dd0244c32bb6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:25.639796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-26ec16c9-efaa-4a1a-aa29-dd0244c32bb6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Aug 24 05:15:25.640810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 847/1585] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:25.691778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d6f67927-365a-450e-90cb-13d94b6b4c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:25.693929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d6f67927-365a-450e-90cb-13d94b6b4c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:25.700940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f67927-365a-450e-90cb-13d94b6b4c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:25.701452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f67927-365a-450e-90cb-13d94b6b4c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:25.701892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f67927-365a-450e-90cb-13d94b6b4c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:25.702589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f67927-365a-450e-90cb-13d94b6b4c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:25.703075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f67927-365a-450e-90cb-13d94b6b4c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:25.703499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6f67927-365a-450e-90cb-13d94b6b4c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:25.735529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d6f67927-365a-450e-90cb-13d94b6b4c08 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047562 Aug 24 05:15:25.736561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 739/1586] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:26.350826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8beef2d9-7cf6-401e-ad50-bce1bec66439 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:26.353236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8beef2d9-7cf6-401e-ad50-bce1bec66439 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:26.359394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8beef2d9-7cf6-401e-ad50-bce1bec66439 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:26.359902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8beef2d9-7cf6-401e-ad50-bce1bec66439 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:26.360328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8beef2d9-7cf6-401e-ad50-bce1bec66439 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:26.361039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8beef2d9-7cf6-401e-ad50-bce1bec66439 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:26.361478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8beef2d9-7cf6-401e-ad50-bce1bec66439 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:26.361891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8beef2d9-7cf6-401e-ad50-bce1bec66439 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:26.393853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8beef2d9-7cf6-401e-ad50-bce1bec66439 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047210 Aug 24 05:15:26.394396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 848/1587] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:26 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:26.652784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-410f593f-d0f5-4982-a06e-5ffa74a83584 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:26.654908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-410f593f-d0f5-4982-a06e-5ffa74a83584 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:26.661284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-410f593f-d0f5-4982-a06e-5ffa74a83584 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:26.661812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-410f593f-d0f5-4982-a06e-5ffa74a83584 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:26.662298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-410f593f-d0f5-4982-a06e-5ffa74a83584 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:26.663184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-410f593f-d0f5-4982-a06e-5ffa74a83584 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:26.663727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-410f593f-d0f5-4982-a06e-5ffa74a83584 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:26.664199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-410f593f-d0f5-4982-a06e-5ffa74a83584 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:26.695523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-410f593f-d0f5-4982-a06e-5ffa74a83584 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Aug 24 05:15:26.696754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 740/1588] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:26.747899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-54535ad2-6bb3-447f-aa4a-af3a76a8bf4d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:26.750035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-54535ad2-6bb3-447f-aa4a-af3a76a8bf4d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:26.757028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54535ad2-6bb3-447f-aa4a-af3a76a8bf4d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:26.757502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54535ad2-6bb3-447f-aa4a-af3a76a8bf4d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:26.757937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54535ad2-6bb3-447f-aa4a-af3a76a8bf4d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:26.758636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54535ad2-6bb3-447f-aa4a-af3a76a8bf4d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:26.759646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54535ad2-6bb3-447f-aa4a-af3a76a8bf4d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:26.760064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54535ad2-6bb3-447f-aa4a-af3a76a8bf4d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:26.790573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-54535ad2-6bb3-447f-aa4a-af3a76a8bf4d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046441 Aug 24 05:15:26.791165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 849/1589] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:27.407028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-332546e5-d3f0-4e7d-9a1a-a1e26007c014 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:27.409039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-332546e5-d3f0-4e7d-9a1a-a1e26007c014 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:27.416100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-332546e5-d3f0-4e7d-9a1a-a1e26007c014 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:27.416577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-332546e5-d3f0-4e7d-9a1a-a1e26007c014 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:27.417011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-332546e5-d3f0-4e7d-9a1a-a1e26007c014 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:27.417707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-332546e5-d3f0-4e7d-9a1a-a1e26007c014 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:27.418158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-332546e5-d3f0-4e7d-9a1a-a1e26007c014 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:27.418582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-332546e5-d3f0-4e7d-9a1a-a1e26007c014 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:27.450418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-332546e5-d3f0-4e7d-9a1a-a1e26007c014 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047450 Aug 24 05:15:27.451011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 741/1590] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:27.708537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-26beda18-6d0a-4d84-9c84-55e5435fe77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:27.710697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-26beda18-6d0a-4d84-9c84-55e5435fe77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:27.719762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26beda18-6d0a-4d84-9c84-55e5435fe77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:27.720260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26beda18-6d0a-4d84-9c84-55e5435fe77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:27.720689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26beda18-6d0a-4d84-9c84-55e5435fe77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:27.721401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26beda18-6d0a-4d84-9c84-55e5435fe77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:27.721846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26beda18-6d0a-4d84-9c84-55e5435fe77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:27.722255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26beda18-6d0a-4d84-9c84-55e5435fe77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:27.753879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-26beda18-6d0a-4d84-9c84-55e5435fe77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049262 Aug 24 05:15:27.754518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 850/1591] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:27 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:27.803252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-67e0c2b7-7259-4b3d-a3cd-afe947bafc24 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:27.805426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-67e0c2b7-7259-4b3d-a3cd-afe947bafc24 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:27.812101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67e0c2b7-7259-4b3d-a3cd-afe947bafc24 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:27.812576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67e0c2b7-7259-4b3d-a3cd-afe947bafc24 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:27.813014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67e0c2b7-7259-4b3d-a3cd-afe947bafc24 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:27.813813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67e0c2b7-7259-4b3d-a3cd-afe947bafc24 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:27.814277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67e0c2b7-7259-4b3d-a3cd-afe947bafc24 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:27.814716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67e0c2b7-7259-4b3d-a3cd-afe947bafc24 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:27.844941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-67e0c2b7-7259-4b3d-a3cd-afe947bafc24 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045992 Aug 24 05:15:27.845500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 742/1592] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:27 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:28.463131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-43169665-c46d-4ec4-a33c-e4857b229fa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:28.465349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-43169665-c46d-4ec4-a33c-e4857b229fa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:28.471914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43169665-c46d-4ec4-a33c-e4857b229fa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:28.472394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43169665-c46d-4ec4-a33c-e4857b229fa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:28.472830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43169665-c46d-4ec4-a33c-e4857b229fa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:28.473528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43169665-c46d-4ec4-a33c-e4857b229fa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:28.473975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43169665-c46d-4ec4-a33c-e4857b229fa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:28.474391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43169665-c46d-4ec4-a33c-e4857b229fa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:28.505460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-43169665-c46d-4ec4-a33c-e4857b229fa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046506 Aug 24 05:15:28.506026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 851/1593] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:28.766455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e637adba-e7d5-4f8b-a4c7-d332b315179c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:28.768704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e637adba-e7d5-4f8b-a4c7-d332b315179c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:28.776003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e637adba-e7d5-4f8b-a4c7-d332b315179c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:28.776478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e637adba-e7d5-4f8b-a4c7-d332b315179c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:28.776912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e637adba-e7d5-4f8b-a4c7-d332b315179c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:28.777598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e637adba-e7d5-4f8b-a4c7-d332b315179c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:28.778041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e637adba-e7d5-4f8b-a4c7-d332b315179c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:28.778457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e637adba-e7d5-4f8b-a4c7-d332b315179c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:28.809503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e637adba-e7d5-4f8b-a4c7-d332b315179c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046910 Aug 24 05:15:28.810191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 743/1594] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:28.857795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9d92bda4-e61c-426e-b259-f3346b7f90f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:28.859950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9d92bda4-e61c-426e-b259-f3346b7f90f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:28.866029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d92bda4-e61c-426e-b259-f3346b7f90f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:28.866495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d92bda4-e61c-426e-b259-f3346b7f90f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:28.867021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d92bda4-e61c-426e-b259-f3346b7f90f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:28.867700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d92bda4-e61c-426e-b259-f3346b7f90f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:28.868681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d92bda4-e61c-426e-b259-f3346b7f90f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:28.869421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d92bda4-e61c-426e-b259-f3346b7f90f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:28.901177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9d92bda4-e61c-426e-b259-f3346b7f90f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047477 Aug 24 05:15:28.901732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 852/1595] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:29.518355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-51879a3a-a09d-4a70-8a5d-b786328f5aad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:29.520516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-51879a3a-a09d-4a70-8a5d-b786328f5aad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:29.527344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51879a3a-a09d-4a70-8a5d-b786328f5aad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:29.527830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51879a3a-a09d-4a70-8a5d-b786328f5aad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:29.528270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51879a3a-a09d-4a70-8a5d-b786328f5aad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:29.528968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51879a3a-a09d-4a70-8a5d-b786328f5aad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:29.529451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51879a3a-a09d-4a70-8a5d-b786328f5aad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:29.529875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51879a3a-a09d-4a70-8a5d-b786328f5aad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:29.562453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-51879a3a-a09d-4a70-8a5d-b786328f5aad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048027 Aug 24 05:15:29.563074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 744/1596] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:29.822609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1d3d6809-993a-4000-b817-e1ae8412e105 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:29.824725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1d3d6809-993a-4000-b817-e1ae8412e105 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:29.831219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3d6809-993a-4000-b817-e1ae8412e105 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:29.831697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3d6809-993a-4000-b817-e1ae8412e105 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:29.832133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3d6809-993a-4000-b817-e1ae8412e105 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:29.832820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3d6809-993a-4000-b817-e1ae8412e105 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:29.833279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3d6809-993a-4000-b817-e1ae8412e105 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:29.833732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3d6809-993a-4000-b817-e1ae8412e105 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:29.864767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1d3d6809-993a-4000-b817-e1ae8412e105 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046842 Aug 24 05:15:29.865461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 853/1597] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:29.913383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f9d43d3e-ecc2-42f9-973b-8323c7359c4e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:29.916437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f9d43d3e-ecc2-42f9-973b-8323c7359c4e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:29.925641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9d43d3e-ecc2-42f9-973b-8323c7359c4e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:29.926195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9d43d3e-ecc2-42f9-973b-8323c7359c4e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:29.926635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9d43d3e-ecc2-42f9-973b-8323c7359c4e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:29.927622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9d43d3e-ecc2-42f9-973b-8323c7359c4e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:29.930173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9d43d3e-ecc2-42f9-973b-8323c7359c4e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:29.930173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9d43d3e-ecc2-42f9-973b-8323c7359c4e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:29.963442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f9d43d3e-ecc2-42f9-973b-8323c7359c4e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054201 Aug 24 05:15:29.964007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 745/1598] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:30.576837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7994313f-5aed-47ca-bd4d-a23f40a753aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:30.579663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7994313f-5aed-47ca-bd4d-a23f40a753aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:30.587782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7994313f-5aed-47ca-bd4d-a23f40a753aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:30.588278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7994313f-5aed-47ca-bd4d-a23f40a753aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:30.588726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7994313f-5aed-47ca-bd4d-a23f40a753aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:30.589421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7994313f-5aed-47ca-bd4d-a23f40a753aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:30.589874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7994313f-5aed-47ca-bd4d-a23f40a753aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:30.590294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7994313f-5aed-47ca-bd4d-a23f40a753aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:30.624825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7994313f-5aed-47ca-bd4d-a23f40a753aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053734 Aug 24 05:15:30.625386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 854/1599] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:30.877567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4ea19375-98c7-45b2-ac47-1b033d1cd8dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:30.879646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4ea19375-98c7-45b2-ac47-1b033d1cd8dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:30.886198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ea19375-98c7-45b2-ac47-1b033d1cd8dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:30.886675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ea19375-98c7-45b2-ac47-1b033d1cd8dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:30.887204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ea19375-98c7-45b2-ac47-1b033d1cd8dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:30.887904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ea19375-98c7-45b2-ac47-1b033d1cd8dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:30.888354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ea19375-98c7-45b2-ac47-1b033d1cd8dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:30.888773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ea19375-98c7-45b2-ac47-1b033d1cd8dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:30.925352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4ea19375-98c7-45b2-ac47-1b033d1cd8dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051909 Aug 24 05:15:30.926085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 746/1600] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:30.976352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1d3ff656-a848-4500-accd-4682c719f9c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:30.979253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1d3ff656-a848-4500-accd-4682c719f9c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:30.985664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3ff656-a848-4500-accd-4682c719f9c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:30.986141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3ff656-a848-4500-accd-4682c719f9c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:30.986573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3ff656-a848-4500-accd-4682c719f9c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:30.987294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3ff656-a848-4500-accd-4682c719f9c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:30.987740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3ff656-a848-4500-accd-4682c719f9c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:30.988160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d3ff656-a848-4500-accd-4682c719f9c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:31.018358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1d3ff656-a848-4500-accd-4682c719f9c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045945 Aug 24 05:15:31.019037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 855/1601] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:31.637465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f95ac66a-390e-43e2-a6e3-e19225ac3e75 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:31.639709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f95ac66a-390e-43e2-a6e3-e19225ac3e75 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:31.646066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95ac66a-390e-43e2-a6e3-e19225ac3e75 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:31.646608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95ac66a-390e-43e2-a6e3-e19225ac3e75 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:31.647116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95ac66a-390e-43e2-a6e3-e19225ac3e75 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:31.647874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95ac66a-390e-43e2-a6e3-e19225ac3e75 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:31.648386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95ac66a-390e-43e2-a6e3-e19225ac3e75 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:31.648863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95ac66a-390e-43e2-a6e3-e19225ac3e75 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:31.680834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f95ac66a-390e-43e2-a6e3-e19225ac3e75 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047519 Aug 24 05:15:31.681469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 747/1602] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:31.938198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ebc59ff8-3fcf-416e-acb8-60609aec9ac5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:31.940370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ebc59ff8-3fcf-416e-acb8-60609aec9ac5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:31.947039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebc59ff8-3fcf-416e-acb8-60609aec9ac5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:31.947861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebc59ff8-3fcf-416e-acb8-60609aec9ac5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:31.948348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebc59ff8-3fcf-416e-acb8-60609aec9ac5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:31.949077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebc59ff8-3fcf-416e-acb8-60609aec9ac5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:31.949732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebc59ff8-3fcf-416e-acb8-60609aec9ac5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:31.949732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebc59ff8-3fcf-416e-acb8-60609aec9ac5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:31.981693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ebc59ff8-3fcf-416e-acb8-60609aec9ac5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047506 Aug 24 05:15:31.982373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 856/1603] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:32.031465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-21a24f71-937e-4d4b-9a26-f46b7327fde7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:32.033661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-21a24f71-937e-4d4b-9a26-f46b7327fde7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:32.040912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21a24f71-937e-4d4b-9a26-f46b7327fde7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:32.041590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21a24f71-937e-4d4b-9a26-f46b7327fde7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:32.042027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21a24f71-937e-4d4b-9a26-f46b7327fde7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:32.042748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21a24f71-937e-4d4b-9a26-f46b7327fde7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:32.043204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21a24f71-937e-4d4b-9a26-f46b7327fde7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:32.043630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21a24f71-937e-4d4b-9a26-f46b7327fde7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:32.073929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-21a24f71-937e-4d4b-9a26-f46b7327fde7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046669 Aug 24 05:15:32.074497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 748/1604] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:32.693609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0b0cab4e-fc1f-4cce-a2fd-d878219d4573 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:32.695672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0b0cab4e-fc1f-4cce-a2fd-d878219d4573 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:32.702806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b0cab4e-fc1f-4cce-a2fd-d878219d4573 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:32.703314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b0cab4e-fc1f-4cce-a2fd-d878219d4573 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:32.703748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b0cab4e-fc1f-4cce-a2fd-d878219d4573 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:32.704440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b0cab4e-fc1f-4cce-a2fd-d878219d4573 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:32.704888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b0cab4e-fc1f-4cce-a2fd-d878219d4573 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:32.705332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0b0cab4e-fc1f-4cce-a2fd-d878219d4573 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:32.737477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0b0cab4e-fc1f-4cce-a2fd-d878219d4573 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047863 Aug 24 05:15:32.738027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 857/1605] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:32.994097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3611ddbd-cdd5-4118-8705-03cc97228a20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:32.996272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3611ddbd-cdd5-4118-8705-03cc97228a20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:33.002347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3611ddbd-cdd5-4118-8705-03cc97228a20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:33.002861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3611ddbd-cdd5-4118-8705-03cc97228a20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:33.003304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3611ddbd-cdd5-4118-8705-03cc97228a20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:33.003994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3611ddbd-cdd5-4118-8705-03cc97228a20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:33.004448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3611ddbd-cdd5-4118-8705-03cc97228a20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:33.004871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3611ddbd-cdd5-4118-8705-03cc97228a20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:33.036825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3611ddbd-cdd5-4118-8705-03cc97228a20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046930 Aug 24 05:15:33.037475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 749/1606] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:33.085927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aae03e23-6dcd-4d9a-a88e-13d5c7ba5e6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:33.088195 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aae03e23-6dcd-4d9a-a88e-13d5c7ba5e6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:33.094197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aae03e23-6dcd-4d9a-a88e-13d5c7ba5e6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:33.094729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aae03e23-6dcd-4d9a-a88e-13d5c7ba5e6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:33.095182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aae03e23-6dcd-4d9a-a88e-13d5c7ba5e6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:33.095843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aae03e23-6dcd-4d9a-a88e-13d5c7ba5e6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:33.096275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aae03e23-6dcd-4d9a-a88e-13d5c7ba5e6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:33.096690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aae03e23-6dcd-4d9a-a88e-13d5c7ba5e6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:33.128110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aae03e23-6dcd-4d9a-a88e-13d5c7ba5e6b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046074 Aug 24 05:15:33.128670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 858/1607] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:33.749638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-471d4433-73d4-4098-8743-98eaf15b1046 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:33.751834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-471d4433-73d4-4098-8743-98eaf15b1046 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:33.759237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-471d4433-73d4-4098-8743-98eaf15b1046 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:33.759787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-471d4433-73d4-4098-8743-98eaf15b1046 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:33.760216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-471d4433-73d4-4098-8743-98eaf15b1046 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:33.760910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-471d4433-73d4-4098-8743-98eaf15b1046 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:33.761356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-471d4433-73d4-4098-8743-98eaf15b1046 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:33.761770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-471d4433-73d4-4098-8743-98eaf15b1046 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:33.791788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-471d4433-73d4-4098-8743-98eaf15b1046 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046062 Aug 24 05:15:33.792350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 750/1608] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:34.049542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9da72cea-4562-472e-9ee4-ea8712100614 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:34.051696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9da72cea-4562-472e-9ee4-ea8712100614 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:34.059111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9da72cea-4562-472e-9ee4-ea8712100614 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:34.059586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9da72cea-4562-472e-9ee4-ea8712100614 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:34.060017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9da72cea-4562-472e-9ee4-ea8712100614 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:34.060711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9da72cea-4562-472e-9ee4-ea8712100614 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:34.061157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9da72cea-4562-472e-9ee4-ea8712100614 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:34.061577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9da72cea-4562-472e-9ee4-ea8712100614 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:34.087844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:34.093300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9da72cea-4562-472e-9ee4-ea8712100614 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047909 Aug 24 05:15:34.093859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 859/1609] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:34.141453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fd9e7820-ee6a-4207-b395-09050a8fd4aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:34.143676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fd9e7820-ee6a-4207-b395-09050a8fd4aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:34.150455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd9e7820-ee6a-4207-b395-09050a8fd4aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:34.150971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd9e7820-ee6a-4207-b395-09050a8fd4aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:34.151405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd9e7820-ee6a-4207-b395-09050a8fd4aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:34.152097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd9e7820-ee6a-4207-b395-09050a8fd4aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:34.152545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd9e7820-ee6a-4207-b395-09050a8fd4aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:34.152960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd9e7820-ee6a-4207-b395-09050a8fd4aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:34.184319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fd9e7820-ee6a-4207-b395-09050a8fd4aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046851 Aug 24 05:15:34.184873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 751/1610] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:34 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:34.805428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-19796453-8ccd-4735-a700-9dd264357913 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:34.807612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-19796453-8ccd-4735-a700-9dd264357913 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:34.813647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19796453-8ccd-4735-a700-9dd264357913 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:34.814135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19796453-8ccd-4735-a700-9dd264357913 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:34.814567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19796453-8ccd-4735-a700-9dd264357913 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:34.815293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19796453-8ccd-4735-a700-9dd264357913 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:34.815740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19796453-8ccd-4735-a700-9dd264357913 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:34.816163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19796453-8ccd-4735-a700-9dd264357913 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:34.847149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-19796453-8ccd-4735-a700-9dd264357913 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046446 Aug 24 05:15:34.847839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 860/1611] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:35.106341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-331ccf1f-2e3b-4272-8e78-ea0f1e69692b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:35.108539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-331ccf1f-2e3b-4272-8e78-ea0f1e69692b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:35.111020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=88 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:35.116591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-331ccf1f-2e3b-4272-8e78-ea0f1e69692b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:35.117082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-331ccf1f-2e3b-4272-8e78-ea0f1e69692b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:35.117518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-331ccf1f-2e3b-4272-8e78-ea0f1e69692b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:35.118975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-331ccf1f-2e3b-4272-8e78-ea0f1e69692b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:35.119433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-331ccf1f-2e3b-4272-8e78-ea0f1e69692b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:35.119906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-331ccf1f-2e3b-4272-8e78-ea0f1e69692b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:35.137816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:35.151680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-331ccf1f-2e3b-4272-8e78-ea0f1e69692b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049971 Aug 24 05:15:35.152325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 752/1612] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:35 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:35.197474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2d94d887-b80b-48ee-86c2-dc6366860c8d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:35.199652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2d94d887-b80b-48ee-86c2-dc6366860c8d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:35.206138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d94d887-b80b-48ee-86c2-dc6366860c8d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:35.206614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d94d887-b80b-48ee-86c2-dc6366860c8d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:35.207084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d94d887-b80b-48ee-86c2-dc6366860c8d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:35.207775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d94d887-b80b-48ee-86c2-dc6366860c8d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:35.208227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d94d887-b80b-48ee-86c2-dc6366860c8d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:35.208701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d94d887-b80b-48ee-86c2-dc6366860c8d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:35.239056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2d94d887-b80b-48ee-86c2-dc6366860c8d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045929 Aug 24 05:15:35.239607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 861/1613] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:35.860845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bb169046-b916-40c9-add4-8a096680776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:35.862904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bb169046-b916-40c9-add4-8a096680776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:35.869391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb169046-b916-40c9-add4-8a096680776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:35.869875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb169046-b916-40c9-add4-8a096680776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:35.870311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb169046-b916-40c9-add4-8a096680776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:35.871035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb169046-b916-40c9-add4-8a096680776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:35.871486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb169046-b916-40c9-add4-8a096680776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:35.871918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb169046-b916-40c9-add4-8a096680776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:35.904196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bb169046-b916-40c9-add4-8a096680776e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047431 Aug 24 05:15:35.904751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 753/1614] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:36.251886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-82811c27-691e-4eee-b781-9561f4d5596f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:36.252489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fc87181e-356e-48cb-bbf3-85a676984b42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:36.254103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-82811c27-691e-4eee-b781-9561f4d5596f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:36.254584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fc87181e-356e-48cb-bbf3-85a676984b42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:36.261716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82811c27-691e-4eee-b781-9561f4d5596f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:36.261913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc87181e-356e-48cb-bbf3-85a676984b42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:36.262207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82811c27-691e-4eee-b781-9561f4d5596f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:36.262470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc87181e-356e-48cb-bbf3-85a676984b42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:36.262639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82811c27-691e-4eee-b781-9561f4d5596f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:36.262915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc87181e-356e-48cb-bbf3-85a676984b42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:36.263360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82811c27-691e-4eee-b781-9561f4d5596f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:36.263615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc87181e-356e-48cb-bbf3-85a676984b42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:36.263832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82811c27-691e-4eee-b781-9561f4d5596f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:36.264070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc87181e-356e-48cb-bbf3-85a676984b42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:36.264248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82811c27-691e-4eee-b781-9561f4d5596f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:36.264478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc87181e-356e-48cb-bbf3-85a676984b42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:36.295760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-82811c27-691e-4eee-b781-9561f4d5596f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047781 Aug 24 05:15:36.296059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fc87181e-356e-48cb-bbf3-85a676984b42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135827 Aug 24 05:15:36.296336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 754/1615] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:36.296620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 862/1616] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:36 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:36.919791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a78cf0c3-4ee9-42fe-b45d-f2e27ce9d458 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:36.922979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a78cf0c3-4ee9-42fe-b45d-f2e27ce9d458 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:36.932707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a78cf0c3-4ee9-42fe-b45d-f2e27ce9d458 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:36.933464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a78cf0c3-4ee9-42fe-b45d-f2e27ce9d458 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:36.934155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a78cf0c3-4ee9-42fe-b45d-f2e27ce9d458 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:36.935182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a78cf0c3-4ee9-42fe-b45d-f2e27ce9d458 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:36.935818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a78cf0c3-4ee9-42fe-b45d-f2e27ce9d458 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:36.936408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a78cf0c3-4ee9-42fe-b45d-f2e27ce9d458 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:36.969913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a78cf0c3-4ee9-42fe-b45d-f2e27ce9d458 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057082 Aug 24 05:15:36.970475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 755/1617] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:37.309077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-95168ec7-3606-4dad-8cb0-5e9483ec1caa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:37.309673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a0d99adc-a1c4-4381-8b27-ca58403cadb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:37.311332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a0d99adc-a1c4-4381-8b27-ca58403cadb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:37.311446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-95168ec7-3606-4dad-8cb0-5e9483ec1caa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:37.317438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0d99adc-a1c4-4381-8b27-ca58403cadb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:37.317754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95168ec7-3606-4dad-8cb0-5e9483ec1caa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:37.317922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0d99adc-a1c4-4381-8b27-ca58403cadb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:37.318230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95168ec7-3606-4dad-8cb0-5e9483ec1caa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:37.318365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0d99adc-a1c4-4381-8b27-ca58403cadb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:37.318662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95168ec7-3606-4dad-8cb0-5e9483ec1caa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:37.319097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0d99adc-a1c4-4381-8b27-ca58403cadb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:37.319373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95168ec7-3606-4dad-8cb0-5e9483ec1caa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:37.319555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0d99adc-a1c4-4381-8b27-ca58403cadb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:37.319817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95168ec7-3606-4dad-8cb0-5e9483ec1caa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:37.319980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0d99adc-a1c4-4381-8b27-ca58403cadb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:37.320233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95168ec7-3606-4dad-8cb0-5e9483ec1caa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:37.349896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a0d99adc-a1c4-4381-8b27-ca58403cadb4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045113 Aug 24 05:15:37.350473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 756/1618] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:37.350654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-95168ec7-3606-4dad-8cb0-5e9483ec1caa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045946 Aug 24 05:15:37.351070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 863/1619] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:37.982897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dc640b2f-f835-459d-97b5-565d6e4815df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:37.985058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dc640b2f-f835-459d-97b5-565d6e4815df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:37.991578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc640b2f-f835-459d-97b5-565d6e4815df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:37.992048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc640b2f-f835-459d-97b5-565d6e4815df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:37.992474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc640b2f-f835-459d-97b5-565d6e4815df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:37.993257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc640b2f-f835-459d-97b5-565d6e4815df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:37.993700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc640b2f-f835-459d-97b5-565d6e4815df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:37.994118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc640b2f-f835-459d-97b5-565d6e4815df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:38.023271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dc640b2f-f835-459d-97b5-565d6e4815df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044372 Aug 24 05:15:38.023821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 757/1620] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:38.362747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7544474f-2ed5-4743-97ff-bbc00104914a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:38.363633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b63e5c99-e59c-4816-8e6a-c5f7dbc38dd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:38.364796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7544474f-2ed5-4743-97ff-bbc00104914a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:38.365730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b63e5c99-e59c-4816-8e6a-c5f7dbc38dd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:38.371477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7544474f-2ed5-4743-97ff-bbc00104914a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:38.371978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7544474f-2ed5-4743-97ff-bbc00104914a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:38.372391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7544474f-2ed5-4743-97ff-bbc00104914a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:38.372668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b63e5c99-e59c-4816-8e6a-c5f7dbc38dd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:38.373080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7544474f-2ed5-4743-97ff-bbc00104914a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:38.373194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b63e5c99-e59c-4816-8e6a-c5f7dbc38dd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:38.373528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7544474f-2ed5-4743-97ff-bbc00104914a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:38.373641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b63e5c99-e59c-4816-8e6a-c5f7dbc38dd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:38.373947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7544474f-2ed5-4743-97ff-bbc00104914a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:38.374237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b63e5c99-e59c-4816-8e6a-c5f7dbc38dd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:38.374710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b63e5c99-e59c-4816-8e6a-c5f7dbc38dd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:38.375126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b63e5c99-e59c-4816-8e6a-c5f7dbc38dd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:38.406019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b63e5c99-e59c-4816-8e6a-c5f7dbc38dd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Aug 24 05:15:38.406589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 758/1621] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:38.410368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7544474f-2ed5-4743-97ff-bbc00104914a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051870 Aug 24 05:15:38.411368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 864/1622] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:39.042039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-36559c5f-1da4-4b01-af0b-190ea50b75d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:39.044125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-36559c5f-1da4-4b01-af0b-190ea50b75d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:39.050810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36559c5f-1da4-4b01-af0b-190ea50b75d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:39.051327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36559c5f-1da4-4b01-af0b-190ea50b75d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:39.051765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36559c5f-1da4-4b01-af0b-190ea50b75d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:39.052727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36559c5f-1da4-4b01-af0b-190ea50b75d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:39.053174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36559c5f-1da4-4b01-af0b-190ea50b75d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:39.053592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36559c5f-1da4-4b01-af0b-190ea50b75d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:39.083953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-36559c5f-1da4-4b01-af0b-190ea50b75d3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046533 Aug 24 05:15:39.084506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 759/1623] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:39.419360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-945919e1-ffe9-44f8-9d10-e0de3507ef3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:39.421498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-945919e1-ffe9-44f8-9d10-e0de3507ef3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:39.425288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7e2132bb-15a1-45e6-9132-2aafbfb6d98a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:39.427679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7e2132bb-15a1-45e6-9132-2aafbfb6d98a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:39.428309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-945919e1-ffe9-44f8-9d10-e0de3507ef3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:39.428785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-945919e1-ffe9-44f8-9d10-e0de3507ef3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:39.429227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-945919e1-ffe9-44f8-9d10-e0de3507ef3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:39.429943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-945919e1-ffe9-44f8-9d10-e0de3507ef3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:39.430395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-945919e1-ffe9-44f8-9d10-e0de3507ef3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:39.430859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-945919e1-ffe9-44f8-9d10-e0de3507ef3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:39.433797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2132bb-15a1-45e6-9132-2aafbfb6d98a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:39.434278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2132bb-15a1-45e6-9132-2aafbfb6d98a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:39.434737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2132bb-15a1-45e6-9132-2aafbfb6d98a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:39.435415 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2132bb-15a1-45e6-9132-2aafbfb6d98a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:39.435867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2132bb-15a1-45e6-9132-2aafbfb6d98a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:39.436267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e2132bb-15a1-45e6-9132-2aafbfb6d98a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:39.462253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-945919e1-ffe9-44f8-9d10-e0de3507ef3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046968 Aug 24 05:15:39.462966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 865/1624] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:39.469362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7e2132bb-15a1-45e6-9132-2aafbfb6d98a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049548 Aug 24 05:15:39.469911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 760/1625] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:40.097190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c7375dba-5186-4a1f-be27-85a3e796dd35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:40.099198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c7375dba-5186-4a1f-be27-85a3e796dd35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:40.101091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=84 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:40.107194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7375dba-5186-4a1f-be27-85a3e796dd35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:40.107662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7375dba-5186-4a1f-be27-85a3e796dd35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:40.108089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7375dba-5186-4a1f-be27-85a3e796dd35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:40.108768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7375dba-5186-4a1f-be27-85a3e796dd35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:40.109204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7375dba-5186-4a1f-be27-85a3e796dd35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:40.109620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c7375dba-5186-4a1f-be27-85a3e796dd35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:40.139006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c7375dba-5186-4a1f-be27-85a3e796dd35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045881 Aug 24 05:15:40.139545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 866/1626] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:40.474598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d6229078-cf37-42de-9962-84685a974d67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:40.476797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d6229078-cf37-42de-9962-84685a974d67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:40.483393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6229078-cf37-42de-9962-84685a974d67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:40.483886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6229078-cf37-42de-9962-84685a974d67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:40.484324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6229078-cf37-42de-9962-84685a974d67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:40.485022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6229078-cf37-42de-9962-84685a974d67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:40.485472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6229078-cf37-42de-9962-84685a974d67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:40.485896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d6229078-cf37-42de-9962-84685a974d67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:40.488646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0c160579-5508-4504-97bf-e6e184916104 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:40.490795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0c160579-5508-4504-97bf-e6e184916104 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:40.497688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c160579-5508-4504-97bf-e6e184916104 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:40.498178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c160579-5508-4504-97bf-e6e184916104 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:40.498617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c160579-5508-4504-97bf-e6e184916104 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:40.499349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c160579-5508-4504-97bf-e6e184916104 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:40.499799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c160579-5508-4504-97bf-e6e184916104 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:40.500213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c160579-5508-4504-97bf-e6e184916104 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:40.518171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d6229078-cf37-42de-9962-84685a974d67 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047188 Aug 24 05:15:40.522329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 761/1627] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:40.532303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0c160579-5508-4504-97bf-e6e184916104 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047567 Aug 24 05:15:40.532860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 867/1628] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:41.152360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-05a7cf09-840b-4cc6-a9e4-86b6fbb665ee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:41.154615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-05a7cf09-840b-4cc6-a9e4-86b6fbb665ee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:41.160813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05a7cf09-840b-4cc6-a9e4-86b6fbb665ee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:41.161290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05a7cf09-840b-4cc6-a9e4-86b6fbb665ee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:41.161721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05a7cf09-840b-4cc6-a9e4-86b6fbb665ee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:41.162410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05a7cf09-840b-4cc6-a9e4-86b6fbb665ee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:41.162904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05a7cf09-840b-4cc6-a9e4-86b6fbb665ee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:41.163324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05a7cf09-840b-4cc6-a9e4-86b6fbb665ee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:41.194499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-05a7cf09-840b-4cc6-a9e4-86b6fbb665ee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046171 Aug 24 05:15:41.195070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 762/1629] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:41.531184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cf008bbb-51ee-4e5c-8c4e-79707af8b561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:41.533483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cf008bbb-51ee-4e5c-8c4e-79707af8b561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:41.543364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf008bbb-51ee-4e5c-8c4e-79707af8b561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:41.544255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf008bbb-51ee-4e5c-8c4e-79707af8b561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:41.544830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf008bbb-51ee-4e5c-8c4e-79707af8b561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:41.545942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf008bbb-51ee-4e5c-8c4e-79707af8b561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:41.546779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf008bbb-51ee-4e5c-8c4e-79707af8b561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:41.547368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf008bbb-51ee-4e5c-8c4e-79707af8b561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:41.548258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1f83484d-4fe5-4fe8-8140-bc10126d76dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:41.550407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1f83484d-4fe5-4fe8-8140-bc10126d76dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:41.557873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f83484d-4fe5-4fe8-8140-bc10126d76dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:41.558358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f83484d-4fe5-4fe8-8140-bc10126d76dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:41.558829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f83484d-4fe5-4fe8-8140-bc10126d76dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:41.559536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f83484d-4fe5-4fe8-8140-bc10126d76dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:41.559985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f83484d-4fe5-4fe8-8140-bc10126d76dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:41.560409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f83484d-4fe5-4fe8-8140-bc10126d76dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:41.591505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1f83484d-4fe5-4fe8-8140-bc10126d76dc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049686 Aug 24 05:15:41.591997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 763/1630] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:41.593108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cf008bbb-51ee-4e5c-8c4e-79707af8b561 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066012 Aug 24 05:15:41.593745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 868/1631] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:41 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:42.207821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c3873c2d-3e20-4c4a-8688-d491f8fe1fea tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:42.210008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c3873c2d-3e20-4c4a-8688-d491f8fe1fea tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:42.216172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3873c2d-3e20-4c4a-8688-d491f8fe1fea tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:42.216653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3873c2d-3e20-4c4a-8688-d491f8fe1fea tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:42.217089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3873c2d-3e20-4c4a-8688-d491f8fe1fea tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:42.217780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3873c2d-3e20-4c4a-8688-d491f8fe1fea tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:42.218233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3873c2d-3e20-4c4a-8688-d491f8fe1fea tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:42.218656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3873c2d-3e20-4c4a-8688-d491f8fe1fea tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:42.249428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c3873c2d-3e20-4c4a-8688-d491f8fe1fea tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Aug 24 05:15:42.249987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 764/1632] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:42.604674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d88d2cc4-4495-46c3-9ca0-bb14beccc54b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:42.605416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d5144471-fe5e-408d-a775-40c6293ef62c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:42.606709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d88d2cc4-4495-46c3-9ca0-bb14beccc54b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:42.607346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d5144471-fe5e-408d-a775-40c6293ef62c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:42.613711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88d2cc4-4495-46c3-9ca0-bb14beccc54b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:42.613899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5144471-fe5e-408d-a775-40c6293ef62c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:42.614223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88d2cc4-4495-46c3-9ca0-bb14beccc54b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:42.614348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5144471-fe5e-408d-a775-40c6293ef62c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:42.614663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88d2cc4-4495-46c3-9ca0-bb14beccc54b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:42.614933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5144471-fe5e-408d-a775-40c6293ef62c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:42.615569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88d2cc4-4495-46c3-9ca0-bb14beccc54b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:42.615671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5144471-fe5e-408d-a775-40c6293ef62c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:42.616027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88d2cc4-4495-46c3-9ca0-bb14beccc54b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:42.616132 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5144471-fe5e-408d-a775-40c6293ef62c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:42.616448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d88d2cc4-4495-46c3-9ca0-bb14beccc54b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:42.616570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5144471-fe5e-408d-a775-40c6293ef62c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:42.647349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d88d2cc4-4495-46c3-9ca0-bb14beccc54b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047232 Aug 24 05:15:42.647607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d5144471-fe5e-408d-a775-40c6293ef62c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046956 Aug 24 05:15:42.647909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 869/1633] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:42.648294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 765/1634] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:43.261762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-71d7d6b7-0ee2-4c8d-a0e8-1b97e709ad86 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:43.263975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-71d7d6b7-0ee2-4c8d-a0e8-1b97e709ad86 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:43.269947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71d7d6b7-0ee2-4c8d-a0e8-1b97e709ad86 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:43.270422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71d7d6b7-0ee2-4c8d-a0e8-1b97e709ad86 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:43.270894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71d7d6b7-0ee2-4c8d-a0e8-1b97e709ad86 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:43.271576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71d7d6b7-0ee2-4c8d-a0e8-1b97e709ad86 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:43.272023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71d7d6b7-0ee2-4c8d-a0e8-1b97e709ad86 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:43.272448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71d7d6b7-0ee2-4c8d-a0e8-1b97e709ad86 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:43.311942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-71d7d6b7-0ee2-4c8d-a0e8-1b97e709ad86 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054579 Aug 24 05:15:43.312485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 870/1635] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:43.659664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-02332c0f-c05e-4015-9293-4f3253226bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:43.660213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-95ae9aa5-6a92-4655-93a4-a6f47ba3fb6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:43.661690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-95ae9aa5-6a92-4655-93a4-a6f47ba3fb6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:43.661819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-02332c0f-c05e-4015-9293-4f3253226bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:43.668330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95ae9aa5-6a92-4655-93a4-a6f47ba3fb6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:43.668562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02332c0f-c05e-4015-9293-4f3253226bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:43.668811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95ae9aa5-6a92-4655-93a4-a6f47ba3fb6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:43.668924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02332c0f-c05e-4015-9293-4f3253226bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:43.669243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95ae9aa5-6a92-4655-93a4-a6f47ba3fb6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:43.669349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02332c0f-c05e-4015-9293-4f3253226bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:43.669950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95ae9aa5-6a92-4655-93a4-a6f47ba3fb6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:43.670061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02332c0f-c05e-4015-9293-4f3253226bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:43.670392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95ae9aa5-6a92-4655-93a4-a6f47ba3fb6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:43.670515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02332c0f-c05e-4015-9293-4f3253226bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:43.670839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95ae9aa5-6a92-4655-93a4-a6f47ba3fb6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:43.670954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-02332c0f-c05e-4015-9293-4f3253226bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:43.703750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-95ae9aa5-6a92-4655-93a4-a6f47ba3fb6a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047954 Aug 24 05:15:43.704314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 871/1636] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:43.704805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-02332c0f-c05e-4015-9293-4f3253226bba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049042 Aug 24 05:15:43.705363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 766/1637] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:43 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:44.324607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4bf63f04-1d7e-431f-b086-af863e7650d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:44.326667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4bf63f04-1d7e-431f-b086-af863e7650d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:44.332691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf63f04-1d7e-431f-b086-af863e7650d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:44.333160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf63f04-1d7e-431f-b086-af863e7650d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:44.333581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf63f04-1d7e-431f-b086-af863e7650d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:44.334267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf63f04-1d7e-431f-b086-af863e7650d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:44.334723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf63f04-1d7e-431f-b086-af863e7650d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:44.335140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf63f04-1d7e-431f-b086-af863e7650d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:44.365679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4bf63f04-1d7e-431f-b086-af863e7650d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045285 Aug 24 05:15:44.366217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 872/1638] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:44.717462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-304df0e2-0b56-494f-be44-618d2d8c42ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:44.718460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d3c34500-7866-4680-8215-5d4ef9ec700f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:44.719593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-304df0e2-0b56-494f-be44-618d2d8c42ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:44.722438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d3c34500-7866-4680-8215-5d4ef9ec700f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:44.726814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-304df0e2-0b56-494f-be44-618d2d8c42ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:44.727295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-304df0e2-0b56-494f-be44-618d2d8c42ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:44.727728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-304df0e2-0b56-494f-be44-618d2d8c42ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:44.728517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-304df0e2-0b56-494f-be44-618d2d8c42ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:44.728964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-304df0e2-0b56-494f-be44-618d2d8c42ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:44.729386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-304df0e2-0b56-494f-be44-618d2d8c42ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:44.733398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3c34500-7866-4680-8215-5d4ef9ec700f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:44.734191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3c34500-7866-4680-8215-5d4ef9ec700f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:44.735006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3c34500-7866-4680-8215-5d4ef9ec700f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:44.736202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3c34500-7866-4680-8215-5d4ef9ec700f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:44.736939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3c34500-7866-4680-8215-5d4ef9ec700f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:44.737606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3c34500-7866-4680-8215-5d4ef9ec700f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:44.762335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-304df0e2-0b56-494f-be44-618d2d8c42ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048709 Aug 24 05:15:44.763246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 873/1639] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:44.784500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d3c34500-7866-4680-8215-5d4ef9ec700f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072213 Aug 24 05:15:44.785057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 767/1640] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:45.377794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8cb218bd-b69b-4253-8bd5-695084d5c9b8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:45.379878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8cb218bd-b69b-4253-8bd5-695084d5c9b8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:45.387025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cb218bd-b69b-4253-8bd5-695084d5c9b8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:45.387516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cb218bd-b69b-4253-8bd5-695084d5c9b8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:45.387955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cb218bd-b69b-4253-8bd5-695084d5c9b8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:45.388648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cb218bd-b69b-4253-8bd5-695084d5c9b8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:45.389097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cb218bd-b69b-4253-8bd5-695084d5c9b8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:45.389518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cb218bd-b69b-4253-8bd5-695084d5c9b8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:45.421095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8cb218bd-b69b-4253-8bd5-695084d5c9b8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047352 Aug 24 05:15:45.421740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 874/1641] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:45.778463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-51f969e0-0763-4150-91ce-a430de8a8f7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:45.780628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-51f969e0-0763-4150-91ce-a430de8a8f7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:45.787247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51f969e0-0763-4150-91ce-a430de8a8f7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:45.787723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51f969e0-0763-4150-91ce-a430de8a8f7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:45.788152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51f969e0-0763-4150-91ce-a430de8a8f7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:45.788835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51f969e0-0763-4150-91ce-a430de8a8f7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:45.789285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51f969e0-0763-4150-91ce-a430de8a8f7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:45.789703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51f969e0-0763-4150-91ce-a430de8a8f7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:45.796526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-88a7c0f4-f0c7-443d-888a-d2e6d976a1c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:45.798659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-88a7c0f4-f0c7-443d-888a-d2e6d976a1c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:45.805053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88a7c0f4-f0c7-443d-888a-d2e6d976a1c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:45.805546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88a7c0f4-f0c7-443d-888a-d2e6d976a1c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:45.806033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88a7c0f4-f0c7-443d-888a-d2e6d976a1c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:45.806786 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88a7c0f4-f0c7-443d-888a-d2e6d976a1c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:45.807247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88a7c0f4-f0c7-443d-888a-d2e6d976a1c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:45.807671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88a7c0f4-f0c7-443d-888a-d2e6d976a1c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:45.822576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-51f969e0-0763-4150-91ce-a430de8a8f7f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048977 Aug 24 05:15:45.823446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 768/1642] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:45 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:45.838618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-88a7c0f4-f0c7-443d-888a-d2e6d976a1c4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046065 Aug 24 05:15:45.839208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 875/1643] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:46.435344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-60e6c926-4f17-4e6a-bf19-a019fc8de9a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:46.437383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-60e6c926-4f17-4e6a-bf19-a019fc8de9a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:46.446532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60e6c926-4f17-4e6a-bf19-a019fc8de9a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:46.447067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60e6c926-4f17-4e6a-bf19-a019fc8de9a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:46.447712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60e6c926-4f17-4e6a-bf19-a019fc8de9a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:46.448491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60e6c926-4f17-4e6a-bf19-a019fc8de9a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:46.448955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60e6c926-4f17-4e6a-bf19-a019fc8de9a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:46.449344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60e6c926-4f17-4e6a-bf19-a019fc8de9a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:46.453181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:46.481704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-60e6c926-4f17-4e6a-bf19-a019fc8de9a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051248 Aug 24 05:15:46.482264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 769/1644] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:46.835010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d1a20ec1-e84d-4989-acea-e560db42e048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:46.837303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d1a20ec1-e84d-4989-acea-e560db42e048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:46.844030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a20ec1-e84d-4989-acea-e560db42e048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:46.844510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a20ec1-e84d-4989-acea-e560db42e048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:46.844941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a20ec1-e84d-4989-acea-e560db42e048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:46.845634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a20ec1-e84d-4989-acea-e560db42e048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:46.846080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a20ec1-e84d-4989-acea-e560db42e048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:46.846499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a20ec1-e84d-4989-acea-e560db42e048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:46.853281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1b22bfa2-e470-4e5a-afd4-93a89f6be20c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:46.855616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1b22bfa2-e470-4e5a-afd4-93a89f6be20c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:46.862083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b22bfa2-e470-4e5a-afd4-93a89f6be20c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:46.862562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b22bfa2-e470-4e5a-afd4-93a89f6be20c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:46.863031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b22bfa2-e470-4e5a-afd4-93a89f6be20c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:46.863719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b22bfa2-e470-4e5a-afd4-93a89f6be20c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:46.864167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b22bfa2-e470-4e5a-afd4-93a89f6be20c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:46.864584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b22bfa2-e470-4e5a-afd4-93a89f6be20c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:46.865813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:46.881369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d1a20ec1-e84d-4989-acea-e560db42e048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050333 Aug 24 05:15:46.881939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 876/1645] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:46.897927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1b22bfa2-e470-4e5a-afd4-93a89f6be20c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048974 Aug 24 05:15:46.898485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 770/1646] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:47.495821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-83e4dbd2-758a-4545-956c-2150cce9c8d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:47.498313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-83e4dbd2-758a-4545-956c-2150cce9c8d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:47.506161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83e4dbd2-758a-4545-956c-2150cce9c8d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:47.506702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83e4dbd2-758a-4545-956c-2150cce9c8d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:47.507261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83e4dbd2-758a-4545-956c-2150cce9c8d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:47.508054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83e4dbd2-758a-4545-956c-2150cce9c8d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:47.509244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83e4dbd2-758a-4545-956c-2150cce9c8d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:47.509876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83e4dbd2-758a-4545-956c-2150cce9c8d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:47.547038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-83e4dbd2-758a-4545-956c-2150cce9c8d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056718 Aug 24 05:15:47.547703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 877/1647] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:47.896587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7946f2f8-19aa-4d04-b730-ddaebbf779f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:47.898598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7946f2f8-19aa-4d04-b730-ddaebbf779f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:47.905541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7946f2f8-19aa-4d04-b730-ddaebbf779f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:47.906022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7946f2f8-19aa-4d04-b730-ddaebbf779f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:47.908566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7946f2f8-19aa-4d04-b730-ddaebbf779f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:47.909560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7946f2f8-19aa-4d04-b730-ddaebbf779f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:47.909687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2d8e8256-af74-48cf-9153-6c63a7600e7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:47.910121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7946f2f8-19aa-4d04-b730-ddaebbf779f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:47.910453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7946f2f8-19aa-4d04-b730-ddaebbf779f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:47.911798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2d8e8256-af74-48cf-9153-6c63a7600e7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:47.919192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d8e8256-af74-48cf-9153-6c63a7600e7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:47.919670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d8e8256-af74-48cf-9153-6c63a7600e7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:47.920134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d8e8256-af74-48cf-9153-6c63a7600e7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:47.920825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d8e8256-af74-48cf-9153-6c63a7600e7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:47.921269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d8e8256-af74-48cf-9153-6c63a7600e7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:47.921692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d8e8256-af74-48cf-9153-6c63a7600e7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:47.943008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7946f2f8-19aa-4d04-b730-ddaebbf779f6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052321 Aug 24 05:15:47.943570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 771/1648] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:47.953304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2d8e8256-af74-48cf-9153-6c63a7600e7d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047743 Aug 24 05:15:47.953864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 878/1649] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:48.561384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c5c3e931-2ddb-42c3-8ba4-665633edb709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:48.563450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c5c3e931-2ddb-42c3-8ba4-665633edb709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:48.569442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5c3e931-2ddb-42c3-8ba4-665633edb709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:48.569919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5c3e931-2ddb-42c3-8ba4-665633edb709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:48.570353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5c3e931-2ddb-42c3-8ba4-665633edb709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:48.571210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5c3e931-2ddb-42c3-8ba4-665633edb709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:48.571665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5c3e931-2ddb-42c3-8ba4-665633edb709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:48.572088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5c3e931-2ddb-42c3-8ba4-665633edb709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:48.604343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c5c3e931-2ddb-42c3-8ba4-665633edb709 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047230 Aug 24 05:15:48.604889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 772/1650] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:48.955882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2c01fad4-d5c9-4e8a-a052-dedaff2fb485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:48.958019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2c01fad4-d5c9-4e8a-a052-dedaff2fb485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:48.965268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c01fad4-d5c9-4e8a-a052-dedaff2fb485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:48.965783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c72d31ff-57d5-4acc-8e95-15fb646660f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:48.966189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c01fad4-d5c9-4e8a-a052-dedaff2fb485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:48.966323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c01fad4-d5c9-4e8a-a052-dedaff2fb485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:48.967039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c01fad4-d5c9-4e8a-a052-dedaff2fb485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:48.967481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c01fad4-d5c9-4e8a-a052-dedaff2fb485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:48.967968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c72d31ff-57d5-4acc-8e95-15fb646660f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:48.968083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c01fad4-d5c9-4e8a-a052-dedaff2fb485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:48.974307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c72d31ff-57d5-4acc-8e95-15fb646660f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:48.974816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c72d31ff-57d5-4acc-8e95-15fb646660f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:48.975256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c72d31ff-57d5-4acc-8e95-15fb646660f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:48.975944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c72d31ff-57d5-4acc-8e95-15fb646660f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:48.976396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c72d31ff-57d5-4acc-8e95-15fb646660f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:48.976819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c72d31ff-57d5-4acc-8e95-15fb646660f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:48.999067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2c01fad4-d5c9-4e8a-a052-dedaff2fb485 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047149 Aug 24 05:15:48.999620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 879/1651] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:49.007993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c72d31ff-57d5-4acc-8e95-15fb646660f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Aug 24 05:15:49.009307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 773/1652] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:49.616753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7450c577-9280-406d-a5ad-2097be704632 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:49.619150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7450c577-9280-406d-a5ad-2097be704632 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:49.625295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7450c577-9280-406d-a5ad-2097be704632 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:49.625766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7450c577-9280-406d-a5ad-2097be704632 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:49.626200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7450c577-9280-406d-a5ad-2097be704632 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:49.626927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7450c577-9280-406d-a5ad-2097be704632 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:49.627374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7450c577-9280-406d-a5ad-2097be704632 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:49.627791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7450c577-9280-406d-a5ad-2097be704632 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:49.658189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7450c577-9280-406d-a5ad-2097be704632 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045490 Aug 24 05:15:49.659071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 880/1653] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:50.011427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f22cb412-7d41-4da1-b4eb-f45794e33048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:50.013562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f22cb412-7d41-4da1-b4eb-f45794e33048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:50.020264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ccc2f900-d95c-4d16-b426-583de65a52e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:50.021470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f22cb412-7d41-4da1-b4eb-f45794e33048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:50.021958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f22cb412-7d41-4da1-b4eb-f45794e33048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:50.022446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ccc2f900-d95c-4d16-b426-583de65a52e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:50.022763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f22cb412-7d41-4da1-b4eb-f45794e33048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:50.023960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f22cb412-7d41-4da1-b4eb-f45794e33048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:50.024431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f22cb412-7d41-4da1-b4eb-f45794e33048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:50.025016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f22cb412-7d41-4da1-b4eb-f45794e33048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:50.028975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccc2f900-d95c-4d16-b426-583de65a52e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:50.030624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccc2f900-d95c-4d16-b426-583de65a52e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:50.030624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccc2f900-d95c-4d16-b426-583de65a52e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:50.030624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccc2f900-d95c-4d16-b426-583de65a52e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:50.031089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccc2f900-d95c-4d16-b426-583de65a52e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:50.031454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ccc2f900-d95c-4d16-b426-583de65a52e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:50.064098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f22cb412-7d41-4da1-b4eb-f45794e33048 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055461 Aug 24 05:15:50.064098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 774/1654] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:50.071556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ccc2f900-d95c-4d16-b426-583de65a52e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055109 Aug 24 05:15:50.072128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 881/1655] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:50.670280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5a57557c-6f0d-4f23-80f7-be2526d7e7f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:50.672337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5a57557c-6f0d-4f23-80f7-be2526d7e7f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:50.678517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a57557c-6f0d-4f23-80f7-be2526d7e7f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:50.679029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a57557c-6f0d-4f23-80f7-be2526d7e7f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:50.679464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a57557c-6f0d-4f23-80f7-be2526d7e7f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:50.680179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a57557c-6f0d-4f23-80f7-be2526d7e7f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:50.680679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a57557c-6f0d-4f23-80f7-be2526d7e7f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:50.681406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a57557c-6f0d-4f23-80f7-be2526d7e7f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:50.713188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5a57557c-6f0d-4f23-80f7-be2526d7e7f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046642 Aug 24 05:15:50.713797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 775/1656] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:51.076567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6cf18fd4-bf9d-4c95-b73e-34b315b550d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:51.078765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6cf18fd4-bf9d-4c95-b73e-34b315b550d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:51.084573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7a33ebef-dd8f-405d-9811-96086f50e0f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:51.085522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6cf18fd4-bf9d-4c95-b73e-34b315b550d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:51.086003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6cf18fd4-bf9d-4c95-b73e-34b315b550d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:51.086535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6cf18fd4-bf9d-4c95-b73e-34b315b550d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:51.086975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7a33ebef-dd8f-405d-9811-96086f50e0f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:51.087259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6cf18fd4-bf9d-4c95-b73e-34b315b550d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:51.087707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6cf18fd4-bf9d-4c95-b73e-34b315b550d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:51.088126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6cf18fd4-bf9d-4c95-b73e-34b315b550d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:51.093473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a33ebef-dd8f-405d-9811-96086f50e0f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:51.093950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a33ebef-dd8f-405d-9811-96086f50e0f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:51.094385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a33ebef-dd8f-405d-9811-96086f50e0f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:51.095096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a33ebef-dd8f-405d-9811-96086f50e0f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:51.095543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a33ebef-dd8f-405d-9811-96086f50e0f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:51.095987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a33ebef-dd8f-405d-9811-96086f50e0f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:51.118973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6cf18fd4-bf9d-4c95-b73e-34b315b550d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046342 Aug 24 05:15:51.119679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 882/1657] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:51.128020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7a33ebef-dd8f-405d-9811-96086f50e0f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047343 Aug 24 05:15:51.128577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 776/1658] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:51.725310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e7c3d660-43ae-4b58-a32d-397ea0be6419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:51.728144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e7c3d660-43ae-4b58-a32d-397ea0be6419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:51.734459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7c3d660-43ae-4b58-a32d-397ea0be6419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:51.735470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7c3d660-43ae-4b58-a32d-397ea0be6419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:51.735470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7c3d660-43ae-4b58-a32d-397ea0be6419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:51.736085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7c3d660-43ae-4b58-a32d-397ea0be6419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:51.736515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7c3d660-43ae-4b58-a32d-397ea0be6419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:51.736937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7c3d660-43ae-4b58-a32d-397ea0be6419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:51.767237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e7c3d660-43ae-4b58-a32d-397ea0be6419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045830 Aug 24 05:15:51.767781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 883/1659] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:52.131220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fb6645b7-338c-40d5-a1f3-2b33f1ff8c06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:52.133334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fb6645b7-338c-40d5-a1f3-2b33f1ff8c06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:52.139887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6645b7-338c-40d5-a1f3-2b33f1ff8c06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:52.140076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0575d935-0538-418c-8803-141d2ada9e27 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:52.140560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6645b7-338c-40d5-a1f3-2b33f1ff8c06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:52.140790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6645b7-338c-40d5-a1f3-2b33f1ff8c06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:52.141482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6645b7-338c-40d5-a1f3-2b33f1ff8c06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:52.141930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6645b7-338c-40d5-a1f3-2b33f1ff8c06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:52.142138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0575d935-0538-418c-8803-141d2ada9e27 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:52.142350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6645b7-338c-40d5-a1f3-2b33f1ff8c06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:52.148374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0575d935-0538-418c-8803-141d2ada9e27 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:52.149353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0575d935-0538-418c-8803-141d2ada9e27 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:52.150057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0575d935-0538-418c-8803-141d2ada9e27 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:52.150768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0575d935-0538-418c-8803-141d2ada9e27 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:52.151228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0575d935-0538-418c-8803-141d2ada9e27 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:52.151642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0575d935-0538-418c-8803-141d2ada9e27 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:52.172702 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fb6645b7-338c-40d5-a1f3-2b33f1ff8c06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Aug 24 05:15:52.173253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 777/1660] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:52.181901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0575d935-0538-418c-8803-141d2ada9e27 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045861 Aug 24 05:15:52.182446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 884/1661] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:52.779572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1e4ecf57-fed3-46d9-b320-6d4888c2aef6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:52.781644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1e4ecf57-fed3-46d9-b320-6d4888c2aef6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:52.787697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e4ecf57-fed3-46d9-b320-6d4888c2aef6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:52.788174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e4ecf57-fed3-46d9-b320-6d4888c2aef6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:52.788606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e4ecf57-fed3-46d9-b320-6d4888c2aef6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:52.789290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e4ecf57-fed3-46d9-b320-6d4888c2aef6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:52.789885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e4ecf57-fed3-46d9-b320-6d4888c2aef6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:52.790309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e4ecf57-fed3-46d9-b320-6d4888c2aef6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:52.819747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1e4ecf57-fed3-46d9-b320-6d4888c2aef6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044248 Aug 24 05:15:52.820288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 778/1662] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:53.185275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9f58021e-30a1-4ca1-a9f5-31eb203940c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:53.187466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9f58021e-30a1-4ca1-a9f5-31eb203940c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:53.193337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ecd2d622-9004-4cc5-8f6d-d0c430940d20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:53.194270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f58021e-30a1-4ca1-a9f5-31eb203940c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:53.194772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f58021e-30a1-4ca1-a9f5-31eb203940c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:53.195210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f58021e-30a1-4ca1-a9f5-31eb203940c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:53.195828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ecd2d622-9004-4cc5-8f6d-d0c430940d20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:53.196077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f58021e-30a1-4ca1-a9f5-31eb203940c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:53.196628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f58021e-30a1-4ca1-a9f5-31eb203940c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:53.197052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f58021e-30a1-4ca1-a9f5-31eb203940c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:53.202344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecd2d622-9004-4cc5-8f6d-d0c430940d20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:53.202856 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecd2d622-9004-4cc5-8f6d-d0c430940d20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:53.203294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecd2d622-9004-4cc5-8f6d-d0c430940d20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:53.203987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecd2d622-9004-4cc5-8f6d-d0c430940d20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:53.204440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecd2d622-9004-4cc5-8f6d-d0c430940d20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:53.204865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecd2d622-9004-4cc5-8f6d-d0c430940d20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:53.226729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9f58021e-30a1-4ca1-a9f5-31eb203940c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045365 Aug 24 05:15:53.227972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 885/1663] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:53.235195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ecd2d622-9004-4cc5-8f6d-d0c430940d20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 Aug 24 05:15:53.235740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 779/1664] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:53.832843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0d5d452a-c3e7-48eb-a64c-eb22bb9a6539 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:53.834941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0d5d452a-c3e7-48eb-a64c-eb22bb9a6539 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:53.841143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d5d452a-c3e7-48eb-a64c-eb22bb9a6539 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:53.841620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d5d452a-c3e7-48eb-a64c-eb22bb9a6539 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:53.842056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d5d452a-c3e7-48eb-a64c-eb22bb9a6539 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:53.842768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d5d452a-c3e7-48eb-a64c-eb22bb9a6539 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:53.843218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d5d452a-c3e7-48eb-a64c-eb22bb9a6539 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:53.843638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d5d452a-c3e7-48eb-a64c-eb22bb9a6539 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:53.873196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0d5d452a-c3e7-48eb-a64c-eb22bb9a6539 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Aug 24 05:15:53.873737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 886/1665] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:54.239405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ae47a7b2-cba0-45af-b894-347f7df4fa01 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:54.242451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ae47a7b2-cba0-45af-b894-347f7df4fa01 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:54.248217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b8345923-8388-4af7-ae0a-9d515fb2d3bd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:54.249951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae47a7b2-cba0-45af-b894-347f7df4fa01 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:54.250454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae47a7b2-cba0-45af-b894-347f7df4fa01 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:54.250785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b8345923-8388-4af7-ae0a-9d515fb2d3bd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:54.250954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae47a7b2-cba0-45af-b894-347f7df4fa01 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:54.251620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae47a7b2-cba0-45af-b894-347f7df4fa01 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:54.252065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae47a7b2-cba0-45af-b894-347f7df4fa01 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:54.252482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae47a7b2-cba0-45af-b894-347f7df4fa01 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:54.257436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8345923-8388-4af7-ae0a-9d515fb2d3bd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:54.257916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8345923-8388-4af7-ae0a-9d515fb2d3bd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:54.258508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8345923-8388-4af7-ae0a-9d515fb2d3bd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:54.259279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8345923-8388-4af7-ae0a-9d515fb2d3bd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:54.259717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8345923-8388-4af7-ae0a-9d515fb2d3bd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:54.260139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8345923-8388-4af7-ae0a-9d515fb2d3bd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:54.282563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ae47a7b2-cba0-45af-b894-347f7df4fa01 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 Aug 24 05:15:54.283168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 780/1666] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:54.291592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b8345923-8388-4af7-ae0a-9d515fb2d3bd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048523 Aug 24 05:15:54.292153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 887/1667] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:54.885565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f732646b-0e29-4168-a0f3-4b1b3bc853cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:54.887644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f732646b-0e29-4168-a0f3-4b1b3bc853cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:54.893578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f732646b-0e29-4168-a0f3-4b1b3bc853cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:54.894087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f732646b-0e29-4168-a0f3-4b1b3bc853cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:54.894558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f732646b-0e29-4168-a0f3-4b1b3bc853cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:54.895258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f732646b-0e29-4168-a0f3-4b1b3bc853cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:54.895708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f732646b-0e29-4168-a0f3-4b1b3bc853cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:54.896130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f732646b-0e29-4168-a0f3-4b1b3bc853cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:54.925822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f732646b-0e29-4168-a0f3-4b1b3bc853cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Aug 24 05:15:54.926369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 781/1668] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:55.294776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-55b9a32c-0b83-4ddb-9d85-fad5a13e8bfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:55.296948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-55b9a32c-0b83-4ddb-9d85-fad5a13e8bfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:55.304342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55b9a32c-0b83-4ddb-9d85-fad5a13e8bfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:55.304511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c1a2c1f3-cc9f-4f5d-b79a-da343ce87586 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:55.304972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55b9a32c-0b83-4ddb-9d85-fad5a13e8bfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:55.305429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55b9a32c-0b83-4ddb-9d85-fad5a13e8bfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:55.306388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55b9a32c-0b83-4ddb-9d85-fad5a13e8bfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:55.306507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c1a2c1f3-cc9f-4f5d-b79a-da343ce87586 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:55.306863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55b9a32c-0b83-4ddb-9d85-fad5a13e8bfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:55.307277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55b9a32c-0b83-4ddb-9d85-fad5a13e8bfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:55.312885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1a2c1f3-cc9f-4f5d-b79a-da343ce87586 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:55.313372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1a2c1f3-cc9f-4f5d-b79a-da343ce87586 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:55.313812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1a2c1f3-cc9f-4f5d-b79a-da343ce87586 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:55.314503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1a2c1f3-cc9f-4f5d-b79a-da343ce87586 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:55.314983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1a2c1f3-cc9f-4f5d-b79a-da343ce87586 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:55.315407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1a2c1f3-cc9f-4f5d-b79a-da343ce87586 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:55.339070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-55b9a32c-0b83-4ddb-9d85-fad5a13e8bfc tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048195 Aug 24 05:15:55.339622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 888/1669] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:55 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:55.346986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c1a2c1f3-cc9f-4f5d-b79a-da343ce87586 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046709 Aug 24 05:15:55.347527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 782/1670] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:55.937733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d92da495-b8fa-4d58-a311-16bba0c1e723 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:55.940136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d92da495-b8fa-4d58-a311-16bba0c1e723 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:55.946297 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d92da495-b8fa-4d58-a311-16bba0c1e723 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:55.946803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d92da495-b8fa-4d58-a311-16bba0c1e723 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:55.947232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d92da495-b8fa-4d58-a311-16bba0c1e723 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:55.947921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d92da495-b8fa-4d58-a311-16bba0c1e723 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:55.948360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d92da495-b8fa-4d58-a311-16bba0c1e723 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:55.948771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d92da495-b8fa-4d58-a311-16bba0c1e723 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:55.979640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d92da495-b8fa-4d58-a311-16bba0c1e723 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Aug 24 05:15:55.980181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 889/1671] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:56.351246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1b381aee-747b-4eb9-9292-7685b8022627 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:56.353981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1b381aee-747b-4eb9-9292-7685b8022627 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:56.359485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-29bd0f32-321a-4af2-bc52-4bac5cf6d742 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:56.360646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b381aee-747b-4eb9-9292-7685b8022627 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:56.361125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b381aee-747b-4eb9-9292-7685b8022627 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:56.361562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b381aee-747b-4eb9-9292-7685b8022627 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:56.361719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-29bd0f32-321a-4af2-bc52-4bac5cf6d742 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:56.362255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b381aee-747b-4eb9-9292-7685b8022627 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:56.362718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b381aee-747b-4eb9-9292-7685b8022627 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:56.363144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b381aee-747b-4eb9-9292-7685b8022627 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:56.368381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29bd0f32-321a-4af2-bc52-4bac5cf6d742 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:56.368853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29bd0f32-321a-4af2-bc52-4bac5cf6d742 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:56.369285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29bd0f32-321a-4af2-bc52-4bac5cf6d742 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:56.369968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29bd0f32-321a-4af2-bc52-4bac5cf6d742 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:56.370414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29bd0f32-321a-4af2-bc52-4bac5cf6d742 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:56.370870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29bd0f32-321a-4af2-bc52-4bac5cf6d742 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:56.392580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1b381aee-747b-4eb9-9292-7685b8022627 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045237 Aug 24 05:15:56.393139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 783/1672] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:56.401185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-29bd0f32-321a-4af2-bc52-4bac5cf6d742 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045555 Aug 24 05:15:56.401728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 890/1673] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:56.991952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-63794bfe-4223-457d-a023-db3dc5f0a47b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:56.994015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-63794bfe-4223-457d-a023-db3dc5f0a47b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:56.999972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63794bfe-4223-457d-a023-db3dc5f0a47b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:57.000460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63794bfe-4223-457d-a023-db3dc5f0a47b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:57.000906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63794bfe-4223-457d-a023-db3dc5f0a47b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:57.001583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63794bfe-4223-457d-a023-db3dc5f0a47b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:57.002031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63794bfe-4223-457d-a023-db3dc5f0a47b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:57.002448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-63794bfe-4223-457d-a023-db3dc5f0a47b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:57.032220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-63794bfe-4223-457d-a023-db3dc5f0a47b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Aug 24 05:15:57.032768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 784/1674] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:57.405121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4d6d1c4b-f2ff-4b4c-afad-ce8bc0ece6ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:57.407222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4d6d1c4b-f2ff-4b4c-afad-ce8bc0ece6ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:57.413314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0f183d3c-a1cc-4d89-a18e-a06abff459d4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:57.413762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d6d1c4b-f2ff-4b4c-afad-ce8bc0ece6ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:57.414126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d6d1c4b-f2ff-4b4c-afad-ce8bc0ece6ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:57.415090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d6d1c4b-f2ff-4b4c-afad-ce8bc0ece6ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:57.415775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d6d1c4b-f2ff-4b4c-afad-ce8bc0ece6ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:57.416210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0f183d3c-a1cc-4d89-a18e-a06abff459d4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:57.416329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d6d1c4b-f2ff-4b4c-afad-ce8bc0ece6ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:57.416631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d6d1c4b-f2ff-4b4c-afad-ce8bc0ece6ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:57.422568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f183d3c-a1cc-4d89-a18e-a06abff459d4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:57.423221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f183d3c-a1cc-4d89-a18e-a06abff459d4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:57.423660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f183d3c-a1cc-4d89-a18e-a06abff459d4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:57.424358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f183d3c-a1cc-4d89-a18e-a06abff459d4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:57.424813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f183d3c-a1cc-4d89-a18e-a06abff459d4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:57.425363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f183d3c-a1cc-4d89-a18e-a06abff459d4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:57.447019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4d6d1c4b-f2ff-4b4c-afad-ce8bc0ece6ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045866 Aug 24 05:15:57.447579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 891/1675] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:57.451220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:57.456620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0f183d3c-a1cc-4d89-a18e-a06abff459d4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047391 Aug 24 05:15:57.457169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 785/1676] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:58.044735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f28d9505-bed6-4a8a-9a11-79b097018135 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:58.046878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f28d9505-bed6-4a8a-9a11-79b097018135 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:58.053105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f28d9505-bed6-4a8a-9a11-79b097018135 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:58.053576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f28d9505-bed6-4a8a-9a11-79b097018135 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:58.054006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f28d9505-bed6-4a8a-9a11-79b097018135 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:58.054678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f28d9505-bed6-4a8a-9a11-79b097018135 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:58.055731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f28d9505-bed6-4a8a-9a11-79b097018135 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:58.056151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f28d9505-bed6-4a8a-9a11-79b097018135 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:58.085590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f28d9505-bed6-4a8a-9a11-79b097018135 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044865 Aug 24 05:15:58.086157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 892/1677] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:58.459448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-643605ed-516b-4833-9be0-8e3787581a69 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:58.461621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-643605ed-516b-4833-9be0-8e3787581a69 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:58.468942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643605ed-516b-4833-9be0-8e3787581a69 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:58.469336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-425ce04e-28a0-416f-8876-358e00175d12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:58.469766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643605ed-516b-4833-9be0-8e3787581a69 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:58.469878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643605ed-516b-4833-9be0-8e3787581a69 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:58.470672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643605ed-516b-4833-9be0-8e3787581a69 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:58.471114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643605ed-516b-4833-9be0-8e3787581a69 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:58.471467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-425ce04e-28a0-416f-8876-358e00175d12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:58.471571 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643605ed-516b-4833-9be0-8e3787581a69 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:58.477804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-425ce04e-28a0-416f-8876-358e00175d12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:58.478277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-425ce04e-28a0-416f-8876-358e00175d12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:58.478737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-425ce04e-28a0-416f-8876-358e00175d12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:58.479427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-425ce04e-28a0-416f-8876-358e00175d12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:58.479874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-425ce04e-28a0-416f-8876-358e00175d12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:58.480291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-425ce04e-28a0-416f-8876-358e00175d12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:58.484122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:15:58.501447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-643605ed-516b-4833-9be0-8e3787581a69 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Aug 24 05:15:58.501998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 786/1678] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:58.511283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-425ce04e-28a0-416f-8876-358e00175d12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046548 Aug 24 05:15:58.511833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 893/1679] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:15:59.097815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dd06ce8b-e6e3-48bf-8f53-ffe00b226a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:59.099970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dd06ce8b-e6e3-48bf-8f53-ffe00b226a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:59.106855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd06ce8b-e6e3-48bf-8f53-ffe00b226a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:59.107350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd06ce8b-e6e3-48bf-8f53-ffe00b226a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:59.107781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd06ce8b-e6e3-48bf-8f53-ffe00b226a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:59.108468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd06ce8b-e6e3-48bf-8f53-ffe00b226a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:59.108916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd06ce8b-e6e3-48bf-8f53-ffe00b226a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:59.109334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd06ce8b-e6e3-48bf-8f53-ffe00b226a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:59.139411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dd06ce8b-e6e3-48bf-8f53-ffe00b226a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Aug 24 05:15:59.139959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 787/1680] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:59.514280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e6ee2650-1d43-4ae9-9948-da3c9ba01c7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:59.516518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e6ee2650-1d43-4ae9-9948-da3c9ba01c7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:59.522776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4fbba19d-e074-4268-b35f-01732c3643f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:15:59.523215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ee2650-1d43-4ae9-9948-da3c9ba01c7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:59.523648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ee2650-1d43-4ae9-9948-da3c9ba01c7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:59.524064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ee2650-1d43-4ae9-9948-da3c9ba01c7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:59.524881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4fbba19d-e074-4268-b35f-01732c3643f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:15:59.524989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ee2650-1d43-4ae9-9948-da3c9ba01c7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:59.525561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ee2650-1d43-4ae9-9948-da3c9ba01c7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:59.526060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ee2650-1d43-4ae9-9948-da3c9ba01c7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:59.531229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fbba19d-e074-4268-b35f-01732c3643f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:59.531710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fbba19d-e074-4268-b35f-01732c3643f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:59.532147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fbba19d-e074-4268-b35f-01732c3643f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:59.532829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fbba19d-e074-4268-b35f-01732c3643f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:15:59.533274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fbba19d-e074-4268-b35f-01732c3643f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:15:59.533694 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fbba19d-e074-4268-b35f-01732c3643f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:15:59.557361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e6ee2650-1d43-4ae9-9948-da3c9ba01c7d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047022 Aug 24 05:15:59.557914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 894/1681] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:59 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:15:59.564476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4fbba19d-e074-4268-b35f-01732c3643f5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045798 Aug 24 05:15:59.565011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 788/1682] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:15:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:00.152670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9f59adf0-bdda-4ba8-82bd-7c9b796a3c32 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:00.154727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9f59adf0-bdda-4ba8-82bd-7c9b796a3c32 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:00.160614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f59adf0-bdda-4ba8-82bd-7c9b796a3c32 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:00.161079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f59adf0-bdda-4ba8-82bd-7c9b796a3c32 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:00.161508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f59adf0-bdda-4ba8-82bd-7c9b796a3c32 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:00.162177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f59adf0-bdda-4ba8-82bd-7c9b796a3c32 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:00.162617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f59adf0-bdda-4ba8-82bd-7c9b796a3c32 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:00.163056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f59adf0-bdda-4ba8-82bd-7c9b796a3c32 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:00.192244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9f59adf0-bdda-4ba8-82bd-7c9b796a3c32 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044171 Aug 24 05:16:00.192807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 895/1683] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:00.569494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e0fb440e-8a03-4db0-8f83-c0167f438053 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:00.572453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e0fb440e-8a03-4db0-8f83-c0167f438053 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:00.577103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-39307292-e1ca-411f-b9ef-4b9bde7bc772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:00.579130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0fb440e-8a03-4db0-8f83-c0167f438053 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:00.579280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-39307292-e1ca-411f-b9ef-4b9bde7bc772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:00.579420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0fb440e-8a03-4db0-8f83-c0167f438053 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:00.579852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0fb440e-8a03-4db0-8f83-c0167f438053 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:00.580538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0fb440e-8a03-4db0-8f83-c0167f438053 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:00.580982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0fb440e-8a03-4db0-8f83-c0167f438053 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:00.581401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0fb440e-8a03-4db0-8f83-c0167f438053 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:00.585286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39307292-e1ca-411f-b9ef-4b9bde7bc772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:00.585755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39307292-e1ca-411f-b9ef-4b9bde7bc772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:00.586240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39307292-e1ca-411f-b9ef-4b9bde7bc772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:00.587469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39307292-e1ca-411f-b9ef-4b9bde7bc772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:00.587909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39307292-e1ca-411f-b9ef-4b9bde7bc772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:00.588328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-39307292-e1ca-411f-b9ef-4b9bde7bc772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:00.612043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e0fb440e-8a03-4db0-8f83-c0167f438053 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046438 Aug 24 05:16:00.612590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 789/1684] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:00.618389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-39307292-e1ca-411f-b9ef-4b9bde7bc772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045000 Aug 24 05:16:00.618961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 896/1685] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:01.139309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:16:01.139516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:16:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:16:01.204675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b5a09a7f-7ab7-43c8-8408-963de81c884e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:01.206828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b5a09a7f-7ab7-43c8-8408-963de81c884e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:01.213294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5a09a7f-7ab7-43c8-8408-963de81c884e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:01.213773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5a09a7f-7ab7-43c8-8408-963de81c884e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:01.214206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5a09a7f-7ab7-43c8-8408-963de81c884e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:01.214936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5a09a7f-7ab7-43c8-8408-963de81c884e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:01.215387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5a09a7f-7ab7-43c8-8408-963de81c884e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:01.215805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5a09a7f-7ab7-43c8-8408-963de81c884e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:01.245929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b5a09a7f-7ab7-43c8-8408-963de81c884e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Aug 24 05:16:01.246405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 790/1686] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:01.623748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f5b88a30-2bd2-464b-b611-042a15fdc0a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:01.625772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f5b88a30-2bd2-464b-b611-042a15fdc0a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:01.629359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-62c3e84b-f356-4322-82da-bc8da72573f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:01.631556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-62c3e84b-f356-4322-82da-bc8da72573f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:01.632183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b88a30-2bd2-464b-b611-042a15fdc0a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:01.632659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b88a30-2bd2-464b-b611-042a15fdc0a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:01.633085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b88a30-2bd2-464b-b611-042a15fdc0a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:01.633766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b88a30-2bd2-464b-b611-042a15fdc0a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:01.634201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b88a30-2bd2-464b-b611-042a15fdc0a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:01.634611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b88a30-2bd2-464b-b611-042a15fdc0a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:01.639220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62c3e84b-f356-4322-82da-bc8da72573f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:01.639220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62c3e84b-f356-4322-82da-bc8da72573f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:01.639220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62c3e84b-f356-4322-82da-bc8da72573f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:01.639546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62c3e84b-f356-4322-82da-bc8da72573f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:01.639998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62c3e84b-f356-4322-82da-bc8da72573f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:01.640424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62c3e84b-f356-4322-82da-bc8da72573f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:01.664030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f5b88a30-2bd2-464b-b611-042a15fdc0a6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Aug 24 05:16:01.665361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 897/1687] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:01.671151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-62c3e84b-f356-4322-82da-bc8da72573f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045614 Aug 24 05:16:01.671698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 791/1688] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:02.259802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-969ea7d0-ea37-47fc-9c73-ade945735e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:02.261996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-969ea7d0-ea37-47fc-9c73-ade945735e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:02.268332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-969ea7d0-ea37-47fc-9c73-ade945735e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:02.268806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-969ea7d0-ea37-47fc-9c73-ade945735e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:02.269234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-969ea7d0-ea37-47fc-9c73-ade945735e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:02.269922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-969ea7d0-ea37-47fc-9c73-ade945735e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:02.270372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-969ea7d0-ea37-47fc-9c73-ade945735e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:02.270827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-969ea7d0-ea37-47fc-9c73-ade945735e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:02.302908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-969ea7d0-ea37-47fc-9c73-ade945735e42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048247 Aug 24 05:16:02.303381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 898/1689] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:02.677811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8779597d-13cf-4bcd-89e4-121b198d56e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:02.680603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8779597d-13cf-4bcd-89e4-121b198d56e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:02.684037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2a7a9c15-5d98-4a6a-9d7b-feaf0f266d16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:02.686173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2a7a9c15-5d98-4a6a-9d7b-feaf0f266d16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:02.687239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8779597d-13cf-4bcd-89e4-121b198d56e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:02.687716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8779597d-13cf-4bcd-89e4-121b198d56e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:02.688150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8779597d-13cf-4bcd-89e4-121b198d56e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:02.688869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8779597d-13cf-4bcd-89e4-121b198d56e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:02.689307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8779597d-13cf-4bcd-89e4-121b198d56e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:02.689719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8779597d-13cf-4bcd-89e4-121b198d56e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:02.692463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a7a9c15-5d98-4a6a-9d7b-feaf0f266d16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:02.692940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a7a9c15-5d98-4a6a-9d7b-feaf0f266d16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:02.693370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a7a9c15-5d98-4a6a-9d7b-feaf0f266d16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:02.694058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a7a9c15-5d98-4a6a-9d7b-feaf0f266d16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:02.694510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a7a9c15-5d98-4a6a-9d7b-feaf0f266d16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:02.694955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a7a9c15-5d98-4a6a-9d7b-feaf0f266d16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:02.720112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8779597d-13cf-4bcd-89e4-121b198d56e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046643 Aug 24 05:16:02.720673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 792/1690] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:02.725501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2a7a9c15-5d98-4a6a-9d7b-feaf0f266d16 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045998 Aug 24 05:16:02.726089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 899/1691] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:03.315812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0499e03d-e684-488e-a4c6-8861b6a0c33a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:03.318001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0499e03d-e684-488e-a4c6-8861b6a0c33a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:03.324191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0499e03d-e684-488e-a4c6-8861b6a0c33a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:03.324672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0499e03d-e684-488e-a4c6-8861b6a0c33a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:03.325105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0499e03d-e684-488e-a4c6-8861b6a0c33a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:03.325791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0499e03d-e684-488e-a4c6-8861b6a0c33a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:03.326244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0499e03d-e684-488e-a4c6-8861b6a0c33a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:03.326669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0499e03d-e684-488e-a4c6-8861b6a0c33a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:03.357126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0499e03d-e684-488e-a4c6-8861b6a0c33a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Aug 24 05:16:03.358019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 793/1692] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:03 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:03.642975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:16:03.643168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:16:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:16:03.732109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-934028af-965d-49a2-977c-0c3c8f65c7d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:03.735009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-934028af-965d-49a2-977c-0c3c8f65c7d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:03.738588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0a97a48a-301b-4e1c-b311-03712e1af12c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:03.740771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0a97a48a-301b-4e1c-b311-03712e1af12c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:03.741446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-934028af-965d-49a2-977c-0c3c8f65c7d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:03.741917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-934028af-965d-49a2-977c-0c3c8f65c7d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:03.742394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-934028af-965d-49a2-977c-0c3c8f65c7d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:03.743355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-934028af-965d-49a2-977c-0c3c8f65c7d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:03.743798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-934028af-965d-49a2-977c-0c3c8f65c7d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:03.744205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-934028af-965d-49a2-977c-0c3c8f65c7d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:03.747170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a97a48a-301b-4e1c-b311-03712e1af12c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:03.747655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a97a48a-301b-4e1c-b311-03712e1af12c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:03.748117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a97a48a-301b-4e1c-b311-03712e1af12c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:03.748809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a97a48a-301b-4e1c-b311-03712e1af12c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:03.749483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a97a48a-301b-4e1c-b311-03712e1af12c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:03.749907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a97a48a-301b-4e1c-b311-03712e1af12c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:03.776335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-934028af-965d-49a2-977c-0c3c8f65c7d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048452 Aug 24 05:16:03.776895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 900/1693] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:03 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:03.783360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0a97a48a-301b-4e1c-b311-03712e1af12c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048698 Aug 24 05:16:03.784069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 794/1694] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:04.370204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-95f750a2-e714-46e9-ac81-638334bab724 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:04.372389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-95f750a2-e714-46e9-ac81-638334bab724 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:04.378399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95f750a2-e714-46e9-ac81-638334bab724 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:04.378911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95f750a2-e714-46e9-ac81-638334bab724 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:04.379348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95f750a2-e714-46e9-ac81-638334bab724 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:04.380031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95f750a2-e714-46e9-ac81-638334bab724 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:04.380480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95f750a2-e714-46e9-ac81-638334bab724 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:04.380900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95f750a2-e714-46e9-ac81-638334bab724 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:04.409864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-95f750a2-e714-46e9-ac81-638334bab724 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044235 Aug 24 05:16:04.410328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 901/1695] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:04.788889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b40971aa-50fc-4b42-aec4-05bffd90b98e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:04.791993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b40971aa-50fc-4b42-aec4-05bffd90b98e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:04.795648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4bf72eac-1ea5-4e3a-bd8f-3192b324f38d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:04.797745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4bf72eac-1ea5-4e3a-bd8f-3192b324f38d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:04.798556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40971aa-50fc-4b42-aec4-05bffd90b98e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:04.799433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40971aa-50fc-4b42-aec4-05bffd90b98e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:04.799659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40971aa-50fc-4b42-aec4-05bffd90b98e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:04.800368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40971aa-50fc-4b42-aec4-05bffd90b98e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:04.800825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40971aa-50fc-4b42-aec4-05bffd90b98e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:04.801256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40971aa-50fc-4b42-aec4-05bffd90b98e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:04.805645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf72eac-1ea5-4e3a-bd8f-3192b324f38d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:04.806243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf72eac-1ea5-4e3a-bd8f-3192b324f38d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:04.806666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf72eac-1ea5-4e3a-bd8f-3192b324f38d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:04.807387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf72eac-1ea5-4e3a-bd8f-3192b324f38d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:04.807838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf72eac-1ea5-4e3a-bd8f-3192b324f38d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:04.808263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bf72eac-1ea5-4e3a-bd8f-3192b324f38d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:04.832209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b40971aa-50fc-4b42-aec4-05bffd90b98e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047296 Aug 24 05:16:04.832766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 795/1696] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:04.839421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4bf72eac-1ea5-4e3a-bd8f-3192b324f38d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047628 Aug 24 05:16:04.839976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 902/1697] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:05.422629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d3f9e652-3ba7-4272-9fae-f850d4b7ac83 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:05.424764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d3f9e652-3ba7-4272-9fae-f850d4b7ac83 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:05.426625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=88 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:05.432222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3f9e652-3ba7-4272-9fae-f850d4b7ac83 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:05.432704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3f9e652-3ba7-4272-9fae-f850d4b7ac83 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:05.433143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3f9e652-3ba7-4272-9fae-f850d4b7ac83 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:05.433835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3f9e652-3ba7-4272-9fae-f850d4b7ac83 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:05.434289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3f9e652-3ba7-4272-9fae-f850d4b7ac83 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:05.434732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3f9e652-3ba7-4272-9fae-f850d4b7ac83 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:05.464516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d3f9e652-3ba7-4272-9fae-f850d4b7ac83 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045879 Aug 24 05:16:05.465059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 796/1698] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:05.846328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bc3db612-37de-4ddc-bedc-beadb96c368b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:05.847448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bc3db612-37de-4ddc-bedc-beadb96c368b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:05.851515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-56934238-fbc8-4ba4-84ad-cb8db0d444ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:05.853766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-56934238-fbc8-4ba4-84ad-cb8db0d444ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:05.854035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc3db612-37de-4ddc-bedc-beadb96c368b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:05.854497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc3db612-37de-4ddc-bedc-beadb96c368b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:05.854957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc3db612-37de-4ddc-bedc-beadb96c368b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:05.855654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc3db612-37de-4ddc-bedc-beadb96c368b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:05.856098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc3db612-37de-4ddc-bedc-beadb96c368b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:05.856518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc3db612-37de-4ddc-bedc-beadb96c368b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:05.860092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56934238-fbc8-4ba4-84ad-cb8db0d444ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:05.860568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56934238-fbc8-4ba4-84ad-cb8db0d444ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:05.861001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56934238-fbc8-4ba4-84ad-cb8db0d444ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:05.861691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56934238-fbc8-4ba4-84ad-cb8db0d444ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:05.862136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56934238-fbc8-4ba4-84ad-cb8db0d444ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:05.862558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56934238-fbc8-4ba4-84ad-cb8db0d444ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:05.887239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bc3db612-37de-4ddc-bedc-beadb96c368b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046067 Aug 24 05:16:05.887803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 903/1699] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:05.892018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-56934238-fbc8-4ba4-84ad-cb8db0d444ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Aug 24 05:16:05.892575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 797/1700] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:06.477170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8722cd72-f72f-4ed3-9e76-451710dd99d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:06.479369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8722cd72-f72f-4ed3-9e76-451710dd99d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:06.485352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8722cd72-f72f-4ed3-9e76-451710dd99d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:06.485829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8722cd72-f72f-4ed3-9e76-451710dd99d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:06.486259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8722cd72-f72f-4ed3-9e76-451710dd99d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:06.486980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8722cd72-f72f-4ed3-9e76-451710dd99d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:06.487428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8722cd72-f72f-4ed3-9e76-451710dd99d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:06.487848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8722cd72-f72f-4ed3-9e76-451710dd99d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:06.518470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8722cd72-f72f-4ed3-9e76-451710dd99d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045403 Aug 24 05:16:06.518959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 904/1701] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:06.900086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c589f186-dc4b-4bce-9d1f-d9acebbdfd14 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:06.902110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c589f186-dc4b-4bce-9d1f-d9acebbdfd14 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:06.904188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e8b8ebc7-8d98-4ca0-b9e8-8de85152f297 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:06.906461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e8b8ebc7-8d98-4ca0-b9e8-8de85152f297 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:06.908770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c589f186-dc4b-4bce-9d1f-d9acebbdfd14 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:06.909244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c589f186-dc4b-4bce-9d1f-d9acebbdfd14 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:06.909672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c589f186-dc4b-4bce-9d1f-d9acebbdfd14 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:06.910354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c589f186-dc4b-4bce-9d1f-d9acebbdfd14 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:06.910819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c589f186-dc4b-4bce-9d1f-d9acebbdfd14 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:06.911233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c589f186-dc4b-4bce-9d1f-d9acebbdfd14 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:06.912684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b8ebc7-8d98-4ca0-b9e8-8de85152f297 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:06.913154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b8ebc7-8d98-4ca0-b9e8-8de85152f297 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:06.913672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b8ebc7-8d98-4ca0-b9e8-8de85152f297 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:06.914413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b8ebc7-8d98-4ca0-b9e8-8de85152f297 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:06.915034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b8ebc7-8d98-4ca0-b9e8-8de85152f297 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:06.915455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8b8ebc7-8d98-4ca0-b9e8-8de85152f297 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:06.941668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c589f186-dc4b-4bce-9d1f-d9acebbdfd14 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045884 Aug 24 05:16:06.942402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 798/1702] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:06.946550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e8b8ebc7-8d98-4ca0-b9e8-8de85152f297 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046379 Aug 24 05:16:06.947232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 905/1703] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:07.530930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-41eeb2b3-42b5-4c7d-b55d-633cc408a3e0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:07.533082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-41eeb2b3-42b5-4c7d-b55d-633cc408a3e0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:07.539715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41eeb2b3-42b5-4c7d-b55d-633cc408a3e0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:07.540200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41eeb2b3-42b5-4c7d-b55d-633cc408a3e0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:07.540639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41eeb2b3-42b5-4c7d-b55d-633cc408a3e0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:07.541323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41eeb2b3-42b5-4c7d-b55d-633cc408a3e0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:07.541776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41eeb2b3-42b5-4c7d-b55d-633cc408a3e0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:07.542200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-41eeb2b3-42b5-4c7d-b55d-633cc408a3e0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:07.572708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-41eeb2b3-42b5-4c7d-b55d-633cc408a3e0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045803 Aug 24 05:16:07.573177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 799/1704] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:07.953593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-531db831-e198-49dc-abdc-e56acd197f9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:07.955756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-531db831-e198-49dc-abdc-e56acd197f9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:07.958574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-69fa3305-c8d2-4012-9a5c-98823f6dda8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:07.960885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-69fa3305-c8d2-4012-9a5c-98823f6dda8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:07.963371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-531db831-e198-49dc-abdc-e56acd197f9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:07.963977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-531db831-e198-49dc-abdc-e56acd197f9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:07.964514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-531db831-e198-49dc-abdc-e56acd197f9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:07.965429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-531db831-e198-49dc-abdc-e56acd197f9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:07.965987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-531db831-e198-49dc-abdc-e56acd197f9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:07.966528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-531db831-e198-49dc-abdc-e56acd197f9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:07.967658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fa3305-c8d2-4012-9a5c-98823f6dda8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:07.968133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fa3305-c8d2-4012-9a5c-98823f6dda8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:07.968567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fa3305-c8d2-4012-9a5c-98823f6dda8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:07.969283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fa3305-c8d2-4012-9a5c-98823f6dda8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:07.969766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fa3305-c8d2-4012-9a5c-98823f6dda8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:07.970186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69fa3305-c8d2-4012-9a5c-98823f6dda8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:07.998490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-531db831-e198-49dc-abdc-e56acd197f9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048852 Aug 24 05:16:07.999086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 906/1705] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:07.999566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-69fa3305-c8d2-4012-9a5c-98823f6dda8a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044873 Aug 24 05:16:08.000117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 800/1706] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:08.584795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6f535bc5-c91e-42b7-b138-181daefe5069 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:08.587015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6f535bc5-c91e-42b7-b138-181daefe5069 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:08.593079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f535bc5-c91e-42b7-b138-181daefe5069 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:08.593555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f535bc5-c91e-42b7-b138-181daefe5069 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:08.593988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f535bc5-c91e-42b7-b138-181daefe5069 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:08.594670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f535bc5-c91e-42b7-b138-181daefe5069 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:08.595143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f535bc5-c91e-42b7-b138-181daefe5069 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:08.595564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f535bc5-c91e-42b7-b138-181daefe5069 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:08.625477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6f535bc5-c91e-42b7-b138-181daefe5069 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Aug 24 05:16:08.625949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 907/1707] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:08.692810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:16:08.693010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:16:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:16:09.011308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-69c1b6a5-fc93-4fdd-8458-19ccecc02b0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:09.012154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b041ea27-b0d4-4eb1-a5f7-07839ee02246 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:09.013410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b041ea27-b0d4-4eb1-a5f7-07839ee02246 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:09.013594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-69c1b6a5-fc93-4fdd-8458-19ccecc02b0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:09.020142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69c1b6a5-fc93-4fdd-8458-19ccecc02b0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:09.020402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041ea27-b0d4-4eb1-a5f7-07839ee02246 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:09.020625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69c1b6a5-fc93-4fdd-8458-19ccecc02b0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:09.020822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041ea27-b0d4-4eb1-a5f7-07839ee02246 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:09.021065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69c1b6a5-fc93-4fdd-8458-19ccecc02b0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:09.021256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041ea27-b0d4-4eb1-a5f7-07839ee02246 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:09.021767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69c1b6a5-fc93-4fdd-8458-19ccecc02b0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:09.021948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041ea27-b0d4-4eb1-a5f7-07839ee02246 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:09.022218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69c1b6a5-fc93-4fdd-8458-19ccecc02b0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:09.022407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041ea27-b0d4-4eb1-a5f7-07839ee02246 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:09.022643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69c1b6a5-fc93-4fdd-8458-19ccecc02b0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:09.022866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041ea27-b0d4-4eb1-a5f7-07839ee02246 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:09.054010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-69c1b6a5-fc93-4fdd-8458-19ccecc02b0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046772 Aug 24 05:16:09.054276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b041ea27-b0d4-4eb1-a5f7-07839ee02246 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046767 Aug 24 05:16:09.054577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 801/1708] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:09.054770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 908/1709] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:09.637816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0c3e9ef4-b979-4726-9ed4-60ef6b9cc2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:09.640002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0c3e9ef4-b979-4726-9ed4-60ef6b9cc2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:09.646125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c3e9ef4-b979-4726-9ed4-60ef6b9cc2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:09.646586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c3e9ef4-b979-4726-9ed4-60ef6b9cc2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:09.647062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c3e9ef4-b979-4726-9ed4-60ef6b9cc2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:09.647749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c3e9ef4-b979-4726-9ed4-60ef6b9cc2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:09.648201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c3e9ef4-b979-4726-9ed4-60ef6b9cc2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:09.648919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0c3e9ef4-b979-4726-9ed4-60ef6b9cc2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:09.666080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:09.680790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0c3e9ef4-b979-4726-9ed4-60ef6b9cc2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046182 Aug 24 05:16:09.681339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 802/1710] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:10.066880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a7b184f3-6b57-445f-8fdc-a918d512c601 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:10.068208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0a065e7e-6fc0-49ae-9f35-30314bb6c80d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:10.068874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a7b184f3-6b57-445f-8fdc-a918d512c601 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:10.071613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0a065e7e-6fc0-49ae-9f35-30314bb6c80d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:10.075640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7b184f3-6b57-445f-8fdc-a918d512c601 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:10.076504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7b184f3-6b57-445f-8fdc-a918d512c601 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:10.077293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7b184f3-6b57-445f-8fdc-a918d512c601 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:10.078032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7b184f3-6b57-445f-8fdc-a918d512c601 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:10.078511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7b184f3-6b57-445f-8fdc-a918d512c601 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:10.078941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7b184f3-6b57-445f-8fdc-a918d512c601 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:10.079386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a065e7e-6fc0-49ae-9f35-30314bb6c80d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:10.080088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a065e7e-6fc0-49ae-9f35-30314bb6c80d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:10.080763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a065e7e-6fc0-49ae-9f35-30314bb6c80d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:10.081626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a065e7e-6fc0-49ae-9f35-30314bb6c80d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:10.082263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a065e7e-6fc0-49ae-9f35-30314bb6c80d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:10.082841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a065e7e-6fc0-49ae-9f35-30314bb6c80d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:10.110848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:10.112830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a7b184f3-6b57-445f-8fdc-a918d512c601 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049876 Aug 24 05:16:10.113333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 803/1711] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:10.116038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0a065e7e-6fc0-49ae-9f35-30314bb6c80d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053418 Aug 24 05:16:10.116578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 909/1712] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:10.696789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4cb05eec-50de-4b49-a933-24a24a1c0dbc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:10.700302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4cb05eec-50de-4b49-a933-24a24a1c0dbc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:10.706567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cb05eec-50de-4b49-a933-24a24a1c0dbc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:10.707085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cb05eec-50de-4b49-a933-24a24a1c0dbc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:10.707523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cb05eec-50de-4b49-a933-24a24a1c0dbc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:10.708217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cb05eec-50de-4b49-a933-24a24a1c0dbc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:10.708667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cb05eec-50de-4b49-a933-24a24a1c0dbc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:10.709091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cb05eec-50de-4b49-a933-24a24a1c0dbc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:10.738864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4cb05eec-50de-4b49-a933-24a24a1c0dbc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049555 Aug 24 05:16:10.739422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 804/1713] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:11.125395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3ce02456-c0a5-4767-ab44-5ab341691f77 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:11.127534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3ce02456-c0a5-4767-ab44-5ab341691f77 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:11.128508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f615012f-bc9e-4dc9-aef6-36d82c1fef64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:11.130029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=88 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:11.130595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f615012f-bc9e-4dc9-aef6-36d82c1fef64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:11.135583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ce02456-c0a5-4767-ab44-5ab341691f77 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:11.136056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ce02456-c0a5-4767-ab44-5ab341691f77 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:11.136481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ce02456-c0a5-4767-ab44-5ab341691f77 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:11.137171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ce02456-c0a5-4767-ab44-5ab341691f77 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:11.137615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ce02456-c0a5-4767-ab44-5ab341691f77 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:11.137719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f615012f-bc9e-4dc9-aef6-36d82c1fef64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:11.138029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ce02456-c0a5-4767-ab44-5ab341691f77 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:11.138129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f615012f-bc9e-4dc9-aef6-36d82c1fef64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:11.138558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f615012f-bc9e-4dc9-aef6-36d82c1fef64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:11.139284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f615012f-bc9e-4dc9-aef6-36d82c1fef64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:11.139733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f615012f-bc9e-4dc9-aef6-36d82c1fef64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:11.140153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f615012f-bc9e-4dc9-aef6-36d82c1fef64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:11.168329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3ce02456-c0a5-4767-ab44-5ab341691f77 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046755 Aug 24 05:16:11.168800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 910/1714] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:11.170492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f615012f-bc9e-4dc9-aef6-36d82c1fef64 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045998 Aug 24 05:16:11.171074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 805/1715] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:11.751683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ecfd49a7-401b-45aa-a3a2-2f926c509c67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:11.753863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ecfd49a7-401b-45aa-a3a2-2f926c509c67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:11.760480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecfd49a7-401b-45aa-a3a2-2f926c509c67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:11.760955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecfd49a7-401b-45aa-a3a2-2f926c509c67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:11.761382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecfd49a7-401b-45aa-a3a2-2f926c509c67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:11.762072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecfd49a7-401b-45aa-a3a2-2f926c509c67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:11.762516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecfd49a7-401b-45aa-a3a2-2f926c509c67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:11.762972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecfd49a7-401b-45aa-a3a2-2f926c509c67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:11.793352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ecfd49a7-401b-45aa-a3a2-2f926c509c67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045630 Aug 24 05:16:11.793892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 911/1716] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:12.181524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c7cf145d-00aa-451e-8bcc-ea9c491c3086 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:12.183191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d13d045d-71db-4e5f-86da-5c453c63f9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:12.183633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c7cf145d-00aa-451e-8bcc-ea9c491c3086 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:12.185346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d13d045d-71db-4e5f-86da-5c453c63f9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:12.190080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7cf145d-00aa-451e-8bcc-ea9c491c3086 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:12.190554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7cf145d-00aa-451e-8bcc-ea9c491c3086 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:12.191014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7cf145d-00aa-451e-8bcc-ea9c491c3086 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:12.191700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7cf145d-00aa-451e-8bcc-ea9c491c3086 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:12.191956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d13d045d-71db-4e5f-86da-5c453c63f9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:12.192146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7cf145d-00aa-451e-8bcc-ea9c491c3086 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:12.192431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d13d045d-71db-4e5f-86da-5c453c63f9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:12.192566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7cf145d-00aa-451e-8bcc-ea9c491c3086 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:12.192860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d13d045d-71db-4e5f-86da-5c453c63f9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:12.193545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d13d045d-71db-4e5f-86da-5c453c63f9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:12.193986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d13d045d-71db-4e5f-86da-5c453c63f9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:12.194392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d13d045d-71db-4e5f-86da-5c453c63f9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:12.223215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c7cf145d-00aa-451e-8bcc-ea9c491c3086 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046478 Aug 24 05:16:12.223774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 806/1717] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:12.225100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d13d045d-71db-4e5f-86da-5c453c63f9be tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046380 Aug 24 05:16:12.225640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 912/1718] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:12.806044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-461241d5-b374-4f30-a76b-1199cacd12d8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:12.808225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-461241d5-b374-4f30-a76b-1199cacd12d8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:12.814164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-461241d5-b374-4f30-a76b-1199cacd12d8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:12.814638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-461241d5-b374-4f30-a76b-1199cacd12d8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:12.815105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-461241d5-b374-4f30-a76b-1199cacd12d8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:12.815794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-461241d5-b374-4f30-a76b-1199cacd12d8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:12.816242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-461241d5-b374-4f30-a76b-1199cacd12d8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:12.816662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-461241d5-b374-4f30-a76b-1199cacd12d8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:12.845750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-461241d5-b374-4f30-a76b-1199cacd12d8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044049 Aug 24 05:16:12.846287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 807/1719] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:13.235121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a2069861-a034-46d8-a79b-b3c397e2ff20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:13.236851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-08badf25-1ec1-4cbd-91e3-b712fce4c662 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:13.237359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a2069861-a034-46d8-a79b-b3c397e2ff20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:13.238977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-08badf25-1ec1-4cbd-91e3-b712fce4c662 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:13.244424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2069861-a034-46d8-a79b-b3c397e2ff20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:13.244898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2069861-a034-46d8-a79b-b3c397e2ff20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:13.245230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08badf25-1ec1-4cbd-91e3-b712fce4c662 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:13.245359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2069861-a034-46d8-a79b-b3c397e2ff20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:13.245705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08badf25-1ec1-4cbd-91e3-b712fce4c662 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:13.246018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2069861-a034-46d8-a79b-b3c397e2ff20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:13.246123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08badf25-1ec1-4cbd-91e3-b712fce4c662 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:13.246456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2069861-a034-46d8-a79b-b3c397e2ff20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:13.246840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08badf25-1ec1-4cbd-91e3-b712fce4c662 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:13.246952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2069861-a034-46d8-a79b-b3c397e2ff20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:13.247287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08badf25-1ec1-4cbd-91e3-b712fce4c662 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:13.247706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-08badf25-1ec1-4cbd-91e3-b712fce4c662 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:13.276899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a2069861-a034-46d8-a79b-b3c397e2ff20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045770 Aug 24 05:16:13.277361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 913/1720] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:13.277600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-08badf25-1ec1-4cbd-91e3-b712fce4c662 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Aug 24 05:16:13.278145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 808/1721] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:13.857977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d7ed2d91-c061-4e49-93dd-9d78a93addf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:13.860233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d7ed2d91-c061-4e49-93dd-9d78a93addf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:13.866212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ed2d91-c061-4e49-93dd-9d78a93addf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:13.866708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ed2d91-c061-4e49-93dd-9d78a93addf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:13.867702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ed2d91-c061-4e49-93dd-9d78a93addf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:13.868545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ed2d91-c061-4e49-93dd-9d78a93addf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:13.868992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ed2d91-c061-4e49-93dd-9d78a93addf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:13.869410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7ed2d91-c061-4e49-93dd-9d78a93addf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:13.898827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d7ed2d91-c061-4e49-93dd-9d78a93addf2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044780 Aug 24 05:16:13.899375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 914/1722] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:14.289903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-487d0ce1-7f69-44d0-9dc2-d0995b6a7777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:14.290483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-02691853-3b8c-444f-9713-b07744080aab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:14.292066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-487d0ce1-7f69-44d0-9dc2-d0995b6a7777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:14.292202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-02691853-3b8c-444f-9713-b07744080aab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:14.298495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02691853-3b8c-444f-9713-b07744080aab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:14.298661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-487d0ce1-7f69-44d0-9dc2-d0995b6a7777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:14.299000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02691853-3b8c-444f-9713-b07744080aab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:14.299126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-487d0ce1-7f69-44d0-9dc2-d0995b6a7777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:14.299424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02691853-3b8c-444f-9713-b07744080aab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:14.299541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-487d0ce1-7f69-44d0-9dc2-d0995b6a7777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:14.300104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02691853-3b8c-444f-9713-b07744080aab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:14.300207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-487d0ce1-7f69-44d0-9dc2-d0995b6a7777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:14.300544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02691853-3b8c-444f-9713-b07744080aab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:14.300659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-487d0ce1-7f69-44d0-9dc2-d0995b6a7777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:14.300954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02691853-3b8c-444f-9713-b07744080aab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:14.301055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-487d0ce1-7f69-44d0-9dc2-d0995b6a7777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:14.330229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-02691853-3b8c-444f-9713-b07744080aab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 Aug 24 05:16:14.330771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-487d0ce1-7f69-44d0-9dc2-d0995b6a7777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045540 Aug 24 05:16:14.330991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 915/1723] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:14 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:14.331330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 809/1724] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:14.911082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3846428f-8fe4-4738-b4fe-716bc1cda6ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:14.913198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3846428f-8fe4-4738-b4fe-716bc1cda6ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:14.919360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3846428f-8fe4-4738-b4fe-716bc1cda6ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:14.919836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3846428f-8fe4-4738-b4fe-716bc1cda6ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:14.920267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3846428f-8fe4-4738-b4fe-716bc1cda6ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:14.920945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3846428f-8fe4-4738-b4fe-716bc1cda6ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:14.921389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3846428f-8fe4-4738-b4fe-716bc1cda6ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:14.921809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3846428f-8fe4-4738-b4fe-716bc1cda6ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:14.951286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3846428f-8fe4-4738-b4fe-716bc1cda6ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Aug 24 05:16:14.951822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 916/1725] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:15.342935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-eed2fb89-7944-412b-ab0e-6457f931b772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:15.343639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-99fcd195-0c84-45d1-b119-c7a50efb9eaa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:15.345001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-99fcd195-0c84-45d1-b119-c7a50efb9eaa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:15.345165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-eed2fb89-7944-412b-ab0e-6457f931b772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:15.351395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed2fb89-7944-412b-ab0e-6457f931b772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:15.351879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed2fb89-7944-412b-ab0e-6457f931b772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:15.352311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed2fb89-7944-412b-ab0e-6457f931b772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:15.352497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99fcd195-0c84-45d1-b119-c7a50efb9eaa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:15.352987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99fcd195-0c84-45d1-b119-c7a50efb9eaa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:15.353099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed2fb89-7944-412b-ab0e-6457f931b772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:15.353433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed2fb89-7944-412b-ab0e-6457f931b772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:15.353547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99fcd195-0c84-45d1-b119-c7a50efb9eaa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:15.353853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed2fb89-7944-412b-ab0e-6457f931b772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:15.354123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99fcd195-0c84-45d1-b119-c7a50efb9eaa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:15.354597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99fcd195-0c84-45d1-b119-c7a50efb9eaa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:15.355040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99fcd195-0c84-45d1-b119-c7a50efb9eaa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:15.385659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-eed2fb89-7944-412b-ab0e-6457f931b772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046702 Aug 24 05:16:15.386226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 917/1726] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:15.386517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-99fcd195-0c84-45d1-b119-c7a50efb9eaa tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047587 Aug 24 05:16:15.387095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 810/1727] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:15.964225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-88cf4c89-6003-4353-870e-69f58a7a8ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:15.966350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-88cf4c89-6003-4353-870e-69f58a7a8ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:15.972421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88cf4c89-6003-4353-870e-69f58a7a8ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:15.972900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88cf4c89-6003-4353-870e-69f58a7a8ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:15.973331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88cf4c89-6003-4353-870e-69f58a7a8ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:15.974011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88cf4c89-6003-4353-870e-69f58a7a8ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:15.974458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88cf4c89-6003-4353-870e-69f58a7a8ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:15.974910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88cf4c89-6003-4353-870e-69f58a7a8ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:16.004525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-88cf4c89-6003-4353-870e-69f58a7a8ba2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Aug 24 05:16:16.005001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 918/1728] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:16.397433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d01e0710-5c16-4138-95ee-8187d267dcf4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:16.397976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4d2eb5d0-c431-409a-8128-030b7a4ea9db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:16.399661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4d2eb5d0-c431-409a-8128-030b7a4ea9db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:16.403533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d01e0710-5c16-4138-95ee-8187d267dcf4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:16.406095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2eb5d0-c431-409a-8128-030b7a4ea9db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:16.406625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2eb5d0-c431-409a-8128-030b7a4ea9db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:16.407056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2eb5d0-c431-409a-8128-030b7a4ea9db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:16.407858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2eb5d0-c431-409a-8128-030b7a4ea9db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:16.408310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2eb5d0-c431-409a-8128-030b7a4ea9db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:16.408730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2eb5d0-c431-409a-8128-030b7a4ea9db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:16.411900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d01e0710-5c16-4138-95ee-8187d267dcf4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:16.412393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d01e0710-5c16-4138-95ee-8187d267dcf4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:16.412840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d01e0710-5c16-4138-95ee-8187d267dcf4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:16.413690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d01e0710-5c16-4138-95ee-8187d267dcf4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:16.414651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d01e0710-5c16-4138-95ee-8187d267dcf4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:16.415112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d01e0710-5c16-4138-95ee-8187d267dcf4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:16.440839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4d2eb5d0-c431-409a-8128-030b7a4ea9db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047150 Aug 24 05:16:16.445283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 919/1729] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:16.446150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d01e0710-5c16-4138-95ee-8187d267dcf4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052745 Aug 24 05:16:16.446725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 811/1730] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:16 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:17.017012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f3523e88-004c-4db8-a566-101d3623edef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:17.019083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f3523e88-004c-4db8-a566-101d3623edef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:17.025841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3523e88-004c-4db8-a566-101d3623edef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:17.026319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3523e88-004c-4db8-a566-101d3623edef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:17.026781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3523e88-004c-4db8-a566-101d3623edef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:17.027464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3523e88-004c-4db8-a566-101d3623edef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:17.027914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3523e88-004c-4db8-a566-101d3623edef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:17.028336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3523e88-004c-4db8-a566-101d3623edef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:17.057652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f3523e88-004c-4db8-a566-101d3623edef tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Aug 24 05:16:17.058198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 920/1731] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:17.452910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f420d328-159a-4197-a4c5-b31c3d9827b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:17.455053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f420d328-159a-4197-a4c5-b31c3d9827b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:17.459013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-37c8bb31-facb-4777-9189-0d8eb96d869f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:17.461348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-37c8bb31-facb-4777-9189-0d8eb96d869f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:17.461837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f420d328-159a-4197-a4c5-b31c3d9827b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:17.462319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f420d328-159a-4197-a4c5-b31c3d9827b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:17.462782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f420d328-159a-4197-a4c5-b31c3d9827b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:17.463474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f420d328-159a-4197-a4c5-b31c3d9827b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:17.463916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f420d328-159a-4197-a4c5-b31c3d9827b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:17.464333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f420d328-159a-4197-a4c5-b31c3d9827b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:17.468161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37c8bb31-facb-4777-9189-0d8eb96d869f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:17.468629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37c8bb31-facb-4777-9189-0d8eb96d869f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:17.469056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37c8bb31-facb-4777-9189-0d8eb96d869f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:17.469732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37c8bb31-facb-4777-9189-0d8eb96d869f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:17.470175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37c8bb31-facb-4777-9189-0d8eb96d869f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:17.470590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37c8bb31-facb-4777-9189-0d8eb96d869f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:17.494246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f420d328-159a-4197-a4c5-b31c3d9827b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045214 Aug 24 05:16:17.494821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 812/1732] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:17 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:17.500388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-37c8bb31-facb-4777-9189-0d8eb96d869f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045673 Aug 24 05:16:17.500924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 921/1733] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:18.069997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8fe407bb-ea55-484d-86fe-a442c2c3fb20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:18.072229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8fe407bb-ea55-484d-86fe-a442c2c3fb20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:18.078137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8fe407bb-ea55-484d-86fe-a442c2c3fb20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:18.078617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8fe407bb-ea55-484d-86fe-a442c2c3fb20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:18.079094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8fe407bb-ea55-484d-86fe-a442c2c3fb20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:18.079790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8fe407bb-ea55-484d-86fe-a442c2c3fb20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:18.080274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8fe407bb-ea55-484d-86fe-a442c2c3fb20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:18.080696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8fe407bb-ea55-484d-86fe-a442c2c3fb20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:18.113279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8fe407bb-ea55-484d-86fe-a442c2c3fb20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047198 Aug 24 05:16:18.117508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 813/1734] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:18.506058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0fa13bc0-99d3-499b-a010-783eb6ca8659 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:18.508325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0fa13bc0-99d3-499b-a010-783eb6ca8659 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:18.512209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3e918783-b187-4c53-a582-3876a423b027 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:18.514315 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3e918783-b187-4c53-a582-3876a423b027 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:18.514801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa13bc0-99d3-499b-a010-783eb6ca8659 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:18.515281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa13bc0-99d3-499b-a010-783eb6ca8659 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:18.515709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa13bc0-99d3-499b-a010-783eb6ca8659 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:18.516396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa13bc0-99d3-499b-a010-783eb6ca8659 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:18.516835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa13bc0-99d3-499b-a010-783eb6ca8659 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:18.517259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa13bc0-99d3-499b-a010-783eb6ca8659 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:18.520623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e918783-b187-4c53-a582-3876a423b027 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:18.521096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e918783-b187-4c53-a582-3876a423b027 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:18.521522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e918783-b187-4c53-a582-3876a423b027 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:18.522198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e918783-b187-4c53-a582-3876a423b027 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:18.522636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e918783-b187-4c53-a582-3876a423b027 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:18.523081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e918783-b187-4c53-a582-3876a423b027 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:18.547348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0fa13bc0-99d3-499b-a010-783eb6ca8659 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045207 Aug 24 05:16:18.548190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 922/1735] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:18.557290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3e918783-b187-4c53-a582-3876a423b027 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048866 Aug 24 05:16:18.557836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 814/1736] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:19.129208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-28a4b9bd-d440-4bde-b656-caf4c8fc4a95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:19.131341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-28a4b9bd-d440-4bde-b656-caf4c8fc4a95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:19.137356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28a4b9bd-d440-4bde-b656-caf4c8fc4a95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:19.137820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28a4b9bd-d440-4bde-b656-caf4c8fc4a95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:19.138246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28a4b9bd-d440-4bde-b656-caf4c8fc4a95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:19.138950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28a4b9bd-d440-4bde-b656-caf4c8fc4a95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:19.139392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28a4b9bd-d440-4bde-b656-caf4c8fc4a95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:19.139804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28a4b9bd-d440-4bde-b656-caf4c8fc4a95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:19.169849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-28a4b9bd-d440-4bde-b656-caf4c8fc4a95 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044555 Aug 24 05:16:19.170396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 923/1737] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:19.559820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ce1e6b3b-20fe-4f43-950e-637892416a5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:19.561986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ce1e6b3b-20fe-4f43-950e-637892416a5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:19.568553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce1e6b3b-20fe-4f43-950e-637892416a5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:19.568718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b53a1584-6941-4d7d-bdeb-ccadca74c6b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:19.569136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce1e6b3b-20fe-4f43-950e-637892416a5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:19.569459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce1e6b3b-20fe-4f43-950e-637892416a5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:19.570916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce1e6b3b-20fe-4f43-950e-637892416a5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:19.571292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b53a1584-6941-4d7d-bdeb-ccadca74c6b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:19.571524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce1e6b3b-20fe-4f43-950e-637892416a5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:19.571956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce1e6b3b-20fe-4f43-950e-637892416a5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:19.577563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b53a1584-6941-4d7d-bdeb-ccadca74c6b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:19.578035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b53a1584-6941-4d7d-bdeb-ccadca74c6b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:19.578465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b53a1584-6941-4d7d-bdeb-ccadca74c6b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:19.579183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b53a1584-6941-4d7d-bdeb-ccadca74c6b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:19.579628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b53a1584-6941-4d7d-bdeb-ccadca74c6b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:19.580041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b53a1584-6941-4d7d-bdeb-ccadca74c6b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:19.601635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ce1e6b3b-20fe-4f43-950e-637892416a5c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045743 Aug 24 05:16:19.602311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 815/1738] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:19.609396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b53a1584-6941-4d7d-bdeb-ccadca74c6b8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044612 Aug 24 05:16:19.609936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 924/1739] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:20.182878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-67f84778-0bc7-4592-8707-07ec880c182a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:20.184982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-67f84778-0bc7-4592-8707-07ec880c182a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:20.190934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67f84778-0bc7-4592-8707-07ec880c182a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:20.191410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67f84778-0bc7-4592-8707-07ec880c182a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:20.191841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67f84778-0bc7-4592-8707-07ec880c182a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:20.192524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67f84778-0bc7-4592-8707-07ec880c182a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:20.192977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67f84778-0bc7-4592-8707-07ec880c182a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:20.193402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67f84778-0bc7-4592-8707-07ec880c182a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:20.222711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-67f84778-0bc7-4592-8707-07ec880c182a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044374 Aug 24 05:16:20.223271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 816/1740] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:20.613482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-eed23114-76e2-4daf-bc9d-32aa0a3a93a8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:20.615851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-eed23114-76e2-4daf-bc9d-32aa0a3a93a8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:20.621851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-da3e8de5-81d0-44ca-a55b-d3973da01043 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:20.622877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed23114-76e2-4daf-bc9d-32aa0a3a93a8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:20.623359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed23114-76e2-4daf-bc9d-32aa0a3a93a8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:20.623792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed23114-76e2-4daf-bc9d-32aa0a3a93a8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:20.624110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-da3e8de5-81d0-44ca-a55b-d3973da01043 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:20.624483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed23114-76e2-4daf-bc9d-32aa0a3a93a8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:20.624929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed23114-76e2-4daf-bc9d-32aa0a3a93a8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:20.625348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eed23114-76e2-4daf-bc9d-32aa0a3a93a8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:20.630598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da3e8de5-81d0-44ca-a55b-d3973da01043 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:20.631120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da3e8de5-81d0-44ca-a55b-d3973da01043 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:20.631558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da3e8de5-81d0-44ca-a55b-d3973da01043 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:20.632253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da3e8de5-81d0-44ca-a55b-d3973da01043 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:20.632783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da3e8de5-81d0-44ca-a55b-d3973da01043 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:20.633204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-da3e8de5-81d0-44ca-a55b-d3973da01043 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:20.656402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-eed23114-76e2-4daf-bc9d-32aa0a3a93a8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046853 Aug 24 05:16:20.656967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 925/1741] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:20.663627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-da3e8de5-81d0-44ca-a55b-d3973da01043 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045845 Aug 24 05:16:20.664849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 817/1742] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:21.235377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3526891e-1215-42b8-99dd-13d80c9acb90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:21.237532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3526891e-1215-42b8-99dd-13d80c9acb90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:21.244404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3526891e-1215-42b8-99dd-13d80c9acb90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:21.244884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3526891e-1215-42b8-99dd-13d80c9acb90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:21.245318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3526891e-1215-42b8-99dd-13d80c9acb90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:21.246003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3526891e-1215-42b8-99dd-13d80c9acb90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:21.246453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3526891e-1215-42b8-99dd-13d80c9acb90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:21.246906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3526891e-1215-42b8-99dd-13d80c9acb90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:21.264267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:21.279172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3526891e-1215-42b8-99dd-13d80c9acb90 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047780 Aug 24 05:16:21.279720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 926/1743] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:21.668447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-318afe1d-53f5-4776-af05-9b6cb09bc192 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:21.670607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-318afe1d-53f5-4776-af05-9b6cb09bc192 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:21.676560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d0b7d0f7-510c-4197-b70b-4bc408d90031 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:21.677286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-318afe1d-53f5-4776-af05-9b6cb09bc192 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:21.678028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-318afe1d-53f5-4776-af05-9b6cb09bc192 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:21.678465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-318afe1d-53f5-4776-af05-9b6cb09bc192 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:21.679196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-318afe1d-53f5-4776-af05-9b6cb09bc192 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:21.679702 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-318afe1d-53f5-4776-af05-9b6cb09bc192 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:21.680121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-318afe1d-53f5-4776-af05-9b6cb09bc192 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:21.680272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d0b7d0f7-510c-4197-b70b-4bc408d90031 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:21.686767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0b7d0f7-510c-4197-b70b-4bc408d90031 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:21.687242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0b7d0f7-510c-4197-b70b-4bc408d90031 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:21.687672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0b7d0f7-510c-4197-b70b-4bc408d90031 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:21.688476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0b7d0f7-510c-4197-b70b-4bc408d90031 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:21.688922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0b7d0f7-510c-4197-b70b-4bc408d90031 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:21.689338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0b7d0f7-510c-4197-b70b-4bc408d90031 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:21.710134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-318afe1d-53f5-4776-af05-9b6cb09bc192 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045609 Aug 24 05:16:21.711467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 818/1744] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:21.720968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d0b7d0f7-510c-4197-b70b-4bc408d90031 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048507 Aug 24 05:16:21.721515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 927/1745] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:22.292116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a9d4f88f-17f4-42ed-baa9-868a9d03e490 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:22.294159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a9d4f88f-17f4-42ed-baa9-868a9d03e490 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:22.300197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9d4f88f-17f4-42ed-baa9-868a9d03e490 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:22.300675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9d4f88f-17f4-42ed-baa9-868a9d03e490 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:22.301109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9d4f88f-17f4-42ed-baa9-868a9d03e490 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:22.301805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9d4f88f-17f4-42ed-baa9-868a9d03e490 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:22.302272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9d4f88f-17f4-42ed-baa9-868a9d03e490 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:22.302977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9d4f88f-17f4-42ed-baa9-868a9d03e490 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:22.306737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:22.332976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a9d4f88f-17f4-42ed-baa9-868a9d03e490 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045017 Aug 24 05:16:22.333750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 819/1746] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:22.723647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6da48ed1-8ce4-4695-b1c7-e03bd136c804 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:22.725792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6da48ed1-8ce4-4695-b1c7-e03bd136c804 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:22.733060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da48ed1-8ce4-4695-b1c7-e03bd136c804 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:22.733689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da48ed1-8ce4-4695-b1c7-e03bd136c804 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:22.734223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da48ed1-8ce4-4695-b1c7-e03bd136c804 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:22.734878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da48ed1-8ce4-4695-b1c7-e03bd136c804 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:22.735334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da48ed1-8ce4-4695-b1c7-e03bd136c804 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:22.735748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6da48ed1-8ce4-4695-b1c7-e03bd136c804 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:22.736115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c2d76e41-8706-4be9-bc27-a152c2dacfa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:22.738271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c2d76e41-8706-4be9-bc27-a152c2dacfa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:22.744943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2d76e41-8706-4be9-bc27-a152c2dacfa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:22.745421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2d76e41-8706-4be9-bc27-a152c2dacfa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:22.745851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2d76e41-8706-4be9-bc27-a152c2dacfa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:22.746544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2d76e41-8706-4be9-bc27-a152c2dacfa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:22.747029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2d76e41-8706-4be9-bc27-a152c2dacfa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:22.747455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2d76e41-8706-4be9-bc27-a152c2dacfa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:22.768627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6da48ed1-8ce4-4695-b1c7-e03bd136c804 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048917 Aug 24 05:16:22.769227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 928/1747] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:22 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:22.778385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c2d76e41-8706-4be9-bc27-a152c2dacfa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Aug 24 05:16:22.778959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 820/1748] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:23.345777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b6a20369-f6a0-4fc6-a541-965526287aba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:23.347922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b6a20369-f6a0-4fc6-a541-965526287aba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:23.354655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6a20369-f6a0-4fc6-a541-965526287aba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:23.355162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6a20369-f6a0-4fc6-a541-965526287aba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:23.355596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6a20369-f6a0-4fc6-a541-965526287aba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:23.356280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6a20369-f6a0-4fc6-a541-965526287aba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:23.356728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6a20369-f6a0-4fc6-a541-965526287aba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:23.357146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6a20369-f6a0-4fc6-a541-965526287aba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:23.390044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b6a20369-f6a0-4fc6-a541-965526287aba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048112 Aug 24 05:16:23.390603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 929/1749] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:23.781234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4ef3c10f-0ecd-478f-a0c5-2547d8ef1433 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:23.783389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4ef3c10f-0ecd-478f-a0c5-2547d8ef1433 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:23.790133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ef3c10f-0ecd-478f-a0c5-2547d8ef1433 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:23.790614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ef3c10f-0ecd-478f-a0c5-2547d8ef1433 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:23.790795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4c4a975a-96fc-476f-aa9e-3eb84a53e971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:23.791435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ef3c10f-0ecd-478f-a0c5-2547d8ef1433 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:23.791749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ef3c10f-0ecd-478f-a0c5-2547d8ef1433 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:23.792193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ef3c10f-0ecd-478f-a0c5-2547d8ef1433 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:23.792610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ef3c10f-0ecd-478f-a0c5-2547d8ef1433 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:23.792856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4c4a975a-96fc-476f-aa9e-3eb84a53e971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:23.799273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c4a975a-96fc-476f-aa9e-3eb84a53e971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:23.799750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c4a975a-96fc-476f-aa9e-3eb84a53e971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:23.800180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c4a975a-96fc-476f-aa9e-3eb84a53e971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:23.800871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c4a975a-96fc-476f-aa9e-3eb84a53e971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:23.801314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c4a975a-96fc-476f-aa9e-3eb84a53e971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:23.801727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4c4a975a-96fc-476f-aa9e-3eb84a53e971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:23.822993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4ef3c10f-0ecd-478f-a0c5-2547d8ef1433 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045688 Aug 24 05:16:23.823568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 821/1750] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:23.832589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4c4a975a-96fc-476f-aa9e-3eb84a53e971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Aug 24 05:16:23.833146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 930/1751] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:24.402717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-387eed2a-f3b3-4015-a356-b43cafab24bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:24.404863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-387eed2a-f3b3-4015-a356-b43cafab24bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:24.411025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387eed2a-f3b3-4015-a356-b43cafab24bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:24.411491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387eed2a-f3b3-4015-a356-b43cafab24bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:24.411916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387eed2a-f3b3-4015-a356-b43cafab24bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:24.412597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387eed2a-f3b3-4015-a356-b43cafab24bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:24.413039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387eed2a-f3b3-4015-a356-b43cafab24bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:24.413456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387eed2a-f3b3-4015-a356-b43cafab24bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:24.445365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-387eed2a-f3b3-4015-a356-b43cafab24bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046955 Aug 24 05:16:24.445944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 822/1752] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:24.835253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8ee4b580-b6ab-4dc0-b29c-1484ec888e6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:24.837415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8ee4b580-b6ab-4dc0-b29c-1484ec888e6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:24.844027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee4b580-b6ab-4dc0-b29c-1484ec888e6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:24.844496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee4b580-b6ab-4dc0-b29c-1484ec888e6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:24.844928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee4b580-b6ab-4dc0-b29c-1484ec888e6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:24.845608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee4b580-b6ab-4dc0-b29c-1484ec888e6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:24.845722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7f887677-28cd-4ab0-a16a-022ebeea23ce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:24.846146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee4b580-b6ab-4dc0-b29c-1484ec888e6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:24.846451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8ee4b580-b6ab-4dc0-b29c-1484ec888e6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:24.847893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7f887677-28cd-4ab0-a16a-022ebeea23ce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:24.855348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f887677-28cd-4ab0-a16a-022ebeea23ce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:24.855836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f887677-28cd-4ab0-a16a-022ebeea23ce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:24.856280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f887677-28cd-4ab0-a16a-022ebeea23ce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:24.857012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f887677-28cd-4ab0-a16a-022ebeea23ce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:24.857468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f887677-28cd-4ab0-a16a-022ebeea23ce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:24.857897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f887677-28cd-4ab0-a16a-022ebeea23ce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:24.880463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8ee4b580-b6ab-4dc0-b29c-1484ec888e6f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049095 Aug 24 05:16:24.881023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 931/1753] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:24 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:24.891245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7f887677-28cd-4ab0-a16a-022ebeea23ce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049370 Aug 24 05:16:24.891801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 823/1754] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:25.458778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-51cf9657-0546-4cdb-905f-fabbf649a84d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:25.461214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-51cf9657-0546-4cdb-905f-fabbf649a84d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:25.468044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51cf9657-0546-4cdb-905f-fabbf649a84d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:25.468523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51cf9657-0546-4cdb-905f-fabbf649a84d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:25.468945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51cf9657-0546-4cdb-905f-fabbf649a84d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:25.469638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51cf9657-0546-4cdb-905f-fabbf649a84d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:25.470182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51cf9657-0546-4cdb-905f-fabbf649a84d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:25.470596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51cf9657-0546-4cdb-905f-fabbf649a84d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:25.503907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-51cf9657-0546-4cdb-905f-fabbf649a84d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049826 Aug 24 05:16:25.504467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 932/1755] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:25.893929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-50197cc2-452d-484a-8adf-cc91e6322162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:25.896111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-50197cc2-452d-484a-8adf-cc91e6322162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:25.903783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50197cc2-452d-484a-8adf-cc91e6322162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:25.904285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50197cc2-452d-484a-8adf-cc91e6322162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:25.905054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50197cc2-452d-484a-8adf-cc91e6322162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:25.905271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1a09847f-98d6-41c3-8dd9-ba0343e43165 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:25.906191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50197cc2-452d-484a-8adf-cc91e6322162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:25.906658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50197cc2-452d-484a-8adf-cc91e6322162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:25.907115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50197cc2-452d-484a-8adf-cc91e6322162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:25.907443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1a09847f-98d6-41c3-8dd9-ba0343e43165 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:25.916321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a09847f-98d6-41c3-8dd9-ba0343e43165 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:25.917054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a09847f-98d6-41c3-8dd9-ba0343e43165 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:25.917857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a09847f-98d6-41c3-8dd9-ba0343e43165 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:25.918713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a09847f-98d6-41c3-8dd9-ba0343e43165 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:25.919166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a09847f-98d6-41c3-8dd9-ba0343e43165 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:25.919932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a09847f-98d6-41c3-8dd9-ba0343e43165 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:25.947256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-50197cc2-452d-484a-8adf-cc91e6322162 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057107 Aug 24 05:16:25.948399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 824/1756] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:25.968623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1a09847f-98d6-41c3-8dd9-ba0343e43165 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067949 Aug 24 05:16:25.969112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 933/1757] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:26.516422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cda80fa3-9ca7-4cd5-88a0-983aec09c779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:26.518528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cda80fa3-9ca7-4cd5-88a0-983aec09c779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:26.524664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cda80fa3-9ca7-4cd5-88a0-983aec09c779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:26.525140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cda80fa3-9ca7-4cd5-88a0-983aec09c779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:26.525576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cda80fa3-9ca7-4cd5-88a0-983aec09c779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:26.526263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cda80fa3-9ca7-4cd5-88a0-983aec09c779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:26.526747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cda80fa3-9ca7-4cd5-88a0-983aec09c779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:26.527175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cda80fa3-9ca7-4cd5-88a0-983aec09c779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:26.556699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cda80fa3-9ca7-4cd5-88a0-983aec09c779 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044238 Aug 24 05:16:26.557236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 825/1758] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:26 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:26.960053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-306a69a9-80c8-4835-83a1-21d79f5e5248 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:26.962222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-306a69a9-80c8-4835-83a1-21d79f5e5248 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:26.968674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-306a69a9-80c8-4835-83a1-21d79f5e5248 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:26.969149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-306a69a9-80c8-4835-83a1-21d79f5e5248 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:26.969581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-306a69a9-80c8-4835-83a1-21d79f5e5248 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:26.970260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-306a69a9-80c8-4835-83a1-21d79f5e5248 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:26.970730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-306a69a9-80c8-4835-83a1-21d79f5e5248 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:26.971179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-306a69a9-80c8-4835-83a1-21d79f5e5248 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:26.981372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c5d9ee4a-56c9-4806-b7f8-4902515ec90f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:26.983512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c5d9ee4a-56c9-4806-b7f8-4902515ec90f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:26.989979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5d9ee4a-56c9-4806-b7f8-4902515ec90f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:26.990397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5d9ee4a-56c9-4806-b7f8-4902515ec90f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:26.990869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5d9ee4a-56c9-4806-b7f8-4902515ec90f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:26.991568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5d9ee4a-56c9-4806-b7f8-4902515ec90f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:26.992788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5d9ee4a-56c9-4806-b7f8-4902515ec90f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:26.993216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5d9ee4a-56c9-4806-b7f8-4902515ec90f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:27.005068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-306a69a9-80c8-4835-83a1-21d79f5e5248 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048921 Aug 24 05:16:27.005629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 934/1759] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:27.022639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c5d9ee4a-56c9-4806-b7f8-4902515ec90f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045192 Aug 24 05:16:27.023775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 826/1760] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:27.568621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-df301185-fd20-42b0-80d4-80eb6c9730c1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:27.571387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-df301185-fd20-42b0-80d4-80eb6c9730c1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:27.577389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df301185-fd20-42b0-80d4-80eb6c9730c1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:27.577868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df301185-fd20-42b0-80d4-80eb6c9730c1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:27.578296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df301185-fd20-42b0-80d4-80eb6c9730c1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:27.578997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df301185-fd20-42b0-80d4-80eb6c9730c1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:27.579442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df301185-fd20-42b0-80d4-80eb6c9730c1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:27.579856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df301185-fd20-42b0-80d4-80eb6c9730c1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:27.609993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-df301185-fd20-42b0-80d4-80eb6c9730c1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Aug 24 05:16:27.610533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 935/1761] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:28.017548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5d74d3d3-81e6-4384-b31a-d5d8c9639ab0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:28.019611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5d74d3d3-81e6-4384-b31a-d5d8c9639ab0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:28.026504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d74d3d3-81e6-4384-b31a-d5d8c9639ab0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.026812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d74d3d3-81e6-4384-b31a-d5d8c9639ab0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.027910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d74d3d3-81e6-4384-b31a-d5d8c9639ab0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.027910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d74d3d3-81e6-4384-b31a-d5d8c9639ab0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.028371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d74d3d3-81e6-4384-b31a-d5d8c9639ab0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.028828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d74d3d3-81e6-4384-b31a-d5d8c9639ab0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.035618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2ed44fcb-52ae-45ad-93d8-5bada3581140 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:28.037732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2ed44fcb-52ae-45ad-93d8-5bada3581140 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:28.044274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ed44fcb-52ae-45ad-93d8-5bada3581140 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.044754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ed44fcb-52ae-45ad-93d8-5bada3581140 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.045189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ed44fcb-52ae-45ad-93d8-5bada3581140 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.045913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ed44fcb-52ae-45ad-93d8-5bada3581140 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.046363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ed44fcb-52ae-45ad-93d8-5bada3581140 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.046816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ed44fcb-52ae-45ad-93d8-5bada3581140 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.059363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5d74d3d3-81e6-4384-b31a-d5d8c9639ab0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045834 Aug 24 05:16:28.059929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 827/1762] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:28.077643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2ed44fcb-52ae-45ad-93d8-5bada3581140 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045947 Aug 24 05:16:28.078184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 936/1763] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:28.622189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cc1b791b-d70d-405f-ac4c-57596265771a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:28.624355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cc1b791b-d70d-405f-ac4c-57596265771a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:28.630754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc1b791b-d70d-405f-ac4c-57596265771a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.631243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc1b791b-d70d-405f-ac4c-57596265771a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.631685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc1b791b-d70d-405f-ac4c-57596265771a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.632562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc1b791b-d70d-405f-ac4c-57596265771a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:28.633371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc1b791b-d70d-405f-ac4c-57596265771a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:28.634130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc1b791b-d70d-405f-ac4c-57596265771a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:28.666448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cc1b791b-d70d-405f-ac4c-57596265771a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048169 Aug 24 05:16:28.667038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 828/1764] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:29.072079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-804f647f-e2c0-45a0-8186-f208e7a946ba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:29.074246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-804f647f-e2c0-45a0-8186-f208e7a946ba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:29.080709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-804f647f-e2c0-45a0-8186-f208e7a946ba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:29.081184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-804f647f-e2c0-45a0-8186-f208e7a946ba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:29.081615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-804f647f-e2c0-45a0-8186-f208e7a946ba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:29.082309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-804f647f-e2c0-45a0-8186-f208e7a946ba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:29.082757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-804f647f-e2c0-45a0-8186-f208e7a946ba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:29.083179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-804f647f-e2c0-45a0-8186-f208e7a946ba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:29.090317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8d102cc3-3860-4a30-9ee1-1545e153856d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:29.092682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8d102cc3-3860-4a30-9ee1-1545e153856d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:29.099292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d102cc3-3860-4a30-9ee1-1545e153856d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:29.099779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d102cc3-3860-4a30-9ee1-1545e153856d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:29.100215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d102cc3-3860-4a30-9ee1-1545e153856d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:29.100913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d102cc3-3860-4a30-9ee1-1545e153856d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:29.101844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d102cc3-3860-4a30-9ee1-1545e153856d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:29.102121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d102cc3-3860-4a30-9ee1-1545e153856d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:29.113441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-804f647f-e2c0-45a0-8186-f208e7a946ba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045820 Aug 24 05:16:29.114000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 937/1765] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:29.131833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8d102cc3-3860-4a30-9ee1-1545e153856d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046397 Aug 24 05:16:29.132939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 829/1766] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:29.678859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8d4abbe0-4159-4100-bb1b-5381f6e50aa2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:29.681673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8d4abbe0-4159-4100-bb1b-5381f6e50aa2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:29.687573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4abbe0-4159-4100-bb1b-5381f6e50aa2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:29.688039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4abbe0-4159-4100-bb1b-5381f6e50aa2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:29.688462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4abbe0-4159-4100-bb1b-5381f6e50aa2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:29.689133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4abbe0-4159-4100-bb1b-5381f6e50aa2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:29.689573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4abbe0-4159-4100-bb1b-5381f6e50aa2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:29.689985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d4abbe0-4159-4100-bb1b-5381f6e50aa2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:29.718114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8d4abbe0-4159-4100-bb1b-5381f6e50aa2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Aug 24 05:16:29.718644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 938/1767] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:30.125634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-395b992d-f2b5-4aaf-90d0-28d7f38ddee5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:30.127801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-395b992d-f2b5-4aaf-90d0-28d7f38ddee5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:30.134906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395b992d-f2b5-4aaf-90d0-28d7f38ddee5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:30.135381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395b992d-f2b5-4aaf-90d0-28d7f38ddee5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:30.135812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395b992d-f2b5-4aaf-90d0-28d7f38ddee5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:30.136499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395b992d-f2b5-4aaf-90d0-28d7f38ddee5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:30.136945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395b992d-f2b5-4aaf-90d0-28d7f38ddee5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:30.137364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395b992d-f2b5-4aaf-90d0-28d7f38ddee5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:30.144467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-83498054-a0a8-4457-902c-1ad217800b47 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:30.146632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-83498054-a0a8-4457-902c-1ad217800b47 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:30.153016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83498054-a0a8-4457-902c-1ad217800b47 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:30.153492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83498054-a0a8-4457-902c-1ad217800b47 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:30.153921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83498054-a0a8-4457-902c-1ad217800b47 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:30.154606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83498054-a0a8-4457-902c-1ad217800b47 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:30.155074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83498054-a0a8-4457-902c-1ad217800b47 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:30.155491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-83498054-a0a8-4457-902c-1ad217800b47 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:30.167069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-395b992d-f2b5-4aaf-90d0-28d7f38ddee5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Aug 24 05:16:30.167632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 830/1768] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:30.185559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-83498054-a0a8-4457-902c-1ad217800b47 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045064 Aug 24 05:16:30.186100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 939/1769] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:30.730680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d5ac0b4a-ef42-4498-ac14-d3fe3e690a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:30.732888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d5ac0b4a-ef42-4498-ac14-d3fe3e690a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:30.739016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5ac0b4a-ef42-4498-ac14-d3fe3e690a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:30.739490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5ac0b4a-ef42-4498-ac14-d3fe3e690a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:30.739918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5ac0b4a-ef42-4498-ac14-d3fe3e690a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:30.740604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5ac0b4a-ef42-4498-ac14-d3fe3e690a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:30.741047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5ac0b4a-ef42-4498-ac14-d3fe3e690a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:30.741467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5ac0b4a-ef42-4498-ac14-d3fe3e690a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:30.772028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d5ac0b4a-ef42-4498-ac14-d3fe3e690a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045970 Aug 24 05:16:30.772566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 831/1770] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:31.180024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3e1173d4-b380-4727-8eb7-23d892ebd78e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:31.182132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3e1173d4-b380-4727-8eb7-23d892ebd78e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:31.188451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e1173d4-b380-4727-8eb7-23d892ebd78e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:31.188916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e1173d4-b380-4727-8eb7-23d892ebd78e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:31.189342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e1173d4-b380-4727-8eb7-23d892ebd78e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:31.190013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e1173d4-b380-4727-8eb7-23d892ebd78e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:31.190451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e1173d4-b380-4727-8eb7-23d892ebd78e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:31.190911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e1173d4-b380-4727-8eb7-23d892ebd78e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:31.197464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1e506917-a0f1-4de9-bc2a-a45920df5da8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:31.199691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1e506917-a0f1-4de9-bc2a-a45920df5da8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:31.206013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e506917-a0f1-4de9-bc2a-a45920df5da8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:31.206494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e506917-a0f1-4de9-bc2a-a45920df5da8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:31.206985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e506917-a0f1-4de9-bc2a-a45920df5da8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:31.207673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e506917-a0f1-4de9-bc2a-a45920df5da8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:31.208125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e506917-a0f1-4de9-bc2a-a45920df5da8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:31.208550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e506917-a0f1-4de9-bc2a-a45920df5da8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:31.220394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3e1173d4-b380-4727-8eb7-23d892ebd78e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045156 Aug 24 05:16:31.220941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 940/1771] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:31.238312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1e506917-a0f1-4de9-bc2a-a45920df5da8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044821 Aug 24 05:16:31.238898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 832/1772] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:31.785145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9ac6f225-0c9a-4bc2-856f-10c73969786d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:31.787303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9ac6f225-0c9a-4bc2-856f-10c73969786d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:31.794381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ac6f225-0c9a-4bc2-856f-10c73969786d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:31.794892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ac6f225-0c9a-4bc2-856f-10c73969786d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:31.795332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ac6f225-0c9a-4bc2-856f-10c73969786d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:31.796018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ac6f225-0c9a-4bc2-856f-10c73969786d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:31.796472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ac6f225-0c9a-4bc2-856f-10c73969786d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:31.796887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9ac6f225-0c9a-4bc2-856f-10c73969786d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:31.826353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9ac6f225-0c9a-4bc2-856f-10c73969786d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Aug 24 05:16:31.826920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 941/1773] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:32.232805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-79fdfd8d-419c-4247-a57b-153384c41f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:32.234962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-79fdfd8d-419c-4247-a57b-153384c41f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:32.241458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79fdfd8d-419c-4247-a57b-153384c41f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.242130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79fdfd8d-419c-4247-a57b-153384c41f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.242616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79fdfd8d-419c-4247-a57b-153384c41f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.243336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79fdfd8d-419c-4247-a57b-153384c41f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.243788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79fdfd8d-419c-4247-a57b-153384c41f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.244212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79fdfd8d-419c-4247-a57b-153384c41f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.251020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dc68f9ba-9bed-46ca-a7a8-607aa067c7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:32.253143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dc68f9ba-9bed-46ca-a7a8-607aa067c7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:32.260463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc68f9ba-9bed-46ca-a7a8-607aa067c7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.260934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc68f9ba-9bed-46ca-a7a8-607aa067c7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.261359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc68f9ba-9bed-46ca-a7a8-607aa067c7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.262039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc68f9ba-9bed-46ca-a7a8-607aa067c7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.262480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc68f9ba-9bed-46ca-a7a8-607aa067c7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.262928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc68f9ba-9bed-46ca-a7a8-607aa067c7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.275127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-79fdfd8d-419c-4247-a57b-153384c41f00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046128 Aug 24 05:16:32.275619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 833/1774] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:32.295126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dc68f9ba-9bed-46ca-a7a8-607aa067c7f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047976 Aug 24 05:16:32.295682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 942/1775] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:32.838371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-43aaf931-be5e-4414-ac5a-b2460fb8a5f9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:32.840604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-43aaf931-be5e-4414-ac5a-b2460fb8a5f9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:32.846527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43aaf931-be5e-4414-ac5a-b2460fb8a5f9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.847042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43aaf931-be5e-4414-ac5a-b2460fb8a5f9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.847477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43aaf931-be5e-4414-ac5a-b2460fb8a5f9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.848163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43aaf931-be5e-4414-ac5a-b2460fb8a5f9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:32.848613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43aaf931-be5e-4414-ac5a-b2460fb8a5f9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:32.849030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43aaf931-be5e-4414-ac5a-b2460fb8a5f9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:32.881799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-43aaf931-be5e-4414-ac5a-b2460fb8a5f9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047347 Aug 24 05:16:32.882393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 834/1776] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:33.287369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9beefba5-92af-40e4-9b26-3dafe15c1d27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:33.290442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9beefba5-92af-40e4-9b26-3dafe15c1d27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:33.296958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9beefba5-92af-40e4-9b26-3dafe15c1d27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:33.297442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9beefba5-92af-40e4-9b26-3dafe15c1d27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:33.298368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9beefba5-92af-40e4-9b26-3dafe15c1d27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:33.298548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9beefba5-92af-40e4-9b26-3dafe15c1d27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:33.299020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9beefba5-92af-40e4-9b26-3dafe15c1d27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:33.299440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9beefba5-92af-40e4-9b26-3dafe15c1d27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:33.303409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:33.309230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ddf96e79-0672-4edd-8f4f-c03e9864fccb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:33.312232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ddf96e79-0672-4edd-8f4f-c03e9864fccb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:33.319365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddf96e79-0672-4edd-8f4f-c03e9864fccb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:33.320402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddf96e79-0672-4edd-8f4f-c03e9864fccb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:33.320845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddf96e79-0672-4edd-8f4f-c03e9864fccb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:33.321544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddf96e79-0672-4edd-8f4f-c03e9864fccb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:33.321994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddf96e79-0672-4edd-8f4f-c03e9864fccb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:33.322414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddf96e79-0672-4edd-8f4f-c03e9864fccb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:33.331420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9beefba5-92af-40e4-9b26-3dafe15c1d27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047908 Aug 24 05:16:33.331906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 943/1777] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:33 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:33.348546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:33.353903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ddf96e79-0672-4edd-8f4f-c03e9864fccb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050232 Aug 24 05:16:33.354457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 835/1778] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:33.893548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-68a494b6-92ee-4a49-929c-52ca1fd1c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:33.895692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-68a494b6-92ee-4a49-929c-52ca1fd1c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:33.902337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68a494b6-92ee-4a49-929c-52ca1fd1c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:33.902840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68a494b6-92ee-4a49-929c-52ca1fd1c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:33.903274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68a494b6-92ee-4a49-929c-52ca1fd1c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:33.903952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68a494b6-92ee-4a49-929c-52ca1fd1c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:33.904408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68a494b6-92ee-4a49-929c-52ca1fd1c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:33.904830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68a494b6-92ee-4a49-929c-52ca1fd1c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:33.934951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-68a494b6-92ee-4a49-929c-52ca1fd1c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045434 Aug 24 05:16:33.935497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 944/1779] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:34.343763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6b1c4d9e-9824-4a63-a237-562637e533a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:34.345905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6b1c4d9e-9824-4a63-a237-562637e533a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:34.353060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b1c4d9e-9824-4a63-a237-562637e533a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:34.353578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b1c4d9e-9824-4a63-a237-562637e533a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:34.354019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b1c4d9e-9824-4a63-a237-562637e533a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:34.354772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b1c4d9e-9824-4a63-a237-562637e533a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:34.355263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b1c4d9e-9824-4a63-a237-562637e533a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:34.355690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b1c4d9e-9824-4a63-a237-562637e533a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:34.365429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9456f478-b4a3-4bad-ae1b-456147dcaff2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:34.368233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9456f478-b4a3-4bad-ae1b-456147dcaff2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:34.374663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9456f478-b4a3-4bad-ae1b-456147dcaff2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:34.375173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9456f478-b4a3-4bad-ae1b-456147dcaff2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:34.375605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9456f478-b4a3-4bad-ae1b-456147dcaff2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:34.376377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9456f478-b4a3-4bad-ae1b-456147dcaff2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:34.376847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9456f478-b4a3-4bad-ae1b-456147dcaff2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:34.377271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9456f478-b4a3-4bad-ae1b-456147dcaff2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:34.386520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6b1c4d9e-9824-4a63-a237-562637e533a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047129 Aug 24 05:16:34.387113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 836/1780] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:34.407465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9456f478-b4a3-4bad-ae1b-456147dcaff2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Aug 24 05:16:34.408021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 945/1781] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:34 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:16:34.947371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-328ce0e2-8860-4cf3-9057-45ea30321477 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:34.949553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-328ce0e2-8860-4cf3-9057-45ea30321477 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:34.955523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-328ce0e2-8860-4cf3-9057-45ea30321477 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:34.956038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-328ce0e2-8860-4cf3-9057-45ea30321477 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:34.956474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-328ce0e2-8860-4cf3-9057-45ea30321477 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:34.957160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-328ce0e2-8860-4cf3-9057-45ea30321477 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:34.957609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-328ce0e2-8860-4cf3-9057-45ea30321477 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:34.958034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-328ce0e2-8860-4cf3-9057-45ea30321477 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:34.987590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-328ce0e2-8860-4cf3-9057-45ea30321477 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Aug 24 05:16:34.988061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 837/1782] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:35.401163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2d680780-d571-46a1-b0e2-8963213aef09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:35.403347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2d680780-d571-46a1-b0e2-8963213aef09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:35.409708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d680780-d571-46a1-b0e2-8963213aef09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:35.410183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d680780-d571-46a1-b0e2-8963213aef09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:35.410616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d680780-d571-46a1-b0e2-8963213aef09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:35.411322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d680780-d571-46a1-b0e2-8963213aef09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:35.411776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d680780-d571-46a1-b0e2-8963213aef09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:35.412198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d680780-d571-46a1-b0e2-8963213aef09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:35.444535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2d680780-d571-46a1-b0e2-8963213aef09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047823 Aug 24 05:16:35.445333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 946/1783] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:35 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:35.468063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c92de6cb-5db3-46a4-8942-51dbdead2a12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:35.470184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c92de6cb-5db3-46a4-8942-51dbdead2a12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:35.472066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=84 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:35.478076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c92de6cb-5db3-46a4-8942-51dbdead2a12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:35.478558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c92de6cb-5db3-46a4-8942-51dbdead2a12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:35.479037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c92de6cb-5db3-46a4-8942-51dbdead2a12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:35.479733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c92de6cb-5db3-46a4-8942-51dbdead2a12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:35.480185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c92de6cb-5db3-46a4-8942-51dbdead2a12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:35.480610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c92de6cb-5db3-46a4-8942-51dbdead2a12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:35.510697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c92de6cb-5db3-46a4-8942-51dbdead2a12 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094194 Aug 24 05:16:35.511187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 838/1784] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:36.067422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-529da654-8cf1-438c-9f75-c047343b60cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:36.069549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-529da654-8cf1-438c-9f75-c047343b60cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:36.076976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-529da654-8cf1-438c-9f75-c047343b60cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:36.077455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-529da654-8cf1-438c-9f75-c047343b60cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:36.077882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-529da654-8cf1-438c-9f75-c047343b60cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:36.078570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-529da654-8cf1-438c-9f75-c047343b60cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:36.079105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-529da654-8cf1-438c-9f75-c047343b60cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:36.079525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-529da654-8cf1-438c-9f75-c047343b60cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:36.109061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-529da654-8cf1-438c-9f75-c047343b60cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112806 Aug 24 05:16:36.109615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 947/1785] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:36.457529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-455b30e5-9915-4055-87a6-a5b9c0600438 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:36.459696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-455b30e5-9915-4055-87a6-a5b9c0600438 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:36.466255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-455b30e5-9915-4055-87a6-a5b9c0600438 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:36.466773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-455b30e5-9915-4055-87a6-a5b9c0600438 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:36.467213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-455b30e5-9915-4055-87a6-a5b9c0600438 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:36.467900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-455b30e5-9915-4055-87a6-a5b9c0600438 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:36.468352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-455b30e5-9915-4055-87a6-a5b9c0600438 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:36.468896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-455b30e5-9915-4055-87a6-a5b9c0600438 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:36.505330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-455b30e5-9915-4055-87a6-a5b9c0600438 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051616 Aug 24 05:16:36.506192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 839/1786] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:36 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:36.523068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a6561062-29cc-4b72-9f0a-89eeaceb8d73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:36.525262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a6561062-29cc-4b72-9f0a-89eeaceb8d73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:36.531651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6561062-29cc-4b72-9f0a-89eeaceb8d73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:36.532122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6561062-29cc-4b72-9f0a-89eeaceb8d73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:36.532551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6561062-29cc-4b72-9f0a-89eeaceb8d73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:36.533227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6561062-29cc-4b72-9f0a-89eeaceb8d73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:36.533667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6561062-29cc-4b72-9f0a-89eeaceb8d73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:36.534082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6561062-29cc-4b72-9f0a-89eeaceb8d73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:36.564023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a6561062-29cc-4b72-9f0a-89eeaceb8d73 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045027 Aug 24 05:16:36.564575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 948/1787] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:16:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:16:37.123128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e26b936c-a30c-4b2c-ada7-8f959b8aabcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:37.125703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e26b936c-a30c-4b2c-ada7-8f959b8aabcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:37.132887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e26b936c-a30c-4b2c-ada7-8f959b8aabcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:37.133407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e26b936c-a30c-4b2c-ada7-8f959b8aabcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:37.133932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e26b936c-a30c-4b2c-ada7-8f959b8aabcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:37.134756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e26b936c-a30c-4b2c-ada7-8f959b8aabcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:37.135344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e26b936c-a30c-4b2c-ada7-8f959b8aabcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:37.135811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e26b936c-a30c-4b2c-ada7-8f959b8aabcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:37.243097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e26b936c-a30c-4b2c-ada7-8f959b8aabcc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "POST /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/action" status: 200 len: 75942 microversion: 2.1 time: 0.124937 Aug 24 05:16:37.243646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 840/1788] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 05:16:37 2022] POST /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa/action => generated 75942 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:16:37.434046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-14210d02-60d9-4708-aa37-53d3f8931d6e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:37.434540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-14210d02-60d9-4708-aa37-53d3f8931d6e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:37.440539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14210d02-60d9-4708-aa37-53d3f8931d6e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:37.441010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14210d02-60d9-4708-aa37-53d3f8931d6e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:37.441442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14210d02-60d9-4708-aa37-53d3f8931d6e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:37.442126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14210d02-60d9-4708-aa37-53d3f8931d6e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:37.442572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14210d02-60d9-4708-aa37-53d3f8931d6e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:37.443038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14210d02-60d9-4708-aa37-53d3f8931d6e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:37.468970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-14210d02-60d9-4708-aa37-53d3f8931d6e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Going to try to terminate instance {{(pid=120558) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:16:37.519384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-20b2c218-992c-446e-b4a2-f306a7c0eee0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:37.521953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-20b2c218-992c-446e-b4a2-f306a7c0eee0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:37.529924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b2c218-992c-446e-b4a2-f306a7c0eee0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:37.530472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b2c218-992c-446e-b4a2-f306a7c0eee0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:37.530962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b2c218-992c-446e-b4a2-f306a7c0eee0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:37.531651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b2c218-992c-446e-b4a2-f306a7c0eee0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:37.532097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b2c218-992c-446e-b4a2-f306a7c0eee0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:37.532564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20b2c218-992c-446e-b4a2-f306a7c0eee0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:37.550967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-14210d02-60d9-4708-aa37-53d3f8931d6e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 204 len: 0 microversion: 2.1 time: 0.120430 Aug 24 05:16:37.552160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 949/1789] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:16:37 2022] DELETE /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:16:37.562863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-06fdeba1-1b35-4e27-84da-75552b12e464 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:37.564811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-06fdeba1-1b35-4e27-84da-75552b12e464 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:37.570379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fdeba1-1b35-4e27-84da-75552b12e464 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:37.571070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fdeba1-1b35-4e27-84da-75552b12e464 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:37.571589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fdeba1-1b35-4e27-84da-75552b12e464 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:37.572258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fdeba1-1b35-4e27-84da-75552b12e464 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:37.572692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fdeba1-1b35-4e27-84da-75552b12e464 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:37.573112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-06fdeba1-1b35-4e27-84da-75552b12e464 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:37.640299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-20b2c218-992c-446e-b4a2-f306a7c0eee0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "POST /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/action" status: 200 len: 83429 microversion: 2.1 time: 0.125177 Aug 24 05:16:37.641349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 841/1790] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 05:16:37 2022] POST /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5/action => generated 83429 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:16:37.645949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-97cb1784-eb58-4f90-92a1-8b69361f6f1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:16:37.649130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-97cb1784-eb58-4f90-92a1-8b69361f6f1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:37.656214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97cb1784-eb58-4f90-92a1-8b69361f6f1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:37.656691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97cb1784-eb58-4f90-92a1-8b69361f6f1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:37.657334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97cb1784-eb58-4f90-92a1-8b69361f6f1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:37.658008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97cb1784-eb58-4f90-92a1-8b69361f6f1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:37.660083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97cb1784-eb58-4f90-92a1-8b69361f6f1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:37.660520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97cb1784-eb58-4f90-92a1-8b69361f6f1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:37.758288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-97cb1784-eb58-4f90-92a1-8b69361f6f1f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/action" status: 200 len: 41195 microversion: 2.1 time: 0.115890 Aug 24 05:16:37.758972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 842/1791] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 05:16:37 2022] POST /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053/action => generated 41195 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:16:37.760239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-06fdeba1-1b35-4e27-84da-75552b12e464 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:37.768621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-06fdeba1-1b35-4e27-84da-75552b12e464 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.211297 Aug 24 05:16:37.769181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 950/1792] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:37 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:16:38.791864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-66d93330-1fca-4ee9-825b-0bf1d8922437 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:38.792593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-66d93330-1fca-4ee9-825b-0bf1d8922437 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:38.800262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d93330-1fca-4ee9-825b-0bf1d8922437 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:38.800739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d93330-1fca-4ee9-825b-0bf1d8922437 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:38.801209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d93330-1fca-4ee9-825b-0bf1d8922437 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:38.801901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d93330-1fca-4ee9-825b-0bf1d8922437 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:38.802360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d93330-1fca-4ee9-825b-0bf1d8922437 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:38.803069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d93330-1fca-4ee9-825b-0bf1d8922437 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:38.997271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-66d93330-1fca-4ee9-825b-0bf1d8922437 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:39.005460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-66d93330-1fca-4ee9-825b-0bf1d8922437 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.218642 Aug 24 05:16:39.006015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 843/1793] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:38 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:39.370256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f58280eb-7792-463a-9bbd-c71852c32891 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] Calling method '.version_select at 0x7f3590ed9670>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:39.396209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f58280eb-7792-463a-9bbd-c71852c32891 tempest-TestVolumeBootPattern-160960211 tempest-TestVolumeBootPattern-160960211-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-776612737" status: 202 len: 0 microversion: 2.1 time: 0.030228 Aug 24 05:16:39.399363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 951/1794] 10.222.0.97 () {58 vars in 1260 bytes} [Wed Aug 24 05:16:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-776612737 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:16:40.027600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-46e86b2d-2e93-44f6-948c-36eb107cfc28 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:40.028271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-46e86b2d-2e93-44f6-948c-36eb107cfc28 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:40.036011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46e86b2d-2e93-44f6-948c-36eb107cfc28 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:40.036500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46e86b2d-2e93-44f6-948c-36eb107cfc28 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:40.036941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46e86b2d-2e93-44f6-948c-36eb107cfc28 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:40.037649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46e86b2d-2e93-44f6-948c-36eb107cfc28 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:40.038103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46e86b2d-2e93-44f6-948c-36eb107cfc28 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:40.039222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46e86b2d-2e93-44f6-948c-36eb107cfc28 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:40.202820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-46e86b2d-2e93-44f6-948c-36eb107cfc28 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:40.218827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-46e86b2d-2e93-44f6-948c-36eb107cfc28 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.195603 Aug 24 05:16:40.219601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 844/1795] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:40 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:16:41.242772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-75f13010-6e48-43e6-9a6b-ec6b1b01dd2c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:41.243376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-75f13010-6e48-43e6-9a6b-ec6b1b01dd2c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:41.245426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:41.253012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75f13010-6e48-43e6-9a6b-ec6b1b01dd2c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:41.253012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75f13010-6e48-43e6-9a6b-ec6b1b01dd2c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:41.253464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75f13010-6e48-43e6-9a6b-ec6b1b01dd2c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:41.254372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75f13010-6e48-43e6-9a6b-ec6b1b01dd2c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:41.254864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75f13010-6e48-43e6-9a6b-ec6b1b01dd2c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:41.255281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75f13010-6e48-43e6-9a6b-ec6b1b01dd2c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:41.403009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-75f13010-6e48-43e6-9a6b-ec6b1b01dd2c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:41.415770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-75f13010-6e48-43e6-9a6b-ec6b1b01dd2c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.177811 Aug 24 05:16:41.416936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 952/1796] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:41 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:42.449220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c448b9a8-c48f-4c68-88a6-1ebcc60b2037 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:42.451062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c448b9a8-c48f-4c68-88a6-1ebcc60b2037 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:42.458357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c448b9a8-c48f-4c68-88a6-1ebcc60b2037 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:42.459635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c448b9a8-c48f-4c68-88a6-1ebcc60b2037 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:42.460333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c448b9a8-c48f-4c68-88a6-1ebcc60b2037 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:42.461154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c448b9a8-c48f-4c68-88a6-1ebcc60b2037 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:42.461855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c448b9a8-c48f-4c68-88a6-1ebcc60b2037 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:42.462475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c448b9a8-c48f-4c68-88a6-1ebcc60b2037 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:42.647296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c448b9a8-c48f-4c68-88a6-1ebcc60b2037 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:42.659671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c448b9a8-c48f-4c68-88a6-1ebcc60b2037 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.216958 Aug 24 05:16:42.660718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 845/1797] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:42 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:43.682425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3d20641d-b852-47f0-8510-298cbbd9682a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:43.683135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3d20641d-b852-47f0-8510-298cbbd9682a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:43.693911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d20641d-b852-47f0-8510-298cbbd9682a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:43.695238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d20641d-b852-47f0-8510-298cbbd9682a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:43.695756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d20641d-b852-47f0-8510-298cbbd9682a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:43.699488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d20641d-b852-47f0-8510-298cbbd9682a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:43.699963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d20641d-b852-47f0-8510-298cbbd9682a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:43.700402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d20641d-b852-47f0-8510-298cbbd9682a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:43.860592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3d20641d-b852-47f0-8510-298cbbd9682a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:43.869766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3d20641d-b852-47f0-8510-298cbbd9682a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.192033 Aug 24 05:16:43.870328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 953/1798] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:43 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:44.893676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3c761a66-441e-44d2-995a-44c39437b24a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:44.894842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3c761a66-441e-44d2-995a-44c39437b24a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:44.905119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c761a66-441e-44d2-995a-44c39437b24a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:44.905849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c761a66-441e-44d2-995a-44c39437b24a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:44.906495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c761a66-441e-44d2-995a-44c39437b24a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:44.907508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c761a66-441e-44d2-995a-44c39437b24a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:44.908183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c761a66-441e-44d2-995a-44c39437b24a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:44.908750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c761a66-441e-44d2-995a-44c39437b24a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:45.153889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c761a66-441e-44d2-995a-44c39437b24a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:45.169645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3c761a66-441e-44d2-995a-44c39437b24a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.281132 Aug 24 05:16:45.171005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 846/1799] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:44 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:46.195061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8216d34e-75e8-418c-9210-dfaef8344cba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:46.195950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8216d34e-75e8-418c-9210-dfaef8344cba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:46.202385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8216d34e-75e8-418c-9210-dfaef8344cba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:46.203474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8216d34e-75e8-418c-9210-dfaef8344cba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:46.203909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8216d34e-75e8-418c-9210-dfaef8344cba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:46.204609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8216d34e-75e8-418c-9210-dfaef8344cba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:46.205576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8216d34e-75e8-418c-9210-dfaef8344cba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:46.206001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8216d34e-75e8-418c-9210-dfaef8344cba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:46.458098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8216d34e-75e8-418c-9210-dfaef8344cba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:46.472603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8216d34e-75e8-418c-9210-dfaef8344cba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.281937 Aug 24 05:16:46.473473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 954/1800] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:46 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:47.494357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5b0e5bc7-4970-449b-a389-42230e72fac2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:47.496107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5b0e5bc7-4970-449b-a389-42230e72fac2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:47.502628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b0e5bc7-4970-449b-a389-42230e72fac2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:47.503142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b0e5bc7-4970-449b-a389-42230e72fac2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:47.503578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b0e5bc7-4970-449b-a389-42230e72fac2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:47.508105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b0e5bc7-4970-449b-a389-42230e72fac2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:47.508712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b0e5bc7-4970-449b-a389-42230e72fac2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:47.509000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5b0e5bc7-4970-449b-a389-42230e72fac2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:47.647026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5b0e5bc7-4970-449b-a389-42230e72fac2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:47.655489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5b0e5bc7-4970-449b-a389-42230e72fac2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.165789 Aug 24 05:16:47.656063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 847/1801] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:47 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:48.679358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8a15a7ef-bb58-4c93-ace2-b90366aea0e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:48.679896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8a15a7ef-bb58-4c93-ace2-b90366aea0e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:48.686398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a15a7ef-bb58-4c93-ace2-b90366aea0e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:48.686918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a15a7ef-bb58-4c93-ace2-b90366aea0e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:48.687356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a15a7ef-bb58-4c93-ace2-b90366aea0e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:48.688043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a15a7ef-bb58-4c93-ace2-b90366aea0e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:48.688495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a15a7ef-bb58-4c93-ace2-b90366aea0e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:48.688917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a15a7ef-bb58-4c93-ace2-b90366aea0e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:48.830119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8a15a7ef-bb58-4c93-ace2-b90366aea0e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:48.841401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8a15a7ef-bb58-4c93-ace2-b90366aea0e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.166367 Aug 24 05:16:48.842099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 955/1802] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:48 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:49.862029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2d3d5a6d-6d08-4854-ad4b-e2aca40431bd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:49.862634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2d3d5a6d-6d08-4854-ad4b-e2aca40431bd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:49.869348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d3d5a6d-6d08-4854-ad4b-e2aca40431bd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:49.869825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d3d5a6d-6d08-4854-ad4b-e2aca40431bd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:49.870257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d3d5a6d-6d08-4854-ad4b-e2aca40431bd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:49.870967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d3d5a6d-6d08-4854-ad4b-e2aca40431bd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:49.871417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d3d5a6d-6d08-4854-ad4b-e2aca40431bd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:49.871842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2d3d5a6d-6d08-4854-ad4b-e2aca40431bd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:50.005446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2d3d5a6d-6d08-4854-ad4b-e2aca40431bd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:50.014173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2d3d5a6d-6d08-4854-ad4b-e2aca40431bd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156048 Aug 24 05:16:50.014741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 848/1803] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:49 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:51.035752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ca1a80b7-cdb3-4121-ad4d-484b33d19d13 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:51.036333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ca1a80b7-cdb3-4121-ad4d-484b33d19d13 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:51.043743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1a80b7-cdb3-4121-ad4d-484b33d19d13 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:51.044226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1a80b7-cdb3-4121-ad4d-484b33d19d13 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:51.044665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1a80b7-cdb3-4121-ad4d-484b33d19d13 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:51.045384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1a80b7-cdb3-4121-ad4d-484b33d19d13 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:51.045835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1a80b7-cdb3-4121-ad4d-484b33d19d13 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:51.046261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1a80b7-cdb3-4121-ad4d-484b33d19d13 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:51.178963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ca1a80b7-cdb3-4121-ad4d-484b33d19d13 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:51.187266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ca1a80b7-cdb3-4121-ad4d-484b33d19d13 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155407 Aug 24 05:16:51.187825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 956/1804] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:51 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:52.209878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8a8823c3-fccd-46f4-8a28-6bf86197c5d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:52.210489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8a8823c3-fccd-46f4-8a28-6bf86197c5d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:52.217050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a8823c3-fccd-46f4-8a28-6bf86197c5d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:52.217549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a8823c3-fccd-46f4-8a28-6bf86197c5d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:52.217980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a8823c3-fccd-46f4-8a28-6bf86197c5d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:52.218665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a8823c3-fccd-46f4-8a28-6bf86197c5d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:52.219138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a8823c3-fccd-46f4-8a28-6bf86197c5d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:52.219558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a8823c3-fccd-46f4-8a28-6bf86197c5d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:52.354517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8a8823c3-fccd-46f4-8a28-6bf86197c5d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:52.362773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8a8823c3-fccd-46f4-8a28-6bf86197c5d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156757 Aug 24 05:16:52.363340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 849/1805] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:52 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:53.384372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b5b1dbbd-b866-4f27-80f1-c7a0dfba4f33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:53.384987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b5b1dbbd-b866-4f27-80f1-c7a0dfba4f33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:53.391563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5b1dbbd-b866-4f27-80f1-c7a0dfba4f33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:53.392043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5b1dbbd-b866-4f27-80f1-c7a0dfba4f33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:53.392478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5b1dbbd-b866-4f27-80f1-c7a0dfba4f33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:53.393165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5b1dbbd-b866-4f27-80f1-c7a0dfba4f33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:53.393614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5b1dbbd-b866-4f27-80f1-c7a0dfba4f33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:53.394034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5b1dbbd-b866-4f27-80f1-c7a0dfba4f33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:53.523552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b5b1dbbd-b866-4f27-80f1-c7a0dfba4f33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:53.531745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b5b1dbbd-b866-4f27-80f1-c7a0dfba4f33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.151462 Aug 24 05:16:53.532301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 957/1806] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:53 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:54.554669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7f2102f6-222f-4620-829c-102eca44ce60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:54.555301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7f2102f6-222f-4620-829c-102eca44ce60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:54.561669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f2102f6-222f-4620-829c-102eca44ce60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:54.562149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f2102f6-222f-4620-829c-102eca44ce60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:54.562592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f2102f6-222f-4620-829c-102eca44ce60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:54.563306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f2102f6-222f-4620-829c-102eca44ce60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:54.563759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f2102f6-222f-4620-829c-102eca44ce60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:54.564184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f2102f6-222f-4620-829c-102eca44ce60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:54.703301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7f2102f6-222f-4620-829c-102eca44ce60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:54.711674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7f2102f6-222f-4620-829c-102eca44ce60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161927 Aug 24 05:16:54.712252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 850/1807] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:54 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:55.732704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0fe59c3a-4a66-4db0-8fe1-a184d9873bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:55.733315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0fe59c3a-4a66-4db0-8fe1-a184d9873bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:55.739860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe59c3a-4a66-4db0-8fe1-a184d9873bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:55.740338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe59c3a-4a66-4db0-8fe1-a184d9873bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:55.740778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe59c3a-4a66-4db0-8fe1-a184d9873bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:55.741517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe59c3a-4a66-4db0-8fe1-a184d9873bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:55.741965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe59c3a-4a66-4db0-8fe1-a184d9873bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:55.742384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe59c3a-4a66-4db0-8fe1-a184d9873bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:55.875469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0fe59c3a-4a66-4db0-8fe1-a184d9873bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:55.884217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0fe59c3a-4a66-4db0-8fe1-a184d9873bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155307 Aug 24 05:16:55.884803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 958/1808] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:55 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:56.905398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5836db23-1379-43b7-b412-08720d2d36bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:56.906015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5836db23-1379-43b7-b412-08720d2d36bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:56.912451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5836db23-1379-43b7-b412-08720d2d36bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:56.913494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5836db23-1379-43b7-b412-08720d2d36bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:56.914040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5836db23-1379-43b7-b412-08720d2d36bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:56.914845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5836db23-1379-43b7-b412-08720d2d36bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:56.915302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5836db23-1379-43b7-b412-08720d2d36bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:56.915723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5836db23-1379-43b7-b412-08720d2d36bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:57.044876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5836db23-1379-43b7-b412-08720d2d36bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:57.053305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5836db23-1379-43b7-b412-08720d2d36bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.151769 Aug 24 05:16:57.053990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 851/1809] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:56 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:58.075280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f78a7b9e-d7fc-4287-99f8-cd338c9a0599 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:58.075867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f78a7b9e-d7fc-4287-99f8-cd338c9a0599 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:58.082879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f78a7b9e-d7fc-4287-99f8-cd338c9a0599 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:58.083360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f78a7b9e-d7fc-4287-99f8-cd338c9a0599 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:58.083795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f78a7b9e-d7fc-4287-99f8-cd338c9a0599 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:58.084480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f78a7b9e-d7fc-4287-99f8-cd338c9a0599 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:58.085093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f78a7b9e-d7fc-4287-99f8-cd338c9a0599 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:58.085560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f78a7b9e-d7fc-4287-99f8-cd338c9a0599 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:58.089859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:16:58.221091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f78a7b9e-d7fc-4287-99f8-cd338c9a0599 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:58.229953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f78a7b9e-d7fc-4287-99f8-cd338c9a0599 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158534 Aug 24 05:16:58.230510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 959/1810] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:58 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:16:59.251928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-015f95f4-96f1-4f8c-a5f5-2a9d38bf0149 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:16:59.252490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-015f95f4-96f1-4f8c-a5f5-2a9d38bf0149 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:16:59.259766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015f95f4-96f1-4f8c-a5f5-2a9d38bf0149 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:59.260244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015f95f4-96f1-4f8c-a5f5-2a9d38bf0149 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:59.260677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015f95f4-96f1-4f8c-a5f5-2a9d38bf0149 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:59.261360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015f95f4-96f1-4f8c-a5f5-2a9d38bf0149 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:16:59.261809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015f95f4-96f1-4f8c-a5f5-2a9d38bf0149 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:16:59.262229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015f95f4-96f1-4f8c-a5f5-2a9d38bf0149 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:16:59.392523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-015f95f4-96f1-4f8c-a5f5-2a9d38bf0149 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:16:59.400954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-015f95f4-96f1-4f8c-a5f5-2a9d38bf0149 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153053 Aug 24 05:16:59.401518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 852/1811] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:16:59 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:17:00.421958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-89b410ce-d821-4956-aced-93a2821b69e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:00.422566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-89b410ce-d821-4956-aced-93a2821b69e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:00.430017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b410ce-d821-4956-aced-93a2821b69e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:00.430513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b410ce-d821-4956-aced-93a2821b69e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:00.430979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b410ce-d821-4956-aced-93a2821b69e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:00.431667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b410ce-d821-4956-aced-93a2821b69e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:00.432121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b410ce-d821-4956-aced-93a2821b69e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:00.432539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89b410ce-d821-4956-aced-93a2821b69e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:00.563361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-89b410ce-d821-4956-aced-93a2821b69e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:00.571755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-89b410ce-d821-4956-aced-93a2821b69e8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153715 Aug 24 05:17:00.572327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 960/1812] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:00 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:01.592689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-24d5c6a4-49b9-4744-8994-a57f70565021 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:01.593303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-24d5c6a4-49b9-4744-8994-a57f70565021 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:01.599934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d5c6a4-49b9-4744-8994-a57f70565021 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:01.600481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d5c6a4-49b9-4744-8994-a57f70565021 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:01.601014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d5c6a4-49b9-4744-8994-a57f70565021 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:01.601706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d5c6a4-49b9-4744-8994-a57f70565021 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:01.602163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d5c6a4-49b9-4744-8994-a57f70565021 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:01.602589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d5c6a4-49b9-4744-8994-a57f70565021 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:01.620958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:01.730816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-24d5c6a4-49b9-4744-8994-a57f70565021 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:01.739173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-24d5c6a4-49b9-4744-8994-a57f70565021 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.150386 Aug 24 05:17:01.739734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 853/1813] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:01 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:02.761471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e2945215-a198-45c3-b8f6-9bb033f5907e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:02.762082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e2945215-a198-45c3-b8f6-9bb033f5907e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:02.768565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2945215-a198-45c3-b8f6-9bb033f5907e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:02.769041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2945215-a198-45c3-b8f6-9bb033f5907e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:02.769475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2945215-a198-45c3-b8f6-9bb033f5907e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:02.770175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2945215-a198-45c3-b8f6-9bb033f5907e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:02.770608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2945215-a198-45c3-b8f6-9bb033f5907e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:02.771055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2945215-a198-45c3-b8f6-9bb033f5907e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:02.907251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e2945215-a198-45c3-b8f6-9bb033f5907e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:02.916221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e2945215-a198-45c3-b8f6-9bb033f5907e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158715 Aug 24 05:17:02.916799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 961/1814] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:02 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:03.938818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-15459d76-cec7-477d-8238-5728a5a55469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:03.939441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-15459d76-cec7-477d-8238-5728a5a55469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:03.945934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15459d76-cec7-477d-8238-5728a5a55469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:03.946424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15459d76-cec7-477d-8238-5728a5a55469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:03.946897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15459d76-cec7-477d-8238-5728a5a55469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:03.947589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15459d76-cec7-477d-8238-5728a5a55469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:03.948040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15459d76-cec7-477d-8238-5728a5a55469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:03.948469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15459d76-cec7-477d-8238-5728a5a55469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:04.080150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-15459d76-cec7-477d-8238-5728a5a55469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:04.089046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-15459d76-cec7-477d-8238-5728a5a55469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154144 Aug 24 05:17:04.089603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 854/1815] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:03 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:05.109710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a15bd3c1-abc3-487d-a5d3-bb293685357f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:05.110315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a15bd3c1-abc3-487d-a5d3-bb293685357f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:05.117379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a15bd3c1-abc3-487d-a5d3-bb293685357f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:05.117849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a15bd3c1-abc3-487d-a5d3-bb293685357f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:05.118282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a15bd3c1-abc3-487d-a5d3-bb293685357f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:05.119042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a15bd3c1-abc3-487d-a5d3-bb293685357f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:05.119491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a15bd3c1-abc3-487d-a5d3-bb293685357f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:05.119910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a15bd3c1-abc3-487d-a5d3-bb293685357f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:05.247898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a15bd3c1-abc3-487d-a5d3-bb293685357f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:05.256241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a15bd3c1-abc3-487d-a5d3-bb293685357f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.150412 Aug 24 05:17:05.256860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 962/1816] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:05 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:06.280693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-85419b88-0853-4a45-876f-31f56050aa8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:06.281220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-85419b88-0853-4a45-876f-31f56050aa8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:06.283558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=34 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:06.289537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85419b88-0853-4a45-876f-31f56050aa8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:06.290020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85419b88-0853-4a45-876f-31f56050aa8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:06.290496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85419b88-0853-4a45-876f-31f56050aa8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:06.291206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85419b88-0853-4a45-876f-31f56050aa8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:06.291649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85419b88-0853-4a45-876f-31f56050aa8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:06.292063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85419b88-0853-4a45-876f-31f56050aa8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:06.422286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-85419b88-0853-4a45-876f-31f56050aa8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:06.431279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-85419b88-0853-4a45-876f-31f56050aa8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156292 Aug 24 05:17:06.431851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 855/1817] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:06 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:07.452373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-51d5d3db-3e9d-4600-8c7b-1c2bc28d8360 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:07.452975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-51d5d3db-3e9d-4600-8c7b-1c2bc28d8360 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:07.459391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51d5d3db-3e9d-4600-8c7b-1c2bc28d8360 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:07.460505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51d5d3db-3e9d-4600-8c7b-1c2bc28d8360 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:07.460920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51d5d3db-3e9d-4600-8c7b-1c2bc28d8360 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:07.461608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51d5d3db-3e9d-4600-8c7b-1c2bc28d8360 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:07.462058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51d5d3db-3e9d-4600-8c7b-1c2bc28d8360 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:07.462474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-51d5d3db-3e9d-4600-8c7b-1c2bc28d8360 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:07.594373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-51d5d3db-3e9d-4600-8c7b-1c2bc28d8360 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:07.602956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-51d5d3db-3e9d-4600-8c7b-1c2bc28d8360 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154366 Aug 24 05:17:07.603508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 963/1818] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:07 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:08.624783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ad4221d1-9fea-404d-8e77-04a45542ea3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:08.625436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ad4221d1-9fea-404d-8e77-04a45542ea3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:08.632875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad4221d1-9fea-404d-8e77-04a45542ea3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:08.633348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad4221d1-9fea-404d-8e77-04a45542ea3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:08.633772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad4221d1-9fea-404d-8e77-04a45542ea3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:08.634442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad4221d1-9fea-404d-8e77-04a45542ea3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:08.634919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad4221d1-9fea-404d-8e77-04a45542ea3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:08.635334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad4221d1-9fea-404d-8e77-04a45542ea3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:08.768363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ad4221d1-9fea-404d-8e77-04a45542ea3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:08.776671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ad4221d1-9fea-404d-8e77-04a45542ea3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155674 Aug 24 05:17:08.777232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 856/1819] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:08 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:09.798299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3d6e84cc-0f66-493b-8553-ab705d10ffc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:09.798862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3d6e84cc-0f66-493b-8553-ab705d10ffc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:09.806280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d6e84cc-0f66-493b-8553-ab705d10ffc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:09.806800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d6e84cc-0f66-493b-8553-ab705d10ffc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:09.807236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d6e84cc-0f66-493b-8553-ab705d10ffc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:09.807921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d6e84cc-0f66-493b-8553-ab705d10ffc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:09.808366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d6e84cc-0f66-493b-8553-ab705d10ffc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:09.808785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d6e84cc-0f66-493b-8553-ab705d10ffc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:09.940133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3d6e84cc-0f66-493b-8553-ab705d10ffc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:09.949032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3d6e84cc-0f66-493b-8553-ab705d10ffc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154779 Aug 24 05:17:09.949597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 964/1820] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:09 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:10.970213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d453c279-190b-4ebb-a7f2-6c1aac865130 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:10.970845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d453c279-190b-4ebb-a7f2-6c1aac865130 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:10.977924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d453c279-190b-4ebb-a7f2-6c1aac865130 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:10.978394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d453c279-190b-4ebb-a7f2-6c1aac865130 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:10.978864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d453c279-190b-4ebb-a7f2-6c1aac865130 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:10.979543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d453c279-190b-4ebb-a7f2-6c1aac865130 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:10.979991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d453c279-190b-4ebb-a7f2-6c1aac865130 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:10.980410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d453c279-190b-4ebb-a7f2-6c1aac865130 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:11.111701 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d453c279-190b-4ebb-a7f2-6c1aac865130 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:11.121201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d453c279-190b-4ebb-a7f2-6c1aac865130 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154867 Aug 24 05:17:11.121760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 857/1821] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:10 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:12.142414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-21558bff-71b1-469f-ae7c-b2b2d0830dbf tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:12.143037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-21558bff-71b1-469f-ae7c-b2b2d0830dbf tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:12.145331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:12.151088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21558bff-71b1-469f-ae7c-b2b2d0830dbf tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:12.151563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21558bff-71b1-469f-ae7c-b2b2d0830dbf tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:12.152001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21558bff-71b1-469f-ae7c-b2b2d0830dbf tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:12.152664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21558bff-71b1-469f-ae7c-b2b2d0830dbf tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:12.153109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21558bff-71b1-469f-ae7c-b2b2d0830dbf tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:12.153524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21558bff-71b1-469f-ae7c-b2b2d0830dbf tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:12.282555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-21558bff-71b1-469f-ae7c-b2b2d0830dbf tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:12.291345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-21558bff-71b1-469f-ae7c-b2b2d0830dbf tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152817 Aug 24 05:17:12.291902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 965/1822] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:12 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:13.312656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4c49d9c6-cc37-45fd-8af1-4b7647a77541 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:13.313268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4c49d9c6-cc37-45fd-8af1-4b7647a77541 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:13.319951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c49d9c6-cc37-45fd-8af1-4b7647a77541 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:13.320433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c49d9c6-cc37-45fd-8af1-4b7647a77541 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:13.320869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c49d9c6-cc37-45fd-8af1-4b7647a77541 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:13.321557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c49d9c6-cc37-45fd-8af1-4b7647a77541 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:13.322011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c49d9c6-cc37-45fd-8af1-4b7647a77541 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:13.322430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c49d9c6-cc37-45fd-8af1-4b7647a77541 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:13.460337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4c49d9c6-cc37-45fd-8af1-4b7647a77541 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:13.468674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4c49d9c6-cc37-45fd-8af1-4b7647a77541 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159912 Aug 24 05:17:13.469234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 858/1823] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:13 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:14.490339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4982a473-d15e-41bf-acf5-a9d1c7c954f0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:14.491769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4982a473-d15e-41bf-acf5-a9d1c7c954f0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:14.498399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4982a473-d15e-41bf-acf5-a9d1c7c954f0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:14.498917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4982a473-d15e-41bf-acf5-a9d1c7c954f0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:14.499353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4982a473-d15e-41bf-acf5-a9d1c7c954f0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:14.500042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4982a473-d15e-41bf-acf5-a9d1c7c954f0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:14.500493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4982a473-d15e-41bf-acf5-a9d1c7c954f0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:14.500914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4982a473-d15e-41bf-acf5-a9d1c7c954f0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:14.634537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4982a473-d15e-41bf-acf5-a9d1c7c954f0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:14.642858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4982a473-d15e-41bf-acf5-a9d1c7c954f0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156319 Aug 24 05:17:14.643408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 966/1824] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:14 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:15.663261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-65b10f9e-2071-4c3d-9ffc-d5e161a4eaf3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:15.663878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-65b10f9e-2071-4c3d-9ffc-d5e161a4eaf3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:15.670316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b10f9e-2071-4c3d-9ffc-d5e161a4eaf3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:15.670830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b10f9e-2071-4c3d-9ffc-d5e161a4eaf3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:15.671287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b10f9e-2071-4c3d-9ffc-d5e161a4eaf3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:15.671973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b10f9e-2071-4c3d-9ffc-d5e161a4eaf3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:15.672424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b10f9e-2071-4c3d-9ffc-d5e161a4eaf3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:15.672847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b10f9e-2071-4c3d-9ffc-d5e161a4eaf3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:15.805225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-65b10f9e-2071-4c3d-9ffc-d5e161a4eaf3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:15.813532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-65b10f9e-2071-4c3d-9ffc-d5e161a4eaf3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154428 Aug 24 05:17:15.814100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 859/1825] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:15 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:16.836245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-da27dd5e-d896-47d2-ab1e-7295ce0f038a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:16.836790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-da27dd5e-d896-47d2-ab1e-7295ce0f038a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:16.843071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da27dd5e-d896-47d2-ab1e-7295ce0f038a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:16.843558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da27dd5e-d896-47d2-ab1e-7295ce0f038a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:16.843988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da27dd5e-d896-47d2-ab1e-7295ce0f038a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:16.844670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da27dd5e-d896-47d2-ab1e-7295ce0f038a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:16.845122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da27dd5e-d896-47d2-ab1e-7295ce0f038a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:16.845538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da27dd5e-d896-47d2-ab1e-7295ce0f038a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:16.976453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-da27dd5e-d896-47d2-ab1e-7295ce0f038a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:16.984625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-da27dd5e-d896-47d2-ab1e-7295ce0f038a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152939 Aug 24 05:17:16.985399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 967/1826] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:16 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:18.005973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9569e097-a901-492e-a8ca-e0a70f3b8446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:18.006811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9569e097-a901-492e-a8ca-e0a70f3b8446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:18.013108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9569e097-a901-492e-a8ca-e0a70f3b8446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:18.013588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9569e097-a901-492e-a8ca-e0a70f3b8446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:18.014021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9569e097-a901-492e-a8ca-e0a70f3b8446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:18.014728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9569e097-a901-492e-a8ca-e0a70f3b8446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:18.015182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9569e097-a901-492e-a8ca-e0a70f3b8446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:18.015602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9569e097-a901-492e-a8ca-e0a70f3b8446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:18.151294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9569e097-a901-492e-a8ca-e0a70f3b8446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:18.159454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9569e097-a901-492e-a8ca-e0a70f3b8446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157357 Aug 24 05:17:18.160020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 860/1827] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:18 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:19.181937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3c76d4a9-5e4e-4a3c-a60b-e3445d3d92b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:19.182546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3c76d4a9-5e4e-4a3c-a60b-e3445d3d92b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:19.188998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c76d4a9-5e4e-4a3c-a60b-e3445d3d92b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:19.189475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c76d4a9-5e4e-4a3c-a60b-e3445d3d92b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:19.189909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c76d4a9-5e4e-4a3c-a60b-e3445d3d92b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:19.190622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c76d4a9-5e4e-4a3c-a60b-e3445d3d92b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:19.191101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c76d4a9-5e4e-4a3c-a60b-e3445d3d92b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:19.191533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c76d4a9-5e4e-4a3c-a60b-e3445d3d92b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:19.329979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3c76d4a9-5e4e-4a3c-a60b-e3445d3d92b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:19.338130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3c76d4a9-5e4e-4a3c-a60b-e3445d3d92b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161036 Aug 24 05:17:19.338807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 968/1828] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:19 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:20.360130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d899a623-d6a5-4be0-954b-409cdf3ab0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:20.360744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d899a623-d6a5-4be0-954b-409cdf3ab0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:20.368200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d899a623-d6a5-4be0-954b-409cdf3ab0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:20.368686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d899a623-d6a5-4be0-954b-409cdf3ab0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:20.369120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d899a623-d6a5-4be0-954b-409cdf3ab0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:20.369807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d899a623-d6a5-4be0-954b-409cdf3ab0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:20.370260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d899a623-d6a5-4be0-954b-409cdf3ab0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:20.370698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d899a623-d6a5-4be0-954b-409cdf3ab0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:20.513469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d899a623-d6a5-4be0-954b-409cdf3ab0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:20.525109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d899a623-d6a5-4be0-954b-409cdf3ab0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.168962 Aug 24 05:17:20.525684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 861/1829] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:20 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:21.549131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8dedfeb0-be78-408c-b514-14147f5c3eea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:21.549720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8dedfeb0-be78-408c-b514-14147f5c3eea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:21.556601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8dedfeb0-be78-408c-b514-14147f5c3eea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:21.557073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8dedfeb0-be78-408c-b514-14147f5c3eea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:21.557495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8dedfeb0-be78-408c-b514-14147f5c3eea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:21.558170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8dedfeb0-be78-408c-b514-14147f5c3eea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:21.558608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8dedfeb0-be78-408c-b514-14147f5c3eea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:21.559046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8dedfeb0-be78-408c-b514-14147f5c3eea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:21.705323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8dedfeb0-be78-408c-b514-14147f5c3eea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:21.714264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8dedfeb0-be78-408c-b514-14147f5c3eea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.170465 Aug 24 05:17:21.715489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 969/1830] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:21 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:22.736596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e2974ed9-7280-42fe-931c-9a86a0172000 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:22.737203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e2974ed9-7280-42fe-931c-9a86a0172000 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:22.743891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2974ed9-7280-42fe-931c-9a86a0172000 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:22.744371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2974ed9-7280-42fe-931c-9a86a0172000 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:22.744798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2974ed9-7280-42fe-931c-9a86a0172000 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:22.745482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2974ed9-7280-42fe-931c-9a86a0172000 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:22.745932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2974ed9-7280-42fe-931c-9a86a0172000 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:22.746351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2974ed9-7280-42fe-931c-9a86a0172000 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:22.875869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e2974ed9-7280-42fe-931c-9a86a0172000 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:22.884402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e2974ed9-7280-42fe-931c-9a86a0172000 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.151811 Aug 24 05:17:22.884970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 862/1831] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:22 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:23.906467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fe793bf5-9072-46f9-8792-a0a10c19930f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:23.907074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fe793bf5-9072-46f9-8792-a0a10c19930f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:23.914017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe793bf5-9072-46f9-8792-a0a10c19930f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:23.914488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe793bf5-9072-46f9-8792-a0a10c19930f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:23.914944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe793bf5-9072-46f9-8792-a0a10c19930f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:23.915695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe793bf5-9072-46f9-8792-a0a10c19930f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:23.916145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe793bf5-9072-46f9-8792-a0a10c19930f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:23.916568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe793bf5-9072-46f9-8792-a0a10c19930f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:24.061787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fe793bf5-9072-46f9-8792-a0a10c19930f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:24.070469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fe793bf5-9072-46f9-8792-a0a10c19930f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.167890 Aug 24 05:17:24.071091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 970/1832] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:23 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:25.092652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-474715f5-5f94-4cbf-9739-13363caf19bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:25.093252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-474715f5-5f94-4cbf-9739-13363caf19bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:25.099767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474715f5-5f94-4cbf-9739-13363caf19bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:25.100310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474715f5-5f94-4cbf-9739-13363caf19bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:25.100744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474715f5-5f94-4cbf-9739-13363caf19bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:25.101428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474715f5-5f94-4cbf-9739-13363caf19bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:25.101878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474715f5-5f94-4cbf-9739-13363caf19bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:25.102302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474715f5-5f94-4cbf-9739-13363caf19bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:25.239479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-474715f5-5f94-4cbf-9739-13363caf19bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:25.252436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-474715f5-5f94-4cbf-9739-13363caf19bb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.163561 Aug 24 05:17:25.253024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 863/1833] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:25 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:26.276414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-125cfc42-0bc0-4fda-a692-7480b32c22b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:26.277069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-125cfc42-0bc0-4fda-a692-7480b32c22b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:26.283533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-125cfc42-0bc0-4fda-a692-7480b32c22b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:26.284008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-125cfc42-0bc0-4fda-a692-7480b32c22b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:26.284438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-125cfc42-0bc0-4fda-a692-7480b32c22b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:26.285119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-125cfc42-0bc0-4fda-a692-7480b32c22b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:26.285563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-125cfc42-0bc0-4fda-a692-7480b32c22b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:26.285981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-125cfc42-0bc0-4fda-a692-7480b32c22b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:26.431225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-125cfc42-0bc0-4fda-a692-7480b32c22b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:26.440080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-125cfc42-0bc0-4fda-a692-7480b32c22b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.168036 Aug 24 05:17:26.440664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 971/1834] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:26 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:17:26.734539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:17:26.735139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:17:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:17:27.465817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-23991afa-c362-462d-9618-a5adb1122498 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:27.466427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-23991afa-c362-462d-9618-a5adb1122498 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:27.473650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23991afa-c362-462d-9618-a5adb1122498 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:27.474135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23991afa-c362-462d-9618-a5adb1122498 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:27.474572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23991afa-c362-462d-9618-a5adb1122498 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:27.475956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23991afa-c362-462d-9618-a5adb1122498 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:27.476488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23991afa-c362-462d-9618-a5adb1122498 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:27.476913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23991afa-c362-462d-9618-a5adb1122498 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:27.624133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-23991afa-c362-462d-9618-a5adb1122498 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:27.632866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-23991afa-c362-462d-9618-a5adb1122498 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.170864 Aug 24 05:17:27.633469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 864/1835] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:27 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:17:28.660963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-35321add-193d-4f4a-8227-bea75fd5d35e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:28.663254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-35321add-193d-4f4a-8227-bea75fd5d35e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:28.670385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35321add-193d-4f4a-8227-bea75fd5d35e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:28.670385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35321add-193d-4f4a-8227-bea75fd5d35e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:28.670985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35321add-193d-4f4a-8227-bea75fd5d35e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:28.671521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35321add-193d-4f4a-8227-bea75fd5d35e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:28.671970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35321add-193d-4f4a-8227-bea75fd5d35e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:28.672395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35321add-193d-4f4a-8227-bea75fd5d35e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:28.675138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=77 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:28.811753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-35321add-193d-4f4a-8227-bea75fd5d35e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:28.820373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-35321add-193d-4f4a-8227-bea75fd5d35e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.163324 Aug 24 05:17:28.820973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 972/1836] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:28 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:29.842590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-85e0cb88-2324-4586-ae48-9a6d7f6ebe00 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:29.843312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-85e0cb88-2324-4586-ae48-9a6d7f6ebe00 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:29.850420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85e0cb88-2324-4586-ae48-9a6d7f6ebe00 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:29.850929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85e0cb88-2324-4586-ae48-9a6d7f6ebe00 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:29.851370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85e0cb88-2324-4586-ae48-9a6d7f6ebe00 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:29.852064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85e0cb88-2324-4586-ae48-9a6d7f6ebe00 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:29.852515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85e0cb88-2324-4586-ae48-9a6d7f6ebe00 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:29.852937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-85e0cb88-2324-4586-ae48-9a6d7f6ebe00 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:29.990504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-85e0cb88-2324-4586-ae48-9a6d7f6ebe00 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:29.998948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-85e0cb88-2324-4586-ae48-9a6d7f6ebe00 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160076 Aug 24 05:17:29.999370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 865/1837] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:29 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:17:31.023336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cfb68417-ec46-4995-a47a-323572fe80d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:31.024308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cfb68417-ec46-4995-a47a-323572fe80d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:31.031674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb68417-ec46-4995-a47a-323572fe80d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:31.032159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb68417-ec46-4995-a47a-323572fe80d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:31.032596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb68417-ec46-4995-a47a-323572fe80d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:31.033350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb68417-ec46-4995-a47a-323572fe80d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:31.033809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb68417-ec46-4995-a47a-323572fe80d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:31.034236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfb68417-ec46-4995-a47a-323572fe80d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:31.174464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cfb68417-ec46-4995-a47a-323572fe80d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:31.183216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cfb68417-ec46-4995-a47a-323572fe80d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.165976 Aug 24 05:17:31.183785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 973/1838] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:31 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:17:32.204931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9961675e-15d8-4229-9a23-94e8479e27ba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:32.205537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9961675e-15d8-4229-9a23-94e8479e27ba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:32.213111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9961675e-15d8-4229-9a23-94e8479e27ba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:32.213597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9961675e-15d8-4229-9a23-94e8479e27ba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:32.214035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9961675e-15d8-4229-9a23-94e8479e27ba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:32.214754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9961675e-15d8-4229-9a23-94e8479e27ba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:32.215208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9961675e-15d8-4229-9a23-94e8479e27ba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:32.215633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9961675e-15d8-4229-9a23-94e8479e27ba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:32.218232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=75 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:32.352587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9961675e-15d8-4229-9a23-94e8479e27ba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:32.361046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9961675e-15d8-4229-9a23-94e8479e27ba tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160229 Aug 24 05:17:32.361634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 866/1839] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:32 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:33.382958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0ad96926-6bb0-45b6-a5bb-b86ebf501965 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:33.383513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0ad96926-6bb0-45b6-a5bb-b86ebf501965 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:33.390030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ad96926-6bb0-45b6-a5bb-b86ebf501965 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:33.390503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ad96926-6bb0-45b6-a5bb-b86ebf501965 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:33.391089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ad96926-6bb0-45b6-a5bb-b86ebf501965 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:33.391787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ad96926-6bb0-45b6-a5bb-b86ebf501965 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:33.392239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ad96926-6bb0-45b6-a5bb-b86ebf501965 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:33.392653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ad96926-6bb0-45b6-a5bb-b86ebf501965 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:33.528205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0ad96926-6bb0-45b6-a5bb-b86ebf501965 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:33.537337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0ad96926-6bb0-45b6-a5bb-b86ebf501965 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158140 Aug 24 05:17:33.538283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 974/1840] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:33 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:34.560130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e25aee1a-0de9-4a29-b040-89d7bf7732a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:34.560722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e25aee1a-0de9-4a29-b040-89d7bf7732a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:34.567832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e25aee1a-0de9-4a29-b040-89d7bf7732a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:34.569299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e25aee1a-0de9-4a29-b040-89d7bf7732a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:34.569610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e25aee1a-0de9-4a29-b040-89d7bf7732a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:34.570309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e25aee1a-0de9-4a29-b040-89d7bf7732a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:34.570787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e25aee1a-0de9-4a29-b040-89d7bf7732a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:34.571213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e25aee1a-0de9-4a29-b040-89d7bf7732a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:34.708162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e25aee1a-0de9-4a29-b040-89d7bf7732a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:34.716610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e25aee1a-0de9-4a29-b040-89d7bf7732a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160330 Aug 24 05:17:34.717177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 867/1841] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:34 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:35.738566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c5aba271-a986-415a-ae8f-85ca122af670 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:35.739600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c5aba271-a986-415a-ae8f-85ca122af670 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:35.748195 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5aba271-a986-415a-ae8f-85ca122af670 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:35.748819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5aba271-a986-415a-ae8f-85ca122af670 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:35.749364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5aba271-a986-415a-ae8f-85ca122af670 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:35.750205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5aba271-a986-415a-ae8f-85ca122af670 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:35.750848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5aba271-a986-415a-ae8f-85ca122af670 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:35.751411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5aba271-a986-415a-ae8f-85ca122af670 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:35.889811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c5aba271-a986-415a-ae8f-85ca122af670 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:35.898933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c5aba271-a986-415a-ae8f-85ca122af670 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.164995 Aug 24 05:17:35.899503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 975/1842] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:35 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:36.920899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fb62c97e-d65e-493c-8f8a-19a38c6ba7db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:36.921519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fb62c97e-d65e-493c-8f8a-19a38c6ba7db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:36.923951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:36.930251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb62c97e-d65e-493c-8f8a-19a38c6ba7db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:36.930766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb62c97e-d65e-493c-8f8a-19a38c6ba7db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:36.931207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb62c97e-d65e-493c-8f8a-19a38c6ba7db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:36.931897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb62c97e-d65e-493c-8f8a-19a38c6ba7db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:36.932351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb62c97e-d65e-493c-8f8a-19a38c6ba7db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:36.932779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb62c97e-d65e-493c-8f8a-19a38c6ba7db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:37.063581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fb62c97e-d65e-493c-8f8a-19a38c6ba7db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:37.072337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fb62c97e-d65e-493c-8f8a-19a38c6ba7db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155595 Aug 24 05:17:37.072906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 868/1843] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:36 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:38.093779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7e1232d1-4a40-407c-a0f6-1ca1707e9a1b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:38.094326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7e1232d1-4a40-407c-a0f6-1ca1707e9a1b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:38.101368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e1232d1-4a40-407c-a0f6-1ca1707e9a1b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:38.101848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e1232d1-4a40-407c-a0f6-1ca1707e9a1b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:38.102286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e1232d1-4a40-407c-a0f6-1ca1707e9a1b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:38.103007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e1232d1-4a40-407c-a0f6-1ca1707e9a1b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:38.103459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e1232d1-4a40-407c-a0f6-1ca1707e9a1b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:38.103883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e1232d1-4a40-407c-a0f6-1ca1707e9a1b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:38.246271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7e1232d1-4a40-407c-a0f6-1ca1707e9a1b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:38.246271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7e1232d1-4a40-407c-a0f6-1ca1707e9a1b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155476 Aug 24 05:17:38.246271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 976/1844] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:38 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:39.267242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9ea7c690-9eb2-4894-a3e0-1af044f415ee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:39.267838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9ea7c690-9eb2-4894-a3e0-1af044f415ee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:39.274990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ea7c690-9eb2-4894-a3e0-1af044f415ee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:39.275569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ea7c690-9eb2-4894-a3e0-1af044f415ee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:39.275904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ea7c690-9eb2-4894-a3e0-1af044f415ee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:39.276586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ea7c690-9eb2-4894-a3e0-1af044f415ee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:39.277034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ea7c690-9eb2-4894-a3e0-1af044f415ee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:39.277460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ea7c690-9eb2-4894-a3e0-1af044f415ee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:39.450411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9ea7c690-9eb2-4894-a3e0-1af044f415ee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:39.458806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9ea7c690-9eb2-4894-a3e0-1af044f415ee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.195656 Aug 24 05:17:39.459810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 869/1845] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:39 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:40.479667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-106be45b-a419-4971-8670-d23be9f41162 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:40.480265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-106be45b-a419-4971-8670-d23be9f41162 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:40.486850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-106be45b-a419-4971-8670-d23be9f41162 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:40.487329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-106be45b-a419-4971-8670-d23be9f41162 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:40.487761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-106be45b-a419-4971-8670-d23be9f41162 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:40.488451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-106be45b-a419-4971-8670-d23be9f41162 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:40.488895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-106be45b-a419-4971-8670-d23be9f41162 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:40.489312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-106be45b-a419-4971-8670-d23be9f41162 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:40.622917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-106be45b-a419-4971-8670-d23be9f41162 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:40.631058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-106be45b-a419-4971-8670-d23be9f41162 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155304 Aug 24 05:17:40.631629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 977/1846] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:40 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:41.651995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f94e1371-bfc8-458b-9534-89a100647ba7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:41.652577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f94e1371-bfc8-458b-9534-89a100647ba7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:41.659036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94e1371-bfc8-458b-9534-89a100647ba7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:41.659518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94e1371-bfc8-458b-9534-89a100647ba7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:41.659949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94e1371-bfc8-458b-9534-89a100647ba7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:41.660640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94e1371-bfc8-458b-9534-89a100647ba7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:41.661090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94e1371-bfc8-458b-9534-89a100647ba7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:41.661510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94e1371-bfc8-458b-9534-89a100647ba7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:41.794614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f94e1371-bfc8-458b-9534-89a100647ba7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:41.803664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f94e1371-bfc8-458b-9534-89a100647ba7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155530 Aug 24 05:17:41.804237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 870/1847] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:41 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:17:42.825493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c6f7a8ff-7b3d-48a6-b982-4d506aadd7af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:42.826099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c6f7a8ff-7b3d-48a6-b982-4d506aadd7af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:42.828401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:42.834171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6f7a8ff-7b3d-48a6-b982-4d506aadd7af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:42.834920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6f7a8ff-7b3d-48a6-b982-4d506aadd7af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:42.835471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6f7a8ff-7b3d-48a6-b982-4d506aadd7af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:42.836152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6f7a8ff-7b3d-48a6-b982-4d506aadd7af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:42.836593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6f7a8ff-7b3d-48a6-b982-4d506aadd7af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:42.837006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6f7a8ff-7b3d-48a6-b982-4d506aadd7af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:42.971711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c6f7a8ff-7b3d-48a6-b982-4d506aadd7af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:42.980193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c6f7a8ff-7b3d-48a6-b982-4d506aadd7af tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158644 Aug 24 05:17:42.980792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 978/1848] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:42 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:44.002429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-837402ab-1a04-4244-b6f8-728df60cb41d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:44.003058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-837402ab-1a04-4244-b6f8-728df60cb41d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:44.010254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-837402ab-1a04-4244-b6f8-728df60cb41d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:44.010766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-837402ab-1a04-4244-b6f8-728df60cb41d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:44.011207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-837402ab-1a04-4244-b6f8-728df60cb41d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:44.011895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-837402ab-1a04-4244-b6f8-728df60cb41d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:44.012344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-837402ab-1a04-4244-b6f8-728df60cb41d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:44.012763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-837402ab-1a04-4244-b6f8-728df60cb41d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:44.163322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-837402ab-1a04-4244-b6f8-728df60cb41d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:44.171756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-837402ab-1a04-4244-b6f8-728df60cb41d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.173165 Aug 24 05:17:44.172395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 871/1849] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:43 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:45.194040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ee9eff62-7934-406e-927f-25e4ab35d658 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:45.194814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ee9eff62-7934-406e-927f-25e4ab35d658 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:45.200859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee9eff62-7934-406e-927f-25e4ab35d658 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:45.201335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee9eff62-7934-406e-927f-25e4ab35d658 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:45.201771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee9eff62-7934-406e-927f-25e4ab35d658 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:45.202450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee9eff62-7934-406e-927f-25e4ab35d658 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:45.202944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee9eff62-7934-406e-927f-25e4ab35d658 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:45.203332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee9eff62-7934-406e-927f-25e4ab35d658 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:45.338290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ee9eff62-7934-406e-927f-25e4ab35d658 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:45.346478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ee9eff62-7934-406e-927f-25e4ab35d658 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156723 Aug 24 05:17:45.347080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 979/1850] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:45 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:46.369514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6edfe5a8-35f5-4a3a-8714-94dae4a4e951 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:46.370127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6edfe5a8-35f5-4a3a-8714-94dae4a4e951 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:46.376758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6edfe5a8-35f5-4a3a-8714-94dae4a4e951 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:46.377240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6edfe5a8-35f5-4a3a-8714-94dae4a4e951 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:46.377676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6edfe5a8-35f5-4a3a-8714-94dae4a4e951 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:46.378369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6edfe5a8-35f5-4a3a-8714-94dae4a4e951 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:46.378857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6edfe5a8-35f5-4a3a-8714-94dae4a4e951 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:46.379282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6edfe5a8-35f5-4a3a-8714-94dae4a4e951 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:46.517250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6edfe5a8-35f5-4a3a-8714-94dae4a4e951 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:46.527070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6edfe5a8-35f5-4a3a-8714-94dae4a4e951 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162176 Aug 24 05:17:46.527638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 872/1851] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:46 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:47.549524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bcd36abe-b04a-4bca-98e3-698e916b7b41 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:47.550068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bcd36abe-b04a-4bca-98e3-698e916b7b41 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:47.557975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcd36abe-b04a-4bca-98e3-698e916b7b41 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:47.558452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcd36abe-b04a-4bca-98e3-698e916b7b41 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:47.558948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcd36abe-b04a-4bca-98e3-698e916b7b41 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:47.559649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcd36abe-b04a-4bca-98e3-698e916b7b41 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:47.560099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcd36abe-b04a-4bca-98e3-698e916b7b41 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:47.560521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bcd36abe-b04a-4bca-98e3-698e916b7b41 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:47.698910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bcd36abe-b04a-4bca-98e3-698e916b7b41 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:47.707422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bcd36abe-b04a-4bca-98e3-698e916b7b41 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161813 Aug 24 05:17:47.707991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 980/1852] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:47 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:48.729143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3a1fc69d-744e-48a3-a08d-a0181e900cc5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:48.729764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3a1fc69d-744e-48a3-a08d-a0181e900cc5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:48.736705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1fc69d-744e-48a3-a08d-a0181e900cc5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:48.737192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1fc69d-744e-48a3-a08d-a0181e900cc5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:48.737625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1fc69d-744e-48a3-a08d-a0181e900cc5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:48.738328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1fc69d-744e-48a3-a08d-a0181e900cc5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:48.738805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1fc69d-744e-48a3-a08d-a0181e900cc5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:48.739227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1fc69d-744e-48a3-a08d-a0181e900cc5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:48.904767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3a1fc69d-744e-48a3-a08d-a0181e900cc5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:48.914080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3a1fc69d-744e-48a3-a08d-a0181e900cc5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.189499 Aug 24 05:17:48.914652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 873/1853] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:48 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:49.937304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a4ed45d3-c1fd-4b83-8a35-28fbc1be2cf9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:49.938037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a4ed45d3-c1fd-4b83-8a35-28fbc1be2cf9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:49.946656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ed45d3-c1fd-4b83-8a35-28fbc1be2cf9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:49.947175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ed45d3-c1fd-4b83-8a35-28fbc1be2cf9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:49.947600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ed45d3-c1fd-4b83-8a35-28fbc1be2cf9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:49.948294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ed45d3-c1fd-4b83-8a35-28fbc1be2cf9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:49.948740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ed45d3-c1fd-4b83-8a35-28fbc1be2cf9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:49.949154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ed45d3-c1fd-4b83-8a35-28fbc1be2cf9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:50.088565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a4ed45d3-c1fd-4b83-8a35-28fbc1be2cf9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:50.098334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a4ed45d3-c1fd-4b83-8a35-28fbc1be2cf9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.165305 Aug 24 05:17:50.098951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 981/1854] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:49 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:51.120430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b379cdad-7ee4-4daf-b8a8-fcfff168b752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:51.121033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b379cdad-7ee4-4daf-b8a8-fcfff168b752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:51.127715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b379cdad-7ee4-4daf-b8a8-fcfff168b752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:51.128217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b379cdad-7ee4-4daf-b8a8-fcfff168b752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:51.128818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b379cdad-7ee4-4daf-b8a8-fcfff168b752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:51.129561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b379cdad-7ee4-4daf-b8a8-fcfff168b752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:51.130026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b379cdad-7ee4-4daf-b8a8-fcfff168b752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:51.130513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b379cdad-7ee4-4daf-b8a8-fcfff168b752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:51.273975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b379cdad-7ee4-4daf-b8a8-fcfff168b752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:51.282314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b379cdad-7ee4-4daf-b8a8-fcfff168b752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.165771 Aug 24 05:17:51.282981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 874/1855] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:51 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:52.305266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-696e0113-1059-4302-b822-789558b8b786 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:52.305870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-696e0113-1059-4302-b822-789558b8b786 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:52.312437 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-696e0113-1059-4302-b822-789558b8b786 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:52.312915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-696e0113-1059-4302-b822-789558b8b786 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:52.313351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-696e0113-1059-4302-b822-789558b8b786 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:52.314040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-696e0113-1059-4302-b822-789558b8b786 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:52.314499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-696e0113-1059-4302-b822-789558b8b786 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:52.314958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-696e0113-1059-4302-b822-789558b8b786 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:52.450449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-696e0113-1059-4302-b822-789558b8b786 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:52.459552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-696e0113-1059-4302-b822-789558b8b786 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158344 Aug 24 05:17:52.460142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 982/1856] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:52 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:53.481712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9de558e6-68d5-4f70-ab3d-251579cf0ba8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:53.482329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9de558e6-68d5-4f70-ab3d-251579cf0ba8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:53.489043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9de558e6-68d5-4f70-ab3d-251579cf0ba8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:53.490265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9de558e6-68d5-4f70-ab3d-251579cf0ba8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:53.490953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9de558e6-68d5-4f70-ab3d-251579cf0ba8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:53.491654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9de558e6-68d5-4f70-ab3d-251579cf0ba8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:53.492122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9de558e6-68d5-4f70-ab3d-251579cf0ba8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:53.492545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9de558e6-68d5-4f70-ab3d-251579cf0ba8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:53.631692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9de558e6-68d5-4f70-ab3d-251579cf0ba8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:53.640801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9de558e6-68d5-4f70-ab3d-251579cf0ba8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162917 Aug 24 05:17:53.641371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 875/1857] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:53 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:54.663741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-52f8836c-8405-44d1-8bb0-6d1a85a30332 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:54.664399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-52f8836c-8405-44d1-8bb0-6d1a85a30332 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:54.671060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52f8836c-8405-44d1-8bb0-6d1a85a30332 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:54.671533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52f8836c-8405-44d1-8bb0-6d1a85a30332 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:54.672025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52f8836c-8405-44d1-8bb0-6d1a85a30332 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:54.672708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52f8836c-8405-44d1-8bb0-6d1a85a30332 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:54.673152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52f8836c-8405-44d1-8bb0-6d1a85a30332 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:54.673573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52f8836c-8405-44d1-8bb0-6d1a85a30332 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:54.822614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-52f8836c-8405-44d1-8bb0-6d1a85a30332 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:54.831059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-52f8836c-8405-44d1-8bb0-6d1a85a30332 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.173005 Aug 24 05:17:54.831632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 983/1858] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:54 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:55.853602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-34bf27da-1642-489a-b614-13d7052458d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:55.854219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-34bf27da-1642-489a-b614-13d7052458d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:55.860801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34bf27da-1642-489a-b614-13d7052458d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:55.861270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34bf27da-1642-489a-b614-13d7052458d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:55.861705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34bf27da-1642-489a-b614-13d7052458d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:55.862392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34bf27da-1642-489a-b614-13d7052458d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:55.862877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34bf27da-1642-489a-b614-13d7052458d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:55.863299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34bf27da-1642-489a-b614-13d7052458d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:56.019661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-34bf27da-1642-489a-b614-13d7052458d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:56.028423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-34bf27da-1642-489a-b614-13d7052458d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.178590 Aug 24 05:17:56.029322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 876/1859] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:55 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:57.050454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cf3a5c31-4bbc-4d5a-abb4-672aee1464a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:57.051047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cf3a5c31-4bbc-4d5a-abb4-672aee1464a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:57.057869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf3a5c31-4bbc-4d5a-abb4-672aee1464a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:57.058348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf3a5c31-4bbc-4d5a-abb4-672aee1464a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:57.058814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf3a5c31-4bbc-4d5a-abb4-672aee1464a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:57.059504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf3a5c31-4bbc-4d5a-abb4-672aee1464a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:57.059954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf3a5c31-4bbc-4d5a-abb4-672aee1464a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:57.060375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cf3a5c31-4bbc-4d5a-abb4-672aee1464a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:57.191232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cf3a5c31-4bbc-4d5a-abb4-672aee1464a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:57.199811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cf3a5c31-4bbc-4d5a-abb4-672aee1464a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153258 Aug 24 05:17:57.200388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 984/1860] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:57 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:58.221941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4c7e2307-f1ce-4fce-9c90-50f77456d059 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:58.222578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4c7e2307-f1ce-4fce-9c90-50f77456d059 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:58.229836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7e2307-f1ce-4fce-9c90-50f77456d059 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:58.230314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7e2307-f1ce-4fce-9c90-50f77456d059 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:58.230771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7e2307-f1ce-4fce-9c90-50f77456d059 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:58.231460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7e2307-f1ce-4fce-9c90-50f77456d059 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:58.231967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7e2307-f1ce-4fce-9c90-50f77456d059 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:58.232388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c7e2307-f1ce-4fce-9c90-50f77456d059 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:58.368949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4c7e2307-f1ce-4fce-9c90-50f77456d059 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:58.382630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4c7e2307-f1ce-4fce-9c90-50f77456d059 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.164376 Aug 24 05:17:58.383530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 877/1861] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:58 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:17:59.407302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a6f7fafb-7d2e-415f-9590-8ca5d5d328ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:17:59.407839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a6f7fafb-7d2e-415f-9590-8ca5d5d328ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:17:59.415258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6f7fafb-7d2e-415f-9590-8ca5d5d328ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:59.415736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6f7fafb-7d2e-415f-9590-8ca5d5d328ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:59.416172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6f7fafb-7d2e-415f-9590-8ca5d5d328ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:59.416853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6f7fafb-7d2e-415f-9590-8ca5d5d328ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:17:59.417293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6f7fafb-7d2e-415f-9590-8ca5d5d328ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:17:59.417702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6f7fafb-7d2e-415f-9590-8ca5d5d328ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:17:59.420329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:17:59.559321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a6f7fafb-7d2e-415f-9590-8ca5d5d328ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:17:59.568533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a6f7fafb-7d2e-415f-9590-8ca5d5d328ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.164802 Aug 24 05:17:59.569198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 985/1862] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:17:59 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:00.590487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-72d2d792-f59b-4d53-a820-a536ffb1ee7c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:00.591236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-72d2d792-f59b-4d53-a820-a536ffb1ee7c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:00.598720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72d2d792-f59b-4d53-a820-a536ffb1ee7c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:00.599567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72d2d792-f59b-4d53-a820-a536ffb1ee7c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:00.600200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72d2d792-f59b-4d53-a820-a536ffb1ee7c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:00.600897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72d2d792-f59b-4d53-a820-a536ffb1ee7c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:00.601344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72d2d792-f59b-4d53-a820-a536ffb1ee7c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:00.601763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72d2d792-f59b-4d53-a820-a536ffb1ee7c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:00.744910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-72d2d792-f59b-4d53-a820-a536ffb1ee7c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:00.753655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-72d2d792-f59b-4d53-a820-a536ffb1ee7c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.167287 Aug 24 05:18:00.754228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 878/1863] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:00 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:01.776322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-415a403e-d01c-4e5e-a4a3-1d23207a6241 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:01.776928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-415a403e-d01c-4e5e-a4a3-1d23207a6241 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:01.784861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-415a403e-d01c-4e5e-a4a3-1d23207a6241 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:01.785421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-415a403e-d01c-4e5e-a4a3-1d23207a6241 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:01.785896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-415a403e-d01c-4e5e-a4a3-1d23207a6241 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:01.786832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-415a403e-d01c-4e5e-a4a3-1d23207a6241 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:01.787434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-415a403e-d01c-4e5e-a4a3-1d23207a6241 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:01.787932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-415a403e-d01c-4e5e-a4a3-1d23207a6241 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:01.923842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-415a403e-d01c-4e5e-a4a3-1d23207a6241 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:01.932927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-415a403e-d01c-4e5e-a4a3-1d23207a6241 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160810 Aug 24 05:18:01.933496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 986/1864] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:01 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:02.953547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1d6c67bf-e726-4df2-9556-e9ecf3676747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:02.954159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1d6c67bf-e726-4df2-9556-e9ecf3676747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:02.960844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c67bf-e726-4df2-9556-e9ecf3676747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:02.961324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c67bf-e726-4df2-9556-e9ecf3676747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:02.961755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c67bf-e726-4df2-9556-e9ecf3676747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:02.962455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c67bf-e726-4df2-9556-e9ecf3676747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:02.962930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c67bf-e726-4df2-9556-e9ecf3676747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:02.963348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c67bf-e726-4df2-9556-e9ecf3676747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:02.966070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=78 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:03.101475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1d6c67bf-e726-4df2-9556-e9ecf3676747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:03.110079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1d6c67bf-e726-4df2-9556-e9ecf3676747 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160251 Aug 24 05:18:03.110648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 879/1865] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:02 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:04.132368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-45156f52-cf42-41f4-901d-9a914bab16bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:04.132968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-45156f52-cf42-41f4-901d-9a914bab16bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:04.139656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45156f52-cf42-41f4-901d-9a914bab16bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:04.140129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45156f52-cf42-41f4-901d-9a914bab16bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:04.140555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45156f52-cf42-41f4-901d-9a914bab16bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:04.141236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45156f52-cf42-41f4-901d-9a914bab16bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:04.141705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45156f52-cf42-41f4-901d-9a914bab16bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:04.142125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45156f52-cf42-41f4-901d-9a914bab16bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:04.282970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-45156f52-cf42-41f4-901d-9a914bab16bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:04.292592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-45156f52-cf42-41f4-901d-9a914bab16bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.165174 Aug 24 05:18:04.293198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 987/1866] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:04 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:18:05.316054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-01d8275a-5a89-48d5-b2d7-9476b317dbd2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:05.316665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-01d8275a-5a89-48d5-b2d7-9476b317dbd2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:05.323949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01d8275a-5a89-48d5-b2d7-9476b317dbd2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:05.324427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01d8275a-5a89-48d5-b2d7-9476b317dbd2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:05.324860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01d8275a-5a89-48d5-b2d7-9476b317dbd2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:05.325547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01d8275a-5a89-48d5-b2d7-9476b317dbd2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:05.325994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01d8275a-5a89-48d5-b2d7-9476b317dbd2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:05.326409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-01d8275a-5a89-48d5-b2d7-9476b317dbd2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:05.461005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-01d8275a-5a89-48d5-b2d7-9476b317dbd2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:05.469380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-01d8275a-5a89-48d5-b2d7-9476b317dbd2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157186 Aug 24 05:18:05.469939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 880/1867] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:05 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:06.493286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c58df324-bb90-4a31-baed-1b9a2d1ff117 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:06.493889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c58df324-bb90-4a31-baed-1b9a2d1ff117 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:06.500473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c58df324-bb90-4a31-baed-1b9a2d1ff117 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:06.500958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c58df324-bb90-4a31-baed-1b9a2d1ff117 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:06.501390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c58df324-bb90-4a31-baed-1b9a2d1ff117 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:06.502089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c58df324-bb90-4a31-baed-1b9a2d1ff117 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:06.502536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c58df324-bb90-4a31-baed-1b9a2d1ff117 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:06.502987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c58df324-bb90-4a31-baed-1b9a2d1ff117 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:06.664380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c58df324-bb90-4a31-baed-1b9a2d1ff117 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:06.672836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c58df324-bb90-4a31-baed-1b9a2d1ff117 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.184173 Aug 24 05:18:06.673410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 988/1868] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:06 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:07.695405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6f1bf0ff-66fe-45ab-ab99-76951542f72d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:07.696039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6f1bf0ff-66fe-45ab-ab99-76951542f72d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:07.698072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:07.703459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f1bf0ff-66fe-45ab-ab99-76951542f72d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:07.703940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f1bf0ff-66fe-45ab-ab99-76951542f72d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:07.704394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f1bf0ff-66fe-45ab-ab99-76951542f72d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:07.705065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f1bf0ff-66fe-45ab-ab99-76951542f72d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:07.705504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f1bf0ff-66fe-45ab-ab99-76951542f72d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:07.705918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f1bf0ff-66fe-45ab-ab99-76951542f72d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:07.841656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6f1bf0ff-66fe-45ab-ab99-76951542f72d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:07.850391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6f1bf0ff-66fe-45ab-ab99-76951542f72d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159809 Aug 24 05:18:07.851026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 881/1869] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:07 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:08.871157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-54aa7aa1-98c8-4c7d-9b63-874a46382be2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:08.871704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-54aa7aa1-98c8-4c7d-9b63-874a46382be2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:08.878366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54aa7aa1-98c8-4c7d-9b63-874a46382be2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:08.878876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54aa7aa1-98c8-4c7d-9b63-874a46382be2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:08.879310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54aa7aa1-98c8-4c7d-9b63-874a46382be2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:08.880521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54aa7aa1-98c8-4c7d-9b63-874a46382be2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:08.881000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54aa7aa1-98c8-4c7d-9b63-874a46382be2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:08.881414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54aa7aa1-98c8-4c7d-9b63-874a46382be2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:09.017079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-54aa7aa1-98c8-4c7d-9b63-874a46382be2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:09.026520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-54aa7aa1-98c8-4c7d-9b63-874a46382be2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159362 Aug 24 05:18:09.027129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 989/1870] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:08 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:10.048013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f66d3f90-acdb-4883-ae6c-05cc61d09831 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:10.048604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f66d3f90-acdb-4883-ae6c-05cc61d09831 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:10.055414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66d3f90-acdb-4883-ae6c-05cc61d09831 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:10.055892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66d3f90-acdb-4883-ae6c-05cc61d09831 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:10.056383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66d3f90-acdb-4883-ae6c-05cc61d09831 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:10.056996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66d3f90-acdb-4883-ae6c-05cc61d09831 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:10.057442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66d3f90-acdb-4883-ae6c-05cc61d09831 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:10.057859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66d3f90-acdb-4883-ae6c-05cc61d09831 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:10.188676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f66d3f90-acdb-4883-ae6c-05cc61d09831 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:10.197373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f66d3f90-acdb-4883-ae6c-05cc61d09831 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153214 Aug 24 05:18:10.198034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 882/1871] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:10 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:11.218741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9de6d97a-1437-448e-94c0-c63da4c6c1e0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:11.219356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9de6d97a-1437-448e-94c0-c63da4c6c1e0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:11.226525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9de6d97a-1437-448e-94c0-c63da4c6c1e0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:11.227035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9de6d97a-1437-448e-94c0-c63da4c6c1e0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:11.227469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9de6d97a-1437-448e-94c0-c63da4c6c1e0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:11.228157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9de6d97a-1437-448e-94c0-c63da4c6c1e0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:11.228607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9de6d97a-1437-448e-94c0-c63da4c6c1e0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:11.229035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9de6d97a-1437-448e-94c0-c63da4c6c1e0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:11.362402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9de6d97a-1437-448e-94c0-c63da4c6c1e0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:11.371460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9de6d97a-1437-448e-94c0-c63da4c6c1e0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156585 Aug 24 05:18:11.372022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 990/1872] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:11 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:12.393532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-659ca1e2-6d8c-407e-a9c4-ac41f9def8ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:12.394900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-659ca1e2-6d8c-407e-a9c4-ac41f9def8ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:12.402059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-659ca1e2-6d8c-407e-a9c4-ac41f9def8ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:12.402538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-659ca1e2-6d8c-407e-a9c4-ac41f9def8ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:12.403016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-659ca1e2-6d8c-407e-a9c4-ac41f9def8ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:12.403786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-659ca1e2-6d8c-407e-a9c4-ac41f9def8ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:12.404238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-659ca1e2-6d8c-407e-a9c4-ac41f9def8ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:12.404662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-659ca1e2-6d8c-407e-a9c4-ac41f9def8ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:12.546750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-659ca1e2-6d8c-407e-a9c4-ac41f9def8ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:12.555278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-659ca1e2-6d8c-407e-a9c4-ac41f9def8ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.166161 Aug 24 05:18:12.555840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 883/1873] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:12 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:13.576702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dab18df3-a362-4478-bea2-9de24d6b06c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:13.577313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dab18df3-a362-4478-bea2-9de24d6b06c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:13.579559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:13.585101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dab18df3-a362-4478-bea2-9de24d6b06c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:13.585575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dab18df3-a362-4478-bea2-9de24d6b06c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:13.586002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dab18df3-a362-4478-bea2-9de24d6b06c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:13.586720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dab18df3-a362-4478-bea2-9de24d6b06c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:13.587165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dab18df3-a362-4478-bea2-9de24d6b06c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:13.587579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dab18df3-a362-4478-bea2-9de24d6b06c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:13.718789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dab18df3-a362-4478-bea2-9de24d6b06c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:13.727573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dab18df3-a362-4478-bea2-9de24d6b06c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154758 Aug 24 05:18:13.728132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 991/1874] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:13 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:14.748653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a6076ac2-e520-4510-82dd-f8beb95c0039 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:14.749264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a6076ac2-e520-4510-82dd-f8beb95c0039 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:14.756044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6076ac2-e520-4510-82dd-f8beb95c0039 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:14.756519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6076ac2-e520-4510-82dd-f8beb95c0039 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:14.756946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6076ac2-e520-4510-82dd-f8beb95c0039 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:14.757635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6076ac2-e520-4510-82dd-f8beb95c0039 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:14.758083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6076ac2-e520-4510-82dd-f8beb95c0039 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:14.758504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6076ac2-e520-4510-82dd-f8beb95c0039 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:14.888914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a6076ac2-e520-4510-82dd-f8beb95c0039 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:14.897219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a6076ac2-e520-4510-82dd-f8beb95c0039 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152421 Aug 24 05:18:14.898025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 884/1875] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:14 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:15.918261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-595fd653-4718-49f8-b778-159dd0d4bfa8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:15.918914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-595fd653-4718-49f8-b778-159dd0d4bfa8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:15.924945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-595fd653-4718-49f8-b778-159dd0d4bfa8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:15.925423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-595fd653-4718-49f8-b778-159dd0d4bfa8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:15.925860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-595fd653-4718-49f8-b778-159dd0d4bfa8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:15.926575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-595fd653-4718-49f8-b778-159dd0d4bfa8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:15.927158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-595fd653-4718-49f8-b778-159dd0d4bfa8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:15.927679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-595fd653-4718-49f8-b778-159dd0d4bfa8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:16.072678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-595fd653-4718-49f8-b778-159dd0d4bfa8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:16.080960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-595fd653-4718-49f8-b778-159dd0d4bfa8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.166756 Aug 24 05:18:16.081523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 992/1876] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:15 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:17.102219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b08dcaa7-ec93-4067-8749-90075329456f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:17.102862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b08dcaa7-ec93-4067-8749-90075329456f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:17.109378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08dcaa7-ec93-4067-8749-90075329456f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:17.109923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08dcaa7-ec93-4067-8749-90075329456f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:17.110275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08dcaa7-ec93-4067-8749-90075329456f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:17.110982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08dcaa7-ec93-4067-8749-90075329456f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:17.111424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08dcaa7-ec93-4067-8749-90075329456f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:17.111934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08dcaa7-ec93-4067-8749-90075329456f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:17.246225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b08dcaa7-ec93-4067-8749-90075329456f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:17.254497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b08dcaa7-ec93-4067-8749-90075329456f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156209 Aug 24 05:18:17.255572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 885/1877] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:17 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:18:18.276098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4339cd2c-a552-4002-9c1c-89faea06a335 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:18.276707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4339cd2c-a552-4002-9c1c-89faea06a335 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:18.283156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4339cd2c-a552-4002-9c1c-89faea06a335 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:18.283630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4339cd2c-a552-4002-9c1c-89faea06a335 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:18.284072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4339cd2c-a552-4002-9c1c-89faea06a335 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:18.284750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4339cd2c-a552-4002-9c1c-89faea06a335 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:18.285197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4339cd2c-a552-4002-9c1c-89faea06a335 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:18.285614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4339cd2c-a552-4002-9c1c-89faea06a335 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:18.424220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4339cd2c-a552-4002-9c1c-89faea06a335 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:18.434015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4339cd2c-a552-4002-9c1c-89faea06a335 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161829 Aug 24 05:18:18.434601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 993/1878] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:18 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:18:19.455437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d70ce53b-2084-4ac7-865d-a074f937fc2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:19.456048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d70ce53b-2084-4ac7-865d-a074f937fc2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:19.462492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d70ce53b-2084-4ac7-865d-a074f937fc2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:19.463006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d70ce53b-2084-4ac7-865d-a074f937fc2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:19.463438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d70ce53b-2084-4ac7-865d-a074f937fc2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:19.464115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d70ce53b-2084-4ac7-865d-a074f937fc2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:19.464569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d70ce53b-2084-4ac7-865d-a074f937fc2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:19.464984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d70ce53b-2084-4ac7-865d-a074f937fc2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:19.595173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d70ce53b-2084-4ac7-865d-a074f937fc2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:19.603861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d70ce53b-2084-4ac7-865d-a074f937fc2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152269 Aug 24 05:18:19.604426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 886/1879] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:19 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:20.625930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f6ea9895-c987-4d02-9ac6-9c624283fc60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:20.626771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f6ea9895-c987-4d02-9ac6-9c624283fc60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:20.635335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6ea9895-c987-4d02-9ac6-9c624283fc60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:20.635811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6ea9895-c987-4d02-9ac6-9c624283fc60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:20.636246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6ea9895-c987-4d02-9ac6-9c624283fc60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:20.636938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6ea9895-c987-4d02-9ac6-9c624283fc60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:20.637381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6ea9895-c987-4d02-9ac6-9c624283fc60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:20.637800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f6ea9895-c987-4d02-9ac6-9c624283fc60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:20.780108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f6ea9895-c987-4d02-9ac6-9c624283fc60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:20.788884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f6ea9895-c987-4d02-9ac6-9c624283fc60 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.167170 Aug 24 05:18:20.789458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 994/1880] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:20 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:21.810574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1cef9b5e-90f0-4e27-bde8-7313e0dba004 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:21.811226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1cef9b5e-90f0-4e27-bde8-7313e0dba004 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:21.819099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cef9b5e-90f0-4e27-bde8-7313e0dba004 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:21.819586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cef9b5e-90f0-4e27-bde8-7313e0dba004 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:21.820019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cef9b5e-90f0-4e27-bde8-7313e0dba004 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:21.820724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cef9b5e-90f0-4e27-bde8-7313e0dba004 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:21.821178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cef9b5e-90f0-4e27-bde8-7313e0dba004 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:21.821604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1cef9b5e-90f0-4e27-bde8-7313e0dba004 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:21.955911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1cef9b5e-90f0-4e27-bde8-7313e0dba004 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:21.964839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1cef9b5e-90f0-4e27-bde8-7313e0dba004 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158120 Aug 24 05:18:21.965405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 887/1881] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:21 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:22.988298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d1a130a1-30a6-48bd-a023-2dae07297ab9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:22.988861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d1a130a1-30a6-48bd-a023-2dae07297ab9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:22.996019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a130a1-30a6-48bd-a023-2dae07297ab9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:22.996495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a130a1-30a6-48bd-a023-2dae07297ab9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:22.996930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a130a1-30a6-48bd-a023-2dae07297ab9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:22.997619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a130a1-30a6-48bd-a023-2dae07297ab9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:22.998065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a130a1-30a6-48bd-a023-2dae07297ab9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:22.998481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d1a130a1-30a6-48bd-a023-2dae07297ab9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:23.132481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d1a130a1-30a6-48bd-a023-2dae07297ab9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:23.141593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d1a130a1-30a6-48bd-a023-2dae07297ab9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156583 Aug 24 05:18:23.141593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 995/1882] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:22 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:24.163845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ce181b50-0913-432f-88cf-33c7f34395e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:24.164393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ce181b50-0913-432f-88cf-33c7f34395e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:24.171078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce181b50-0913-432f-88cf-33c7f34395e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:24.171564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce181b50-0913-432f-88cf-33c7f34395e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:24.172001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce181b50-0913-432f-88cf-33c7f34395e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:24.172698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce181b50-0913-432f-88cf-33c7f34395e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:24.173150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce181b50-0913-432f-88cf-33c7f34395e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:24.173576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ce181b50-0913-432f-88cf-33c7f34395e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:24.308286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ce181b50-0913-432f-88cf-33c7f34395e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:24.316657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ce181b50-0913-432f-88cf-33c7f34395e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157574 Aug 24 05:18:24.317254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 888/1883] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:24 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:25.338281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d803e7af-4b47-459f-815c-915a42b94538 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:25.338918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d803e7af-4b47-459f-815c-915a42b94538 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:25.347965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d803e7af-4b47-459f-815c-915a42b94538 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:25.349302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d803e7af-4b47-459f-815c-915a42b94538 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:25.350026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d803e7af-4b47-459f-815c-915a42b94538 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:25.351071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d803e7af-4b47-459f-815c-915a42b94538 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:25.351527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d803e7af-4b47-459f-815c-915a42b94538 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:25.352053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d803e7af-4b47-459f-815c-915a42b94538 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:25.491293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d803e7af-4b47-459f-815c-915a42b94538 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:25.499520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d803e7af-4b47-459f-815c-915a42b94538 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.165002 Aug 24 05:18:25.500016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 996/1884] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:25 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:26.522061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-acea1d29-2e14-420a-9349-66658231ae5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:26.522697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-acea1d29-2e14-420a-9349-66658231ae5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:26.529619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acea1d29-2e14-420a-9349-66658231ae5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:26.530101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acea1d29-2e14-420a-9349-66658231ae5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:26.530531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acea1d29-2e14-420a-9349-66658231ae5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:26.531254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acea1d29-2e14-420a-9349-66658231ae5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:26.531702 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acea1d29-2e14-420a-9349-66658231ae5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:26.532122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-acea1d29-2e14-420a-9349-66658231ae5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:26.688674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-acea1d29-2e14-420a-9349-66658231ae5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:26.698358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-acea1d29-2e14-420a-9349-66658231ae5e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.181278 Aug 24 05:18:26.698962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 889/1885] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:26 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:27.721177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ce8924ed-4b66-4dca-87a8-5e7de4591ab0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:27.721787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ce8924ed-4b66-4dca-87a8-5e7de4591ab0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:27.728546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce8924ed-4b66-4dca-87a8-5e7de4591ab0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:27.729029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce8924ed-4b66-4dca-87a8-5e7de4591ab0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:27.729465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce8924ed-4b66-4dca-87a8-5e7de4591ab0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:27.730157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce8924ed-4b66-4dca-87a8-5e7de4591ab0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:27.730606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce8924ed-4b66-4dca-87a8-5e7de4591ab0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:27.731059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ce8924ed-4b66-4dca-87a8-5e7de4591ab0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:27.867152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ce8924ed-4b66-4dca-87a8-5e7de4591ab0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:27.875371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ce8924ed-4b66-4dca-87a8-5e7de4591ab0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158146 Aug 24 05:18:27.875934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 997/1886] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:27 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:28.897739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4d255da0-5b95-43f6-afb2-001110a797c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:28.898291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4d255da0-5b95-43f6-afb2-001110a797c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:28.904976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d255da0-5b95-43f6-afb2-001110a797c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:28.905459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d255da0-5b95-43f6-afb2-001110a797c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:28.905899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d255da0-5b95-43f6-afb2-001110a797c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:28.906617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d255da0-5b95-43f6-afb2-001110a797c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:28.907095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d255da0-5b95-43f6-afb2-001110a797c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:28.907516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d255da0-5b95-43f6-afb2-001110a797c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:29.039750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4d255da0-5b95-43f6-afb2-001110a797c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:29.048007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4d255da0-5b95-43f6-afb2-001110a797c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154482 Aug 24 05:18:29.048571 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 890/1887] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:28 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:30.070418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b8c44ec2-8490-4afb-ae1f-3b1470cd6097 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:30.071097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b8c44ec2-8490-4afb-ae1f-3b1470cd6097 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:30.077458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c44ec2-8490-4afb-ae1f-3b1470cd6097 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:30.077940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c44ec2-8490-4afb-ae1f-3b1470cd6097 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:30.078366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c44ec2-8490-4afb-ae1f-3b1470cd6097 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:30.079063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c44ec2-8490-4afb-ae1f-3b1470cd6097 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:30.079503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c44ec2-8490-4afb-ae1f-3b1470cd6097 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:30.079919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c44ec2-8490-4afb-ae1f-3b1470cd6097 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:30.082425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:30.212753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b8c44ec2-8490-4afb-ae1f-3b1470cd6097 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:30.221279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b8c44ec2-8490-4afb-ae1f-3b1470cd6097 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155321 Aug 24 05:18:30.221843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 998/1888] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:30 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:31.243198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0ec1c730-9717-48a8-b22f-3edbf37ea40e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:31.243793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0ec1c730-9717-48a8-b22f-3edbf37ea40e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:31.250227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ec1c730-9717-48a8-b22f-3edbf37ea40e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:31.250770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ec1c730-9717-48a8-b22f-3edbf37ea40e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:31.251326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ec1c730-9717-48a8-b22f-3edbf37ea40e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:31.252019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ec1c730-9717-48a8-b22f-3edbf37ea40e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:31.252472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ec1c730-9717-48a8-b22f-3edbf37ea40e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:31.252891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ec1c730-9717-48a8-b22f-3edbf37ea40e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:31.382803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ec1c730-9717-48a8-b22f-3edbf37ea40e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:31.391076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0ec1c730-9717-48a8-b22f-3edbf37ea40e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152616 Aug 24 05:18:31.391628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 891/1889] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:31 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:32.412888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5118bf15-3cd7-4cd0-be2f-fd08983a3013 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:32.413490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5118bf15-3cd7-4cd0-be2f-fd08983a3013 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:32.420170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5118bf15-3cd7-4cd0-be2f-fd08983a3013 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:32.420637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5118bf15-3cd7-4cd0-be2f-fd08983a3013 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:32.421067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5118bf15-3cd7-4cd0-be2f-fd08983a3013 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:32.421749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5118bf15-3cd7-4cd0-be2f-fd08983a3013 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:32.422193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5118bf15-3cd7-4cd0-be2f-fd08983a3013 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:32.422600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5118bf15-3cd7-4cd0-be2f-fd08983a3013 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:32.557740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5118bf15-3cd7-4cd0-be2f-fd08983a3013 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:32.566168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5118bf15-3cd7-4cd0-be2f-fd08983a3013 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157597 Aug 24 05:18:32.566757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 999/1890] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:32 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:33.593106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f8af5936-c077-41e2-983c-97fe99a27334 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:33.593691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f8af5936-c077-41e2-983c-97fe99a27334 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:33.600398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8af5936-c077-41e2-983c-97fe99a27334 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:33.600872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8af5936-c077-41e2-983c-97fe99a27334 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:33.601308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8af5936-c077-41e2-983c-97fe99a27334 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:33.601986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8af5936-c077-41e2-983c-97fe99a27334 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:33.602433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8af5936-c077-41e2-983c-97fe99a27334 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:33.602885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f8af5936-c077-41e2-983c-97fe99a27334 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:33.606734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=78 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:33.731550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f8af5936-c077-41e2-983c-97fe99a27334 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:33.740594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f8af5936-c077-41e2-983c-97fe99a27334 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.151311 Aug 24 05:18:33.741156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 892/1891] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:33 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:34.763121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1261b805-46fc-46fb-8275-a1983ac1e84e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:34.763733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1261b805-46fc-46fb-8275-a1983ac1e84e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:34.770871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1261b805-46fc-46fb-8275-a1983ac1e84e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:34.771366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1261b805-46fc-46fb-8275-a1983ac1e84e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:34.771796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1261b805-46fc-46fb-8275-a1983ac1e84e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:34.772683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1261b805-46fc-46fb-8275-a1983ac1e84e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:34.773135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1261b805-46fc-46fb-8275-a1983ac1e84e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:34.773568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1261b805-46fc-46fb-8275-a1983ac1e84e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:34.908404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1261b805-46fc-46fb-8275-a1983ac1e84e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:34.917247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1261b805-46fc-46fb-8275-a1983ac1e84e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159130 Aug 24 05:18:34.917805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1000/1892] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:34 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:35.938811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dbbeba79-323c-419f-b8b0-f4d9a36f082a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:35.939499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dbbeba79-323c-419f-b8b0-f4d9a36f082a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:35.946842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbbeba79-323c-419f-b8b0-f4d9a36f082a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:35.947329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbbeba79-323c-419f-b8b0-f4d9a36f082a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:35.947762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbbeba79-323c-419f-b8b0-f4d9a36f082a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:35.948455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbbeba79-323c-419f-b8b0-f4d9a36f082a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:35.948902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbbeba79-323c-419f-b8b0-f4d9a36f082a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:35.949320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dbbeba79-323c-419f-b8b0-f4d9a36f082a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:36.094171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dbbeba79-323c-419f-b8b0-f4d9a36f082a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:36.106015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dbbeba79-323c-419f-b8b0-f4d9a36f082a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.171036 Aug 24 05:18:36.106613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 893/1893] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:35 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:37.127616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9395786f-c1f7-4871-9e94-61656fbaeb0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:37.128283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9395786f-c1f7-4871-9e94-61656fbaeb0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:37.135593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9395786f-c1f7-4871-9e94-61656fbaeb0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:37.136062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9395786f-c1f7-4871-9e94-61656fbaeb0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:37.136495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9395786f-c1f7-4871-9e94-61656fbaeb0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:37.137178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9395786f-c1f7-4871-9e94-61656fbaeb0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:37.137620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9395786f-c1f7-4871-9e94-61656fbaeb0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:37.138031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9395786f-c1f7-4871-9e94-61656fbaeb0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:37.278817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9395786f-c1f7-4871-9e94-61656fbaeb0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:37.288272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9395786f-c1f7-4871-9e94-61656fbaeb0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.164449 Aug 24 05:18:37.288851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1001/1894] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:37 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:38.500525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-98b2639c-b8c0-4380-8fea-d5d58c7edf31 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:38.501133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-98b2639c-b8c0-4380-8fea-d5d58c7edf31 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:38.502980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:38.508179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98b2639c-b8c0-4380-8fea-d5d58c7edf31 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:38.508657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98b2639c-b8c0-4380-8fea-d5d58c7edf31 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:38.509089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98b2639c-b8c0-4380-8fea-d5d58c7edf31 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:38.509770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98b2639c-b8c0-4380-8fea-d5d58c7edf31 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:38.510217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98b2639c-b8c0-4380-8fea-d5d58c7edf31 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:38.510633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98b2639c-b8c0-4380-8fea-d5d58c7edf31 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:38.637351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-98b2639c-b8c0-4380-8fea-d5d58c7edf31 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:38.646130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-98b2639c-b8c0-4380-8fea-d5d58c7edf31 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.340259 Aug 24 05:18:38.646709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 894/1895] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:38 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:39.666646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d722c4ff-5e8c-4997-a307-09e570e05a05 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:39.667279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d722c4ff-5e8c-4997-a307-09e570e05a05 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:39.673800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d722c4ff-5e8c-4997-a307-09e570e05a05 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:39.674279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d722c4ff-5e8c-4997-a307-09e570e05a05 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:39.674748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d722c4ff-5e8c-4997-a307-09e570e05a05 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:39.675449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d722c4ff-5e8c-4997-a307-09e570e05a05 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:39.675906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d722c4ff-5e8c-4997-a307-09e570e05a05 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:39.676386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d722c4ff-5e8c-4997-a307-09e570e05a05 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:39.814832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d722c4ff-5e8c-4997-a307-09e570e05a05 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:39.823763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d722c4ff-5e8c-4997-a307-09e570e05a05 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161036 Aug 24 05:18:39.824325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1002/1896] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:39 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:40.844651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b64fe4a6-df20-4dea-8eab-e2dece2f071d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:40.845268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b64fe4a6-df20-4dea-8eab-e2dece2f071d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:40.852444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64fe4a6-df20-4dea-8eab-e2dece2f071d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:40.852930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64fe4a6-df20-4dea-8eab-e2dece2f071d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:40.853367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64fe4a6-df20-4dea-8eab-e2dece2f071d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:40.854065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64fe4a6-df20-4dea-8eab-e2dece2f071d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:40.854543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64fe4a6-df20-4dea-8eab-e2dece2f071d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:40.855000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64fe4a6-df20-4dea-8eab-e2dece2f071d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:40.988243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b64fe4a6-df20-4dea-8eab-e2dece2f071d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:40.998756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b64fe4a6-df20-4dea-8eab-e2dece2f071d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157838 Aug 24 05:18:40.999326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 895/1897] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:40 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:42.021452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-02b1da91-f833-45bf-b348-3f759d6f7bcc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:42.022006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-02b1da91-f833-45bf-b348-3f759d6f7bcc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:42.028405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02b1da91-f833-45bf-b348-3f759d6f7bcc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:42.028870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02b1da91-f833-45bf-b348-3f759d6f7bcc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:42.029293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02b1da91-f833-45bf-b348-3f759d6f7bcc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:42.029965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02b1da91-f833-45bf-b348-3f759d6f7bcc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:42.030403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02b1da91-f833-45bf-b348-3f759d6f7bcc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:42.030853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02b1da91-f833-45bf-b348-3f759d6f7bcc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:42.169984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-02b1da91-f833-45bf-b348-3f759d6f7bcc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:42.178255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-02b1da91-f833-45bf-b348-3f759d6f7bcc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161909 Aug 24 05:18:42.179106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1003/1898] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:42 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:43.199494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dd241ccd-9892-4a9f-9010-b5e63560325b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:43.200150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dd241ccd-9892-4a9f-9010-b5e63560325b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:43.206958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd241ccd-9892-4a9f-9010-b5e63560325b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:43.207537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd241ccd-9892-4a9f-9010-b5e63560325b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:43.207976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd241ccd-9892-4a9f-9010-b5e63560325b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:43.208790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd241ccd-9892-4a9f-9010-b5e63560325b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:43.209323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd241ccd-9892-4a9f-9010-b5e63560325b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:43.209818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd241ccd-9892-4a9f-9010-b5e63560325b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:43.349773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dd241ccd-9892-4a9f-9010-b5e63560325b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:43.358324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dd241ccd-9892-4a9f-9010-b5e63560325b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162815 Aug 24 05:18:43.358921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 896/1899] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:43 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:44.381326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-767d8445-d506-439a-81bf-89e6f5bdff48 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:44.381938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-767d8445-d506-439a-81bf-89e6f5bdff48 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:44.384334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:18:44.389809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-767d8445-d506-439a-81bf-89e6f5bdff48 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:44.390287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-767d8445-d506-439a-81bf-89e6f5bdff48 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:44.390742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-767d8445-d506-439a-81bf-89e6f5bdff48 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:44.391442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-767d8445-d506-439a-81bf-89e6f5bdff48 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:44.391891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-767d8445-d506-439a-81bf-89e6f5bdff48 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:44.392314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-767d8445-d506-439a-81bf-89e6f5bdff48 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:44.535913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-767d8445-d506-439a-81bf-89e6f5bdff48 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:44.545114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-767d8445-d506-439a-81bf-89e6f5bdff48 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.168152 Aug 24 05:18:44.545600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1004/1900] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:44 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:18:45.567634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-92e00a01-e9f8-497d-9264-36e2cb584eca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:45.568239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-92e00a01-e9f8-497d-9264-36e2cb584eca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:45.575029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92e00a01-e9f8-497d-9264-36e2cb584eca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:45.575655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92e00a01-e9f8-497d-9264-36e2cb584eca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:45.576095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92e00a01-e9f8-497d-9264-36e2cb584eca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:45.576784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92e00a01-e9f8-497d-9264-36e2cb584eca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:45.577234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92e00a01-e9f8-497d-9264-36e2cb584eca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:45.577643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92e00a01-e9f8-497d-9264-36e2cb584eca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:45.717019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-92e00a01-e9f8-497d-9264-36e2cb584eca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:45.726189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-92e00a01-e9f8-497d-9264-36e2cb584eca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162579 Aug 24 05:18:45.726787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 897/1901] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:45 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:46.747965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-649d9cf1-d303-4c43-8d1b-87be9e0cba14 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:46.748607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-649d9cf1-d303-4c43-8d1b-87be9e0cba14 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:46.756347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-649d9cf1-d303-4c43-8d1b-87be9e0cba14 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:46.756831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-649d9cf1-d303-4c43-8d1b-87be9e0cba14 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:46.757299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-649d9cf1-d303-4c43-8d1b-87be9e0cba14 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:46.757996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-649d9cf1-d303-4c43-8d1b-87be9e0cba14 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:46.758449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-649d9cf1-d303-4c43-8d1b-87be9e0cba14 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:46.758901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-649d9cf1-d303-4c43-8d1b-87be9e0cba14 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:46.885286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-649d9cf1-d303-4c43-8d1b-87be9e0cba14 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:46.893619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-649d9cf1-d303-4c43-8d1b-87be9e0cba14 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.149474 Aug 24 05:18:46.894198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1005/1902] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:46 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:47.916141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e817338a-1aeb-4a05-8dc1-7ea3f6bc02c1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:47.916763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e817338a-1aeb-4a05-8dc1-7ea3f6bc02c1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:47.923435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e817338a-1aeb-4a05-8dc1-7ea3f6bc02c1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:47.923910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e817338a-1aeb-4a05-8dc1-7ea3f6bc02c1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:47.924338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e817338a-1aeb-4a05-8dc1-7ea3f6bc02c1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:47.925016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e817338a-1aeb-4a05-8dc1-7ea3f6bc02c1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:47.925461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e817338a-1aeb-4a05-8dc1-7ea3f6bc02c1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:47.925884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e817338a-1aeb-4a05-8dc1-7ea3f6bc02c1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:48.052340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e817338a-1aeb-4a05-8dc1-7ea3f6bc02c1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:48.060751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e817338a-1aeb-4a05-8dc1-7ea3f6bc02c1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.148480 Aug 24 05:18:48.061325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 898/1903] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:47 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:49.082263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6b08c3e3-576e-4f34-8409-d5b0ba45b44e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:49.082934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6b08c3e3-576e-4f34-8409-d5b0ba45b44e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:49.089345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b08c3e3-576e-4f34-8409-d5b0ba45b44e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:49.089819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b08c3e3-576e-4f34-8409-d5b0ba45b44e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:49.090256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b08c3e3-576e-4f34-8409-d5b0ba45b44e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:49.090975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b08c3e3-576e-4f34-8409-d5b0ba45b44e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:49.091425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b08c3e3-576e-4f34-8409-d5b0ba45b44e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:49.091846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6b08c3e3-576e-4f34-8409-d5b0ba45b44e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:49.229105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6b08c3e3-576e-4f34-8409-d5b0ba45b44e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:49.237481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6b08c3e3-576e-4f34-8409-d5b0ba45b44e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159207 Aug 24 05:18:49.238399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1006/1904] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:49 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:50.259704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5e1b780a-d3a8-4af0-bf98-e7cbbad18dda tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:50.260309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5e1b780a-d3a8-4af0-bf98-e7cbbad18dda tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:50.266803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e1b780a-d3a8-4af0-bf98-e7cbbad18dda tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:50.267283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e1b780a-d3a8-4af0-bf98-e7cbbad18dda tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:50.267716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e1b780a-d3a8-4af0-bf98-e7cbbad18dda tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:50.268396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e1b780a-d3a8-4af0-bf98-e7cbbad18dda tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:50.268844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e1b780a-d3a8-4af0-bf98-e7cbbad18dda tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:50.269277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e1b780a-d3a8-4af0-bf98-e7cbbad18dda tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:50.402482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5e1b780a-d3a8-4af0-bf98-e7cbbad18dda tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:50.411727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5e1b780a-d3a8-4af0-bf98-e7cbbad18dda tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155022 Aug 24 05:18:50.412286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 899/1905] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:50 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:18:51.432982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-65cb93d1-168e-4397-9ab7-c10c2eb87847 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:51.433678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-65cb93d1-168e-4397-9ab7-c10c2eb87847 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:51.440171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65cb93d1-168e-4397-9ab7-c10c2eb87847 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:51.440733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65cb93d1-168e-4397-9ab7-c10c2eb87847 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:51.441166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65cb93d1-168e-4397-9ab7-c10c2eb87847 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:51.442562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65cb93d1-168e-4397-9ab7-c10c2eb87847 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:51.443220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65cb93d1-168e-4397-9ab7-c10c2eb87847 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:51.443645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65cb93d1-168e-4397-9ab7-c10c2eb87847 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:51.569182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-65cb93d1-168e-4397-9ab7-c10c2eb87847 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:51.577356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-65cb93d1-168e-4397-9ab7-c10c2eb87847 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.148631 Aug 24 05:18:51.577914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1007/1906] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:51 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:52.597610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a9907b35-f4c5-4f93-8989-70dfc974f728 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:52.599026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a9907b35-f4c5-4f93-8989-70dfc974f728 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:52.605431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9907b35-f4c5-4f93-8989-70dfc974f728 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:52.605904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9907b35-f4c5-4f93-8989-70dfc974f728 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:52.606333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9907b35-f4c5-4f93-8989-70dfc974f728 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:52.607039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9907b35-f4c5-4f93-8989-70dfc974f728 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:52.607492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9907b35-f4c5-4f93-8989-70dfc974f728 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:52.607909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9907b35-f4c5-4f93-8989-70dfc974f728 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:52.747676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a9907b35-f4c5-4f93-8989-70dfc974f728 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:52.756308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a9907b35-f4c5-4f93-8989-70dfc974f728 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162523 Aug 24 05:18:52.756881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 900/1907] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:52 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:53.777174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f07705f9-2772-4a20-bb39-0dd4ee0d79ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:53.777785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f07705f9-2772-4a20-bb39-0dd4ee0d79ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:53.784572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f07705f9-2772-4a20-bb39-0dd4ee0d79ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:53.785078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f07705f9-2772-4a20-bb39-0dd4ee0d79ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:53.786168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f07705f9-2772-4a20-bb39-0dd4ee0d79ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:53.786894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f07705f9-2772-4a20-bb39-0dd4ee0d79ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:53.787342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f07705f9-2772-4a20-bb39-0dd4ee0d79ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:53.787761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f07705f9-2772-4a20-bb39-0dd4ee0d79ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:53.919043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f07705f9-2772-4a20-bb39-0dd4ee0d79ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:53.929557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f07705f9-2772-4a20-bb39-0dd4ee0d79ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156273 Aug 24 05:18:53.930164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1008/1908] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:53 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:54.950964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-66d79771-1141-49cf-95cc-b0df1e5f1fd3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:54.951587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-66d79771-1141-49cf-95cc-b0df1e5f1fd3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:54.958588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d79771-1141-49cf-95cc-b0df1e5f1fd3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:54.959180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d79771-1141-49cf-95cc-b0df1e5f1fd3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:54.959632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d79771-1141-49cf-95cc-b0df1e5f1fd3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:54.960328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d79771-1141-49cf-95cc-b0df1e5f1fd3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:54.960783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d79771-1141-49cf-95cc-b0df1e5f1fd3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:54.961201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66d79771-1141-49cf-95cc-b0df1e5f1fd3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:55.090127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-66d79771-1141-49cf-95cc-b0df1e5f1fd3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:55.098496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-66d79771-1141-49cf-95cc-b0df1e5f1fd3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.151611 Aug 24 05:18:55.099079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 901/1909] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:54 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:18:56.119842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-50b01940-b9a0-4c5c-8d60-f3cc1678751f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:56.120448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-50b01940-b9a0-4c5c-8d60-f3cc1678751f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:56.127095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b01940-b9a0-4c5c-8d60-f3cc1678751f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:56.127560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b01940-b9a0-4c5c-8d60-f3cc1678751f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:56.127986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b01940-b9a0-4c5c-8d60-f3cc1678751f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:56.128653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b01940-b9a0-4c5c-8d60-f3cc1678751f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:56.129729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b01940-b9a0-4c5c-8d60-f3cc1678751f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:56.130313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50b01940-b9a0-4c5c-8d60-f3cc1678751f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:56.271682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-50b01940-b9a0-4c5c-8d60-f3cc1678751f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:56.279889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-50b01940-b9a0-4c5c-8d60-f3cc1678751f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.163886 Aug 24 05:18:56.280447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1009/1910] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:56 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:57.301053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7992b49c-c763-48b3-bc18-e54f59ed8c0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:57.301670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7992b49c-c763-48b3-bc18-e54f59ed8c0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:57.308398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7992b49c-c763-48b3-bc18-e54f59ed8c0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:57.308867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7992b49c-c763-48b3-bc18-e54f59ed8c0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:57.309296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7992b49c-c763-48b3-bc18-e54f59ed8c0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:57.309987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7992b49c-c763-48b3-bc18-e54f59ed8c0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:57.310439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7992b49c-c763-48b3-bc18-e54f59ed8c0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:57.310889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7992b49c-c763-48b3-bc18-e54f59ed8c0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:57.446246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7992b49c-c763-48b3-bc18-e54f59ed8c0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:57.455044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7992b49c-c763-48b3-bc18-e54f59ed8c0b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158089 Aug 24 05:18:57.455709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 902/1911] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:57 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:58.477067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fb01d94b-fb4d-4102-936f-2aee09677533 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:58.477687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fb01d94b-fb4d-4102-936f-2aee09677533 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:58.484179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb01d94b-fb4d-4102-936f-2aee09677533 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:58.484654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb01d94b-fb4d-4102-936f-2aee09677533 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:58.485086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb01d94b-fb4d-4102-936f-2aee09677533 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:58.485768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb01d94b-fb4d-4102-936f-2aee09677533 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:58.486244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb01d94b-fb4d-4102-936f-2aee09677533 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:58.486663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb01d94b-fb4d-4102-936f-2aee09677533 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:58.621167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fb01d94b-fb4d-4102-936f-2aee09677533 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:58.629402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fb01d94b-fb4d-4102-936f-2aee09677533 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156482 Aug 24 05:18:58.629960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1010/1912] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:58 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:18:59.650610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-74263e61-d433-43ef-8996-992ee32bfaa2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:18:59.651330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-74263e61-d433-43ef-8996-992ee32bfaa2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:18:59.657806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-74263e61-d433-43ef-8996-992ee32bfaa2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:59.658282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-74263e61-d433-43ef-8996-992ee32bfaa2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:59.658733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-74263e61-d433-43ef-8996-992ee32bfaa2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:59.659420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-74263e61-d433-43ef-8996-992ee32bfaa2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:18:59.659865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-74263e61-d433-43ef-8996-992ee32bfaa2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:18:59.661005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-74263e61-d433-43ef-8996-992ee32bfaa2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:18:59.792904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-74263e61-d433-43ef-8996-992ee32bfaa2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:18:59.801948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-74263e61-d433-43ef-8996-992ee32bfaa2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155141 Aug 24 05:18:59.802731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 903/1913] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:18:59 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:00.825054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2822bc97-f0b1-4bce-8cb4-0dcf889ed595 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:00.825686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2822bc97-f0b1-4bce-8cb4-0dcf889ed595 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:00.832672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2822bc97-f0b1-4bce-8cb4-0dcf889ed595 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:00.833229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2822bc97-f0b1-4bce-8cb4-0dcf889ed595 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:00.833657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2822bc97-f0b1-4bce-8cb4-0dcf889ed595 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:00.834458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2822bc97-f0b1-4bce-8cb4-0dcf889ed595 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:00.834971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2822bc97-f0b1-4bce-8cb4-0dcf889ed595 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:00.835449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2822bc97-f0b1-4bce-8cb4-0dcf889ed595 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:00.838261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:00.971205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2822bc97-f0b1-4bce-8cb4-0dcf889ed595 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:00.980016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2822bc97-f0b1-4bce-8cb4-0dcf889ed595 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160204 Aug 24 05:19:00.980582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1011/1914] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:00 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:19:02.001675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-58f241a5-9dd0-46ea-97f3-67c061affd8b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:02.002293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-58f241a5-9dd0-46ea-97f3-67c061affd8b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:02.009057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58f241a5-9dd0-46ea-97f3-67c061affd8b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:02.009539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58f241a5-9dd0-46ea-97f3-67c061affd8b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:02.009973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58f241a5-9dd0-46ea-97f3-67c061affd8b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:02.010722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58f241a5-9dd0-46ea-97f3-67c061affd8b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:02.011154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58f241a5-9dd0-46ea-97f3-67c061affd8b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:02.011576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58f241a5-9dd0-46ea-97f3-67c061affd8b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:02.144250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-58f241a5-9dd0-46ea-97f3-67c061affd8b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:02.152645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-58f241a5-9dd0-46ea-97f3-67c061affd8b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155444 Aug 24 05:19:02.153203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 904/1915] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:01 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:03.174451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5fb5c925-b70d-4007-ad9e-6c2c6f192822 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:03.175090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5fb5c925-b70d-4007-ad9e-6c2c6f192822 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:03.181776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fb5c925-b70d-4007-ad9e-6c2c6f192822 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:03.182251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fb5c925-b70d-4007-ad9e-6c2c6f192822 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:03.182701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fb5c925-b70d-4007-ad9e-6c2c6f192822 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:03.183383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fb5c925-b70d-4007-ad9e-6c2c6f192822 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:03.183858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fb5c925-b70d-4007-ad9e-6c2c6f192822 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:03.184276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fb5c925-b70d-4007-ad9e-6c2c6f192822 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:03.313625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5fb5c925-b70d-4007-ad9e-6c2c6f192822 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:03.322498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5fb5c925-b70d-4007-ad9e-6c2c6f192822 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152629 Aug 24 05:19:03.323095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1012/1916] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:03 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:04.343265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e5072070-ca36-456e-a5c5-3b28048b2752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:04.343875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e5072070-ca36-456e-a5c5-3b28048b2752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:04.353519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5072070-ca36-456e-a5c5-3b28048b2752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:04.355087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5072070-ca36-456e-a5c5-3b28048b2752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:04.355534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5072070-ca36-456e-a5c5-3b28048b2752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:04.356239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5072070-ca36-456e-a5c5-3b28048b2752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:04.356695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5072070-ca36-456e-a5c5-3b28048b2752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:04.357120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e5072070-ca36-456e-a5c5-3b28048b2752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:04.359872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=78 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:04.493893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e5072070-ca36-456e-a5c5-3b28048b2752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:04.502363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e5072070-ca36-456e-a5c5-3b28048b2752 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.163109 Aug 24 05:19:04.502966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 905/1917] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:04 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:05.524209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4a2a8e18-2ada-4c6a-a0fd-bf93180a1dea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:05.524830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4a2a8e18-2ada-4c6a-a0fd-bf93180a1dea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:05.531484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a2a8e18-2ada-4c6a-a0fd-bf93180a1dea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:05.531958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a2a8e18-2ada-4c6a-a0fd-bf93180a1dea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:05.532389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a2a8e18-2ada-4c6a-a0fd-bf93180a1dea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:05.533078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a2a8e18-2ada-4c6a-a0fd-bf93180a1dea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:05.533531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a2a8e18-2ada-4c6a-a0fd-bf93180a1dea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:05.533951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a2a8e18-2ada-4c6a-a0fd-bf93180a1dea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:05.662913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4a2a8e18-2ada-4c6a-a0fd-bf93180a1dea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:05.671352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4a2a8e18-2ada-4c6a-a0fd-bf93180a1dea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.151796 Aug 24 05:19:05.671929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1013/1918] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:05 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:06.695165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-73a77320-46f5-414e-bf90-173c60411bd4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:06.695804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-73a77320-46f5-414e-bf90-173c60411bd4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:06.702276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73a77320-46f5-414e-bf90-173c60411bd4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:06.702781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73a77320-46f5-414e-bf90-173c60411bd4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:06.703221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73a77320-46f5-414e-bf90-173c60411bd4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:06.703927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73a77320-46f5-414e-bf90-173c60411bd4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:06.704377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73a77320-46f5-414e-bf90-173c60411bd4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:06.704791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73a77320-46f5-414e-bf90-173c60411bd4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:06.842806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-73a77320-46f5-414e-bf90-173c60411bd4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:06.851212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-73a77320-46f5-414e-bf90-173c60411bd4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159910 Aug 24 05:19:06.851776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 906/1919] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:06 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:07.875154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-16ccc412-c8e3-42e7-8c13-341fc3173e45 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:07.876383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-16ccc412-c8e3-42e7-8c13-341fc3173e45 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:07.884309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16ccc412-c8e3-42e7-8c13-341fc3173e45 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:07.884793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16ccc412-c8e3-42e7-8c13-341fc3173e45 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:07.885227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16ccc412-c8e3-42e7-8c13-341fc3173e45 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:07.885919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16ccc412-c8e3-42e7-8c13-341fc3173e45 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:07.886368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16ccc412-c8e3-42e7-8c13-341fc3173e45 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:07.886825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16ccc412-c8e3-42e7-8c13-341fc3173e45 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:08.021148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-16ccc412-c8e3-42e7-8c13-341fc3173e45 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:08.029498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-16ccc412-c8e3-42e7-8c13-341fc3173e45 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159280 Aug 24 05:19:08.030061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1014/1920] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:07 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:19:09.050961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2c45f619-18bf-4613-9157-38241759ced9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:09.051612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2c45f619-18bf-4613-9157-38241759ced9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:09.053720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:09.059198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c45f619-18bf-4613-9157-38241759ced9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:09.059683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c45f619-18bf-4613-9157-38241759ced9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:09.060122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c45f619-18bf-4613-9157-38241759ced9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:09.060813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c45f619-18bf-4613-9157-38241759ced9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:09.061264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c45f619-18bf-4613-9157-38241759ced9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:09.061689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c45f619-18bf-4613-9157-38241759ced9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:09.197323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2c45f619-18bf-4613-9157-38241759ced9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:09.205814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2c45f619-18bf-4613-9157-38241759ced9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159506 Aug 24 05:19:09.206607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 907/1921] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:09 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:10.229231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0864ac6f-4a79-4359-a2cb-48896c02b536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:10.229958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0864ac6f-4a79-4359-a2cb-48896c02b536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:10.236586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0864ac6f-4a79-4359-a2cb-48896c02b536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:10.237059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0864ac6f-4a79-4359-a2cb-48896c02b536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:10.237484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0864ac6f-4a79-4359-a2cb-48896c02b536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:10.238309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0864ac6f-4a79-4359-a2cb-48896c02b536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:10.238760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0864ac6f-4a79-4359-a2cb-48896c02b536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:10.239175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0864ac6f-4a79-4359-a2cb-48896c02b536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:10.370520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0864ac6f-4a79-4359-a2cb-48896c02b536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:10.379500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0864ac6f-4a79-4359-a2cb-48896c02b536 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153712 Aug 24 05:19:10.380233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1015/1922] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:10 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:11.400995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-49d5321f-f0c2-45fd-9d9d-27b58adea165 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:11.401535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-49d5321f-f0c2-45fd-9d9d-27b58adea165 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:11.408072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49d5321f-f0c2-45fd-9d9d-27b58adea165 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:11.408547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49d5321f-f0c2-45fd-9d9d-27b58adea165 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:11.408979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49d5321f-f0c2-45fd-9d9d-27b58adea165 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:11.409661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49d5321f-f0c2-45fd-9d9d-27b58adea165 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:11.410883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49d5321f-f0c2-45fd-9d9d-27b58adea165 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:11.411354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49d5321f-f0c2-45fd-9d9d-27b58adea165 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:11.552044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-49d5321f-f0c2-45fd-9d9d-27b58adea165 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:11.561709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-49d5321f-f0c2-45fd-9d9d-27b58adea165 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.164614 Aug 24 05:19:11.562280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 908/1923] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:11 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:12.583533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9f0f528f-c9ca-4309-a363-a26677d015e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:12.584154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9f0f528f-c9ca-4309-a363-a26677d015e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:12.590560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f0f528f-c9ca-4309-a363-a26677d015e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:12.591074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f0f528f-c9ca-4309-a363-a26677d015e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:12.591510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f0f528f-c9ca-4309-a363-a26677d015e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:12.592203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f0f528f-c9ca-4309-a363-a26677d015e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:12.592645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f0f528f-c9ca-4309-a363-a26677d015e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:12.593065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f0f528f-c9ca-4309-a363-a26677d015e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:12.725868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9f0f528f-c9ca-4309-a363-a26677d015e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:12.734243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9f0f528f-c9ca-4309-a363-a26677d015e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155376 Aug 24 05:19:12.734841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1016/1924] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:12 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:13.757102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c47e9a95-a18d-4db5-b0b9-166ffbcc7105 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:13.757719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c47e9a95-a18d-4db5-b0b9-166ffbcc7105 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:13.764205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c47e9a95-a18d-4db5-b0b9-166ffbcc7105 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:13.764681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c47e9a95-a18d-4db5-b0b9-166ffbcc7105 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:13.765113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c47e9a95-a18d-4db5-b0b9-166ffbcc7105 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:13.765797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c47e9a95-a18d-4db5-b0b9-166ffbcc7105 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:13.766245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c47e9a95-a18d-4db5-b0b9-166ffbcc7105 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:13.766664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c47e9a95-a18d-4db5-b0b9-166ffbcc7105 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:13.901427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c47e9a95-a18d-4db5-b0b9-166ffbcc7105 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:13.909638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c47e9a95-a18d-4db5-b0b9-166ffbcc7105 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156392 Aug 24 05:19:13.910838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 909/1925] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:13 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:14.931761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e5491ee8-0d26-4546-ba09-700f0a035251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:14.932294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e5491ee8-0d26-4546-ba09-700f0a035251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:14.934540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:14.939675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5491ee8-0d26-4546-ba09-700f0a035251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:14.940148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5491ee8-0d26-4546-ba09-700f0a035251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:14.940578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5491ee8-0d26-4546-ba09-700f0a035251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:14.941464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5491ee8-0d26-4546-ba09-700f0a035251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:14.941907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5491ee8-0d26-4546-ba09-700f0a035251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:14.942350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5491ee8-0d26-4546-ba09-700f0a035251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:15.072913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e5491ee8-0d26-4546-ba09-700f0a035251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:15.081085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e5491ee8-0d26-4546-ba09-700f0a035251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153592 Aug 24 05:19:15.082202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1017/1926] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:14 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:16.102997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9e6a120e-f4ee-42e7-9575-085e0662a9f2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:16.103605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9e6a120e-f4ee-42e7-9575-085e0662a9f2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:16.109990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e6a120e-f4ee-42e7-9575-085e0662a9f2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:16.110466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e6a120e-f4ee-42e7-9575-085e0662a9f2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:16.110933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e6a120e-f4ee-42e7-9575-085e0662a9f2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:16.111617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e6a120e-f4ee-42e7-9575-085e0662a9f2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:16.112063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e6a120e-f4ee-42e7-9575-085e0662a9f2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:16.112487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e6a120e-f4ee-42e7-9575-085e0662a9f2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:16.244048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9e6a120e-f4ee-42e7-9575-085e0662a9f2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:16.252288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9e6a120e-f4ee-42e7-9575-085e0662a9f2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153378 Aug 24 05:19:16.252848 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 910/1927] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:16 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:17.273905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-16bcde6b-ff81-4a41-acc1-54b5607eb9b5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:17.274505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-16bcde6b-ff81-4a41-acc1-54b5607eb9b5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:17.280986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16bcde6b-ff81-4a41-acc1-54b5607eb9b5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:17.281457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16bcde6b-ff81-4a41-acc1-54b5607eb9b5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:17.281885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16bcde6b-ff81-4a41-acc1-54b5607eb9b5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:17.282561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16bcde6b-ff81-4a41-acc1-54b5607eb9b5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:17.283042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16bcde6b-ff81-4a41-acc1-54b5607eb9b5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:17.283478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16bcde6b-ff81-4a41-acc1-54b5607eb9b5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:17.417257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-16bcde6b-ff81-4a41-acc1-54b5607eb9b5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:17.426098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-16bcde6b-ff81-4a41-acc1-54b5607eb9b5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155537 Aug 24 05:19:17.426790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1018/1928] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:17 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:18.448859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f6085700-cc8d-433c-9d2c-394358bb3d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:18.449576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f6085700-cc8d-433c-9d2c-394358bb3d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:18.456620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6085700-cc8d-433c-9d2c-394358bb3d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:18.457246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6085700-cc8d-433c-9d2c-394358bb3d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:18.457778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6085700-cc8d-433c-9d2c-394358bb3d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:18.458501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6085700-cc8d-433c-9d2c-394358bb3d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:18.458981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6085700-cc8d-433c-9d2c-394358bb3d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:18.459390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6085700-cc8d-433c-9d2c-394358bb3d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:18.595860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f6085700-cc8d-433c-9d2c-394358bb3d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:18.604641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f6085700-cc8d-433c-9d2c-394358bb3d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160039 Aug 24 05:19:18.605201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 911/1929] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:18 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:19.626277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8b02261f-ad2b-488e-aff7-9d8359ea74ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:19.626971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8b02261f-ad2b-488e-aff7-9d8359ea74ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:19.633659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b02261f-ad2b-488e-aff7-9d8359ea74ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:19.634133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b02261f-ad2b-488e-aff7-9d8359ea74ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:19.634575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b02261f-ad2b-488e-aff7-9d8359ea74ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:19.635310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b02261f-ad2b-488e-aff7-9d8359ea74ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:19.635756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b02261f-ad2b-488e-aff7-9d8359ea74ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:19.636174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b02261f-ad2b-488e-aff7-9d8359ea74ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:19.766875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8b02261f-ad2b-488e-aff7-9d8359ea74ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:19.775851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8b02261f-ad2b-488e-aff7-9d8359ea74ea tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153506 Aug 24 05:19:19.776406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1019/1930] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:19 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:20.612547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:20.612989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:19:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:20.797482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2e92e131-141f-4c33-80ad-914979ef54cc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:20.798120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2e92e131-141f-4c33-80ad-914979ef54cc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:20.805615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e92e131-141f-4c33-80ad-914979ef54cc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:20.806098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e92e131-141f-4c33-80ad-914979ef54cc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:20.806566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e92e131-141f-4c33-80ad-914979ef54cc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:20.807270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e92e131-141f-4c33-80ad-914979ef54cc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:20.807726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e92e131-141f-4c33-80ad-914979ef54cc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:20.808162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e92e131-141f-4c33-80ad-914979ef54cc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:20.948564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2e92e131-141f-4c33-80ad-914979ef54cc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:20.959769 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2e92e131-141f-4c33-80ad-914979ef54cc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.166148 Aug 24 05:19:20.960541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 912/1931] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:20 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:21.147865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:21.148032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:19:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:21.981307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f47275db-d4f0-4cb0-9794-337507b3ae32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:21.981910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f47275db-d4f0-4cb0-9794-337507b3ae32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:21.988481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f47275db-d4f0-4cb0-9794-337507b3ae32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:21.988954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f47275db-d4f0-4cb0-9794-337507b3ae32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:21.989384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f47275db-d4f0-4cb0-9794-337507b3ae32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:21.990068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f47275db-d4f0-4cb0-9794-337507b3ae32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:21.990514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f47275db-d4f0-4cb0-9794-337507b3ae32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:21.990955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f47275db-d4f0-4cb0-9794-337507b3ae32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:22.129153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f47275db-d4f0-4cb0-9794-337507b3ae32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:22.138337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f47275db-d4f0-4cb0-9794-337507b3ae32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160981 Aug 24 05:19:22.138948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1020/1932] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:21 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:23.158661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3ddfe653-f755-420d-932f-fa6bcdf33940 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:23.159295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3ddfe653-f755-420d-932f-fa6bcdf33940 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:23.166502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ddfe653-f755-420d-932f-fa6bcdf33940 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:23.167013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ddfe653-f755-420d-932f-fa6bcdf33940 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:23.167442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ddfe653-f755-420d-932f-fa6bcdf33940 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:23.168129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ddfe653-f755-420d-932f-fa6bcdf33940 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:23.168576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ddfe653-f755-420d-932f-fa6bcdf33940 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:23.168996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3ddfe653-f755-420d-932f-fa6bcdf33940 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:23.304254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3ddfe653-f755-420d-932f-fa6bcdf33940 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:23.313981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3ddfe653-f755-420d-932f-fa6bcdf33940 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159069 Aug 24 05:19:23.314757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 913/1933] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:23 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:23.651928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:23.652171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:19:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:24.336235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a55eafa9-a4d2-4f4a-9714-a01301e95fee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:24.337011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a55eafa9-a4d2-4f4a-9714-a01301e95fee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:24.344823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a55eafa9-a4d2-4f4a-9714-a01301e95fee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:24.345399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a55eafa9-a4d2-4f4a-9714-a01301e95fee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:24.345929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a55eafa9-a4d2-4f4a-9714-a01301e95fee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:24.346846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a55eafa9-a4d2-4f4a-9714-a01301e95fee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:24.347608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a55eafa9-a4d2-4f4a-9714-a01301e95fee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:24.348104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a55eafa9-a4d2-4f4a-9714-a01301e95fee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:24.482804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a55eafa9-a4d2-4f4a-9714-a01301e95fee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:24.492416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a55eafa9-a4d2-4f4a-9714-a01301e95fee tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160889 Aug 24 05:19:24.492972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1021/1934] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:24 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:25.515522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-af652c88-1f69-42c1-b13a-2532ab395bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:25.516129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-af652c88-1f69-42c1-b13a-2532ab395bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:25.523544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af652c88-1f69-42c1-b13a-2532ab395bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:25.524023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af652c88-1f69-42c1-b13a-2532ab395bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:25.524458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af652c88-1f69-42c1-b13a-2532ab395bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:25.525144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af652c88-1f69-42c1-b13a-2532ab395bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:25.525610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af652c88-1f69-42c1-b13a-2532ab395bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:25.526030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af652c88-1f69-42c1-b13a-2532ab395bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:25.661137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-af652c88-1f69-42c1-b13a-2532ab395bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:25.669335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-af652c88-1f69-42c1-b13a-2532ab395bce tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157740 Aug 24 05:19:25.669899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 914/1935] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:25 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:26.131753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:26.132287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:19:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:26.691236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7034e8cb-1f66-41dd-8a32-59e06394be8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:26.691895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7034e8cb-1f66-41dd-8a32-59e06394be8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:26.699690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7034e8cb-1f66-41dd-8a32-59e06394be8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:26.700210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7034e8cb-1f66-41dd-8a32-59e06394be8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:26.700640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7034e8cb-1f66-41dd-8a32-59e06394be8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:26.701319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7034e8cb-1f66-41dd-8a32-59e06394be8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:26.701757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7034e8cb-1f66-41dd-8a32-59e06394be8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:26.702166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7034e8cb-1f66-41dd-8a32-59e06394be8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:26.865783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7034e8cb-1f66-41dd-8a32-59e06394be8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:26.874396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7034e8cb-1f66-41dd-8a32-59e06394be8d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.187034 Aug 24 05:19:26.875169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1022/1936] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:26 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:27.895129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-077fbc94-531e-449b-9a37-100599da1e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:27.895881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-077fbc94-531e-449b-9a37-100599da1e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:27.902909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-077fbc94-531e-449b-9a37-100599da1e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:27.903409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-077fbc94-531e-449b-9a37-100599da1e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:27.903917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-077fbc94-531e-449b-9a37-100599da1e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:27.904656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-077fbc94-531e-449b-9a37-100599da1e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:27.905221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-077fbc94-531e-449b-9a37-100599da1e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:27.905639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-077fbc94-531e-449b-9a37-100599da1e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:28.037332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-077fbc94-531e-449b-9a37-100599da1e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:28.045534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-077fbc94-531e-449b-9a37-100599da1e8e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154433 Aug 24 05:19:28.046090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 915/1937] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:27 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:28.701308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:19:28.701885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:19:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:19:29.067908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6fb6a619-48ea-40ed-ac58-e7be030e2d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:29.068188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6fb6a619-48ea-40ed-ac58-e7be030e2d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:29.074619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fb6a619-48ea-40ed-ac58-e7be030e2d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:29.075127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fb6a619-48ea-40ed-ac58-e7be030e2d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:29.075557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fb6a619-48ea-40ed-ac58-e7be030e2d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:29.076246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fb6a619-48ea-40ed-ac58-e7be030e2d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:29.076692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fb6a619-48ea-40ed-ac58-e7be030e2d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:29.077112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fb6a619-48ea-40ed-ac58-e7be030e2d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:29.212116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6fb6a619-48ea-40ed-ac58-e7be030e2d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:29.220532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6fb6a619-48ea-40ed-ac58-e7be030e2d01 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157055 Aug 24 05:19:29.221085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1023/1938] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:29 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:30.242779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-399fb252-cbbc-4d68-8f2c-47011b112834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:30.243368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-399fb252-cbbc-4d68-8f2c-47011b112834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:30.249809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399fb252-cbbc-4d68-8f2c-47011b112834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:30.250285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399fb252-cbbc-4d68-8f2c-47011b112834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:30.250736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399fb252-cbbc-4d68-8f2c-47011b112834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:30.251422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399fb252-cbbc-4d68-8f2c-47011b112834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:30.251871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399fb252-cbbc-4d68-8f2c-47011b112834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:30.252286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399fb252-cbbc-4d68-8f2c-47011b112834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:30.385384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-399fb252-cbbc-4d68-8f2c-47011b112834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:30.393653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-399fb252-cbbc-4d68-8f2c-47011b112834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156008 Aug 24 05:19:30.394216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 916/1939] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:30 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:31.415624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9d077bb1-7815-4677-9c16-771a20286a15 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:31.416183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9d077bb1-7815-4677-9c16-771a20286a15 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:31.422661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d077bb1-7815-4677-9c16-771a20286a15 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:31.423168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d077bb1-7815-4677-9c16-771a20286a15 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:31.423598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d077bb1-7815-4677-9c16-771a20286a15 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:31.424273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d077bb1-7815-4677-9c16-771a20286a15 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:31.424716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d077bb1-7815-4677-9c16-771a20286a15 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:31.425133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d077bb1-7815-4677-9c16-771a20286a15 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:31.428409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:31.557948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9d077bb1-7815-4677-9c16-771a20286a15 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:31.566070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9d077bb1-7815-4677-9c16-771a20286a15 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154966 Aug 24 05:19:31.566638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1024/1940] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:31 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:32.588350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-338f8105-986f-4fd8-820e-cec6cda100cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:32.588958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-338f8105-986f-4fd8-820e-cec6cda100cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:32.595389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-338f8105-986f-4fd8-820e-cec6cda100cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:32.595865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-338f8105-986f-4fd8-820e-cec6cda100cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:32.596295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-338f8105-986f-4fd8-820e-cec6cda100cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:32.596974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-338f8105-986f-4fd8-820e-cec6cda100cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:32.597418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-338f8105-986f-4fd8-820e-cec6cda100cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:32.597836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-338f8105-986f-4fd8-820e-cec6cda100cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:32.734361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-338f8105-986f-4fd8-820e-cec6cda100cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:32.743354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-338f8105-986f-4fd8-820e-cec6cda100cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159424 Aug 24 05:19:32.743922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 917/1941] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:32 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:19:33.765248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6c2c07bd-31d2-4aee-ba19-f9cc651924b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:33.765863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6c2c07bd-31d2-4aee-ba19-f9cc651924b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:33.772597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c2c07bd-31d2-4aee-ba19-f9cc651924b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:33.773073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c2c07bd-31d2-4aee-ba19-f9cc651924b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:33.773505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c2c07bd-31d2-4aee-ba19-f9cc651924b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:33.774188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c2c07bd-31d2-4aee-ba19-f9cc651924b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:33.774633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c2c07bd-31d2-4aee-ba19-f9cc651924b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:33.775084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c2c07bd-31d2-4aee-ba19-f9cc651924b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:33.907821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6c2c07bd-31d2-4aee-ba19-f9cc651924b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:33.916662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6c2c07bd-31d2-4aee-ba19-f9cc651924b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156299 Aug 24 05:19:33.917166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1025/1942] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:33 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:34.937819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-39bbf65e-b90e-4d7d-9c7c-68435a2ea3e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:34.938435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-39bbf65e-b90e-4d7d-9c7c-68435a2ea3e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:34.945767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39bbf65e-b90e-4d7d-9c7c-68435a2ea3e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:34.946253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39bbf65e-b90e-4d7d-9c7c-68435a2ea3e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:34.946707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39bbf65e-b90e-4d7d-9c7c-68435a2ea3e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:34.947395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39bbf65e-b90e-4d7d-9c7c-68435a2ea3e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:34.947849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39bbf65e-b90e-4d7d-9c7c-68435a2ea3e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:34.948272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-39bbf65e-b90e-4d7d-9c7c-68435a2ea3e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:34.950905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=78 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:35.087586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-39bbf65e-b90e-4d7d-9c7c-68435a2ea3e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:35.095724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-39bbf65e-b90e-4d7d-9c7c-68435a2ea3e9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161823 Aug 24 05:19:35.096289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 918/1943] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:34 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:36.117854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-11ba6f48-9e6d-4529-b713-031e480c0380 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:36.118387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-11ba6f48-9e6d-4529-b713-031e480c0380 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:36.124799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11ba6f48-9e6d-4529-b713-031e480c0380 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:36.125268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11ba6f48-9e6d-4529-b713-031e480c0380 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:36.125696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11ba6f48-9e6d-4529-b713-031e480c0380 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:36.126368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11ba6f48-9e6d-4529-b713-031e480c0380 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:36.126846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11ba6f48-9e6d-4529-b713-031e480c0380 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:36.127263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11ba6f48-9e6d-4529-b713-031e480c0380 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:36.256943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-11ba6f48-9e6d-4529-b713-031e480c0380 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:36.265210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-11ba6f48-9e6d-4529-b713-031e480c0380 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.151981 Aug 24 05:19:36.265776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1026/1944] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:36 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:37.285543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f85ae01b-51ae-44be-bb21-aea5af238757 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:37.286132 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f85ae01b-51ae-44be-bb21-aea5af238757 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:37.293494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85ae01b-51ae-44be-bb21-aea5af238757 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:37.293978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85ae01b-51ae-44be-bb21-aea5af238757 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:37.294418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85ae01b-51ae-44be-bb21-aea5af238757 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:37.295142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85ae01b-51ae-44be-bb21-aea5af238757 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:37.295596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85ae01b-51ae-44be-bb21-aea5af238757 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:37.296020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85ae01b-51ae-44be-bb21-aea5af238757 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:37.431817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f85ae01b-51ae-44be-bb21-aea5af238757 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:37.440246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f85ae01b-51ae-44be-bb21-aea5af238757 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158650 Aug 24 05:19:37.440752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 919/1945] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:37 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:38.462317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3e7a2d80-85c9-4fbe-ae1f-0c09312fc50d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:38.462945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3e7a2d80-85c9-4fbe-ae1f-0c09312fc50d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:38.469458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e7a2d80-85c9-4fbe-ae1f-0c09312fc50d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:38.469929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e7a2d80-85c9-4fbe-ae1f-0c09312fc50d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:38.470368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e7a2d80-85c9-4fbe-ae1f-0c09312fc50d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:38.471076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e7a2d80-85c9-4fbe-ae1f-0c09312fc50d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:38.471525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e7a2d80-85c9-4fbe-ae1f-0c09312fc50d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:38.471944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e7a2d80-85c9-4fbe-ae1f-0c09312fc50d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:38.616414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3e7a2d80-85c9-4fbe-ae1f-0c09312fc50d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:38.627098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3e7a2d80-85c9-4fbe-ae1f-0c09312fc50d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.169135 Aug 24 05:19:38.627834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1027/1946] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:38 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:39.649450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ddb36bc8-c7fc-46cb-9b9c-670dec88c1db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:39.650058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ddb36bc8-c7fc-46cb-9b9c-670dec88c1db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:39.652374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:39.657587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddb36bc8-c7fc-46cb-9b9c-670dec88c1db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:39.658057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddb36bc8-c7fc-46cb-9b9c-670dec88c1db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:39.658482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddb36bc8-c7fc-46cb-9b9c-670dec88c1db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:39.659186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddb36bc8-c7fc-46cb-9b9c-670dec88c1db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:39.659626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddb36bc8-c7fc-46cb-9b9c-670dec88c1db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:39.660036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddb36bc8-c7fc-46cb-9b9c-670dec88c1db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:39.791842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ddb36bc8-c7fc-46cb-9b9c-670dec88c1db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:39.800709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ddb36bc8-c7fc-46cb-9b9c-670dec88c1db tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155795 Aug 24 05:19:39.801274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 920/1947] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:39 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:40.823253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-19dd829f-1754-4ca3-ad24-62a4830403a1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:40.823860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-19dd829f-1754-4ca3-ad24-62a4830403a1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:40.831556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19dd829f-1754-4ca3-ad24-62a4830403a1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:40.831556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19dd829f-1754-4ca3-ad24-62a4830403a1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:40.831556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19dd829f-1754-4ca3-ad24-62a4830403a1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:40.832206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19dd829f-1754-4ca3-ad24-62a4830403a1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:40.832479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19dd829f-1754-4ca3-ad24-62a4830403a1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:40.832904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-19dd829f-1754-4ca3-ad24-62a4830403a1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:40.971008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-19dd829f-1754-4ca3-ad24-62a4830403a1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:40.979701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-19dd829f-1754-4ca3-ad24-62a4830403a1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160343 Aug 24 05:19:40.980274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1028/1948] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:40 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:42.005323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-387b53d3-3769-4414-8c19-c38ab1d33469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:42.006029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-387b53d3-3769-4414-8c19-c38ab1d33469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:42.012589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387b53d3-3769-4414-8c19-c38ab1d33469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:42.013058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387b53d3-3769-4414-8c19-c38ab1d33469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:42.013484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387b53d3-3769-4414-8c19-c38ab1d33469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:42.014162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387b53d3-3769-4414-8c19-c38ab1d33469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:42.014604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387b53d3-3769-4414-8c19-c38ab1d33469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:42.015045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387b53d3-3769-4414-8c19-c38ab1d33469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:42.150941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-387b53d3-3769-4414-8c19-c38ab1d33469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:42.159562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-387b53d3-3769-4414-8c19-c38ab1d33469 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158123 Aug 24 05:19:42.160130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 921/1949] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:42 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:43.195533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a3bb7373-fd8a-4ba4-aae6-12e71cd7c804 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:43.196177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a3bb7373-fd8a-4ba4-aae6-12e71cd7c804 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:43.202844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3bb7373-fd8a-4ba4-aae6-12e71cd7c804 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:43.203322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3bb7373-fd8a-4ba4-aae6-12e71cd7c804 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:43.203757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3bb7373-fd8a-4ba4-aae6-12e71cd7c804 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:43.204440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3bb7373-fd8a-4ba4-aae6-12e71cd7c804 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:43.205071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3bb7373-fd8a-4ba4-aae6-12e71cd7c804 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:43.205497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3bb7373-fd8a-4ba4-aae6-12e71cd7c804 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:43.343172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a3bb7373-fd8a-4ba4-aae6-12e71cd7c804 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:43.352026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a3bb7373-fd8a-4ba4-aae6-12e71cd7c804 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160988 Aug 24 05:19:43.352734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1029/1950] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:43 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:44.373483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-38604ba4-c803-43ec-8ebf-cf320ed1710d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:44.374097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-38604ba4-c803-43ec-8ebf-cf320ed1710d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:44.380717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38604ba4-c803-43ec-8ebf-cf320ed1710d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:44.381328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38604ba4-c803-43ec-8ebf-cf320ed1710d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:44.381764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38604ba4-c803-43ec-8ebf-cf320ed1710d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:44.382482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38604ba4-c803-43ec-8ebf-cf320ed1710d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:44.382961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38604ba4-c803-43ec-8ebf-cf320ed1710d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:44.383387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38604ba4-c803-43ec-8ebf-cf320ed1710d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:44.513980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-38604ba4-c803-43ec-8ebf-cf320ed1710d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:44.523195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-38604ba4-c803-43ec-8ebf-cf320ed1710d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153622 Aug 24 05:19:44.523682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 922/1951] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:44 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:45.545603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f3fa6a3b-d3b2-4652-b103-b4e15c1ea702 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:45.546184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f3fa6a3b-d3b2-4652-b103-b4e15c1ea702 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:45.548213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:19:45.554020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3fa6a3b-d3b2-4652-b103-b4e15c1ea702 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:45.554493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3fa6a3b-d3b2-4652-b103-b4e15c1ea702 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:45.554946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3fa6a3b-d3b2-4652-b103-b4e15c1ea702 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:45.555628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3fa6a3b-d3b2-4652-b103-b4e15c1ea702 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:45.556072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3fa6a3b-d3b2-4652-b103-b4e15c1ea702 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:45.556481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3fa6a3b-d3b2-4652-b103-b4e15c1ea702 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:45.687692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f3fa6a3b-d3b2-4652-b103-b4e15c1ea702 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:45.696499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f3fa6a3b-d3b2-4652-b103-b4e15c1ea702 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154772 Aug 24 05:19:45.697062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1030/1952] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:45 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:46.718939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f99c05cc-1906-4d32-a04b-0bd236e8d2b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:46.719553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f99c05cc-1906-4d32-a04b-0bd236e8d2b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:46.726458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f99c05cc-1906-4d32-a04b-0bd236e8d2b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:46.726976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f99c05cc-1906-4d32-a04b-0bd236e8d2b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:46.727409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f99c05cc-1906-4d32-a04b-0bd236e8d2b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:46.728099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f99c05cc-1906-4d32-a04b-0bd236e8d2b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:46.728546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f99c05cc-1906-4d32-a04b-0bd236e8d2b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:46.729495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f99c05cc-1906-4d32-a04b-0bd236e8d2b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:46.868168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f99c05cc-1906-4d32-a04b-0bd236e8d2b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:46.877252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f99c05cc-1906-4d32-a04b-0bd236e8d2b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162237 Aug 24 05:19:46.877828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 923/1953] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:46 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:47.901519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-45cd8e87-af77-4be2-b7f3-854bfe2d5504 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:47.902194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-45cd8e87-af77-4be2-b7f3-854bfe2d5504 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:47.908793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45cd8e87-af77-4be2-b7f3-854bfe2d5504 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:47.909280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45cd8e87-af77-4be2-b7f3-854bfe2d5504 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:47.909714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45cd8e87-af77-4be2-b7f3-854bfe2d5504 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:47.910399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45cd8e87-af77-4be2-b7f3-854bfe2d5504 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:47.910883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45cd8e87-af77-4be2-b7f3-854bfe2d5504 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:47.911311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45cd8e87-af77-4be2-b7f3-854bfe2d5504 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:48.044454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-45cd8e87-af77-4be2-b7f3-854bfe2d5504 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:48.057834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-45cd8e87-af77-4be2-b7f3-854bfe2d5504 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161318 Aug 24 05:19:48.058848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1031/1954] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:47 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:49.088974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e8a4584d-cece-4e5b-a025-5862931cba0a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:49.089592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e8a4584d-cece-4e5b-a025-5862931cba0a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:49.096410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8a4584d-cece-4e5b-a025-5862931cba0a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:49.096885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8a4584d-cece-4e5b-a025-5862931cba0a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:49.097323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8a4584d-cece-4e5b-a025-5862931cba0a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:49.098004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8a4584d-cece-4e5b-a025-5862931cba0a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:49.098454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8a4584d-cece-4e5b-a025-5862931cba0a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:49.098903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e8a4584d-cece-4e5b-a025-5862931cba0a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:49.241069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e8a4584d-cece-4e5b-a025-5862931cba0a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:49.249651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e8a4584d-cece-4e5b-a025-5862931cba0a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.164637 Aug 24 05:19:49.250225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 924/1955] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:49 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:50.271951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-78b61665-325e-45a6-974f-3175d28bdbd0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:50.272605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-78b61665-325e-45a6-974f-3175d28bdbd0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:50.279088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78b61665-325e-45a6-974f-3175d28bdbd0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:50.279563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78b61665-325e-45a6-974f-3175d28bdbd0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:50.279993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78b61665-325e-45a6-974f-3175d28bdbd0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:50.280681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78b61665-325e-45a6-974f-3175d28bdbd0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:50.281127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78b61665-325e-45a6-974f-3175d28bdbd0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:50.281548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78b61665-325e-45a6-974f-3175d28bdbd0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:50.411761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-78b61665-325e-45a6-974f-3175d28bdbd0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:50.420342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-78b61665-325e-45a6-974f-3175d28bdbd0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152805 Aug 24 05:19:50.420920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1032/1956] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:50 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:51.442814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8af25006-23bf-44ea-8956-bd4c2b8e5992 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:51.443585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8af25006-23bf-44ea-8956-bd4c2b8e5992 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:51.450149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8af25006-23bf-44ea-8956-bd4c2b8e5992 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:51.450631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8af25006-23bf-44ea-8956-bd4c2b8e5992 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:51.451218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8af25006-23bf-44ea-8956-bd4c2b8e5992 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:51.451920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8af25006-23bf-44ea-8956-bd4c2b8e5992 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:51.452374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8af25006-23bf-44ea-8956-bd4c2b8e5992 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:51.452797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8af25006-23bf-44ea-8956-bd4c2b8e5992 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:51.587601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8af25006-23bf-44ea-8956-bd4c2b8e5992 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:51.596271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8af25006-23bf-44ea-8956-bd4c2b8e5992 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157418 Aug 24 05:19:51.596833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 925/1957] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:51 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:52.619098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-638d3c94-4984-4877-8a90-8e5bd28c416a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:52.619705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-638d3c94-4984-4877-8a90-8e5bd28c416a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:52.626050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-638d3c94-4984-4877-8a90-8e5bd28c416a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:52.626527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-638d3c94-4984-4877-8a90-8e5bd28c416a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:52.626996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-638d3c94-4984-4877-8a90-8e5bd28c416a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:52.627688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-638d3c94-4984-4877-8a90-8e5bd28c416a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:52.628132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-638d3c94-4984-4877-8a90-8e5bd28c416a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:52.628547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-638d3c94-4984-4877-8a90-8e5bd28c416a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:52.763176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-638d3c94-4984-4877-8a90-8e5bd28c416a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:52.772546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-638d3c94-4984-4877-8a90-8e5bd28c416a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157452 Aug 24 05:19:52.773345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1033/1958] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:52 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:53.793631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-db6a4df8-8f2f-474a-b9a4-44aa5e1d20be tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:53.794287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-db6a4df8-8f2f-474a-b9a4-44aa5e1d20be tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:53.800822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db6a4df8-8f2f-474a-b9a4-44aa5e1d20be tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:53.801295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db6a4df8-8f2f-474a-b9a4-44aa5e1d20be tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:53.801728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db6a4df8-8f2f-474a-b9a4-44aa5e1d20be tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:53.802467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db6a4df8-8f2f-474a-b9a4-44aa5e1d20be tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:53.802948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db6a4df8-8f2f-474a-b9a4-44aa5e1d20be tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:53.803467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db6a4df8-8f2f-474a-b9a4-44aa5e1d20be tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:53.952453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-db6a4df8-8f2f-474a-b9a4-44aa5e1d20be tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:53.961770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-db6a4df8-8f2f-474a-b9a4-44aa5e1d20be tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.171968 Aug 24 05:19:53.962577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 926/1959] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:53 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:54.983041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3c8c6b0d-5621-4b56-b24f-8fc5c2161ab5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:54.983779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3c8c6b0d-5621-4b56-b24f-8fc5c2161ab5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:54.991359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c8c6b0d-5621-4b56-b24f-8fc5c2161ab5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:54.991757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c8c6b0d-5621-4b56-b24f-8fc5c2161ab5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:54.992182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c8c6b0d-5621-4b56-b24f-8fc5c2161ab5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:54.992866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c8c6b0d-5621-4b56-b24f-8fc5c2161ab5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:54.993303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c8c6b0d-5621-4b56-b24f-8fc5c2161ab5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:54.993721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c8c6b0d-5621-4b56-b24f-8fc5c2161ab5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:55.127997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3c8c6b0d-5621-4b56-b24f-8fc5c2161ab5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:55.137215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3c8c6b0d-5621-4b56-b24f-8fc5c2161ab5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158065 Aug 24 05:19:55.137785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1034/1960] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:54 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:56.159280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9c0b5546-bff1-4f4c-9895-7b2492c538bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:56.159996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9c0b5546-bff1-4f4c-9895-7b2492c538bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:56.167751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0b5546-bff1-4f4c-9895-7b2492c538bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:56.168229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0b5546-bff1-4f4c-9895-7b2492c538bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:56.168872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0b5546-bff1-4f4c-9895-7b2492c538bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:56.169572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0b5546-bff1-4f4c-9895-7b2492c538bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:56.170019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0b5546-bff1-4f4c-9895-7b2492c538bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:56.170438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9c0b5546-bff1-4f4c-9895-7b2492c538bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:56.314104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9c0b5546-bff1-4f4c-9895-7b2492c538bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:56.327112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9c0b5546-bff1-4f4c-9895-7b2492c538bc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.172264 Aug 24 05:19:56.327692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 927/1961] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:56 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:57.352555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ee1f87b6-51bc-4656-8017-637fc52bb559 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:57.353111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ee1f87b6-51bc-4656-8017-637fc52bb559 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:57.359866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee1f87b6-51bc-4656-8017-637fc52bb559 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:57.360341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee1f87b6-51bc-4656-8017-637fc52bb559 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:57.360771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee1f87b6-51bc-4656-8017-637fc52bb559 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:57.361458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee1f87b6-51bc-4656-8017-637fc52bb559 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:57.361904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee1f87b6-51bc-4656-8017-637fc52bb559 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:57.362317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee1f87b6-51bc-4656-8017-637fc52bb559 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:57.731560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ee1f87b6-51bc-4656-8017-637fc52bb559 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:57.740480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ee1f87b6-51bc-4656-8017-637fc52bb559 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.392606 Aug 24 05:19:57.741053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1035/1962] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:57 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:58.760570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-764a1e9b-fe67-40ae-9675-f93af3bfb49a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:58.761177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-764a1e9b-fe67-40ae-9675-f93af3bfb49a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:58.767847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-764a1e9b-fe67-40ae-9675-f93af3bfb49a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:58.768319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-764a1e9b-fe67-40ae-9675-f93af3bfb49a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:58.768745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-764a1e9b-fe67-40ae-9675-f93af3bfb49a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:58.769422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-764a1e9b-fe67-40ae-9675-f93af3bfb49a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:58.769867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-764a1e9b-fe67-40ae-9675-f93af3bfb49a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:58.770284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-764a1e9b-fe67-40ae-9675-f93af3bfb49a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:58.901100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-764a1e9b-fe67-40ae-9675-f93af3bfb49a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:19:58.909362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-764a1e9b-fe67-40ae-9675-f93af3bfb49a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152603 Aug 24 05:19:58.909858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 928/1963] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:58 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:19:59.931891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a4ba24eb-c4b4-4c48-89f5-022a88262833 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:19:59.932499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a4ba24eb-c4b4-4c48-89f5-022a88262833 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:19:59.939051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ba24eb-c4b4-4c48-89f5-022a88262833 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:59.939541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ba24eb-c4b4-4c48-89f5-022a88262833 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:59.939962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ba24eb-c4b4-4c48-89f5-022a88262833 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:19:59.940643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ba24eb-c4b4-4c48-89f5-022a88262833 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:19:59.941089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ba24eb-c4b4-4c48-89f5-022a88262833 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:19:59.941570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ba24eb-c4b4-4c48-89f5-022a88262833 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:00.070869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a4ba24eb-c4b4-4c48-89f5-022a88262833 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:00.079075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a4ba24eb-c4b4-4c48-89f5-022a88262833 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152138 Aug 24 05:20:00.079640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1036/1964] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:19:59 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:01.103526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-64aada06-cf1a-43fc-87fa-54044f13f39f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:01.104075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-64aada06-cf1a-43fc-87fa-54044f13f39f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:01.110431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64aada06-cf1a-43fc-87fa-54044f13f39f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:01.110941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64aada06-cf1a-43fc-87fa-54044f13f39f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:01.111379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64aada06-cf1a-43fc-87fa-54044f13f39f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:01.112067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64aada06-cf1a-43fc-87fa-54044f13f39f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:01.112519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64aada06-cf1a-43fc-87fa-54044f13f39f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:01.112940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64aada06-cf1a-43fc-87fa-54044f13f39f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:01.262754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-64aada06-cf1a-43fc-87fa-54044f13f39f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:01.275951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-64aada06-cf1a-43fc-87fa-54044f13f39f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.172227 Aug 24 05:20:01.275951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 929/1965] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:01 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:02.299740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dcfc2484-875a-48d2-87ba-ddac654ea81c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:02.300341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dcfc2484-875a-48d2-87ba-ddac654ea81c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:02.307479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcfc2484-875a-48d2-87ba-ddac654ea81c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:02.307952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcfc2484-875a-48d2-87ba-ddac654ea81c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:02.308377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcfc2484-875a-48d2-87ba-ddac654ea81c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:02.309058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcfc2484-875a-48d2-87ba-ddac654ea81c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:02.309500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcfc2484-875a-48d2-87ba-ddac654ea81c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:02.309912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dcfc2484-875a-48d2-87ba-ddac654ea81c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:02.313803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:02.444401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dcfc2484-875a-48d2-87ba-ddac654ea81c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:02.452556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dcfc2484-875a-48d2-87ba-ddac654ea81c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156583 Aug 24 05:20:02.453117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1037/1966] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:02 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:03.473343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d9c41fae-3673-4604-b5b9-73f97ead67da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:03.474100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d9c41fae-3673-4604-b5b9-73f97ead67da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:03.480536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9c41fae-3673-4604-b5b9-73f97ead67da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:03.481011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9c41fae-3673-4604-b5b9-73f97ead67da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:03.481451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9c41fae-3673-4604-b5b9-73f97ead67da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:03.482135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9c41fae-3673-4604-b5b9-73f97ead67da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:03.482585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9c41fae-3673-4604-b5b9-73f97ead67da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:03.483043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d9c41fae-3673-4604-b5b9-73f97ead67da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:03.611829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d9c41fae-3673-4604-b5b9-73f97ead67da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:03.620329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d9c41fae-3673-4604-b5b9-73f97ead67da tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.150921 Aug 24 05:20:03.620887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 930/1967] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:03 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:04.641743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4bddb122-5e4b-4018-b4c9-41e6ad40be91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:04.642359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4bddb122-5e4b-4018-b4c9-41e6ad40be91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:04.648777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bddb122-5e4b-4018-b4c9-41e6ad40be91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:04.649256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bddb122-5e4b-4018-b4c9-41e6ad40be91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:04.649688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bddb122-5e4b-4018-b4c9-41e6ad40be91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:04.650370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bddb122-5e4b-4018-b4c9-41e6ad40be91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:04.650861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bddb122-5e4b-4018-b4c9-41e6ad40be91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:04.651286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4bddb122-5e4b-4018-b4c9-41e6ad40be91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:04.780549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4bddb122-5e4b-4018-b4c9-41e6ad40be91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:04.792119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4bddb122-5e4b-4018-b4c9-41e6ad40be91 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154248 Aug 24 05:20:04.792688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1038/1968] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:04 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:05.821041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c469ef6a-97e5-4d11-ac53-4ed5409b07cd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:05.821653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c469ef6a-97e5-4d11-ac53-4ed5409b07cd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:05.828227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c469ef6a-97e5-4d11-ac53-4ed5409b07cd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:05.828707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c469ef6a-97e5-4d11-ac53-4ed5409b07cd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:05.829141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c469ef6a-97e5-4d11-ac53-4ed5409b07cd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:05.829822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c469ef6a-97e5-4d11-ac53-4ed5409b07cd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:05.830272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c469ef6a-97e5-4d11-ac53-4ed5409b07cd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:05.830715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c469ef6a-97e5-4d11-ac53-4ed5409b07cd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:05.834730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=78 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:05.963693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c469ef6a-97e5-4d11-ac53-4ed5409b07cd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:05.971951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c469ef6a-97e5-4d11-ac53-4ed5409b07cd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154991 Aug 24 05:20:05.972516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 931/1969] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:05 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:06.993731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a7819607-f3de-45b2-8ad0-35a22e6d6ad3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:06.994367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a7819607-f3de-45b2-8ad0-35a22e6d6ad3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:07.000871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7819607-f3de-45b2-8ad0-35a22e6d6ad3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:07.001354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7819607-f3de-45b2-8ad0-35a22e6d6ad3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:07.001793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7819607-f3de-45b2-8ad0-35a22e6d6ad3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:07.002488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7819607-f3de-45b2-8ad0-35a22e6d6ad3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:07.002965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7819607-f3de-45b2-8ad0-35a22e6d6ad3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:07.003385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7819607-f3de-45b2-8ad0-35a22e6d6ad3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:07.139592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a7819607-f3de-45b2-8ad0-35a22e6d6ad3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:07.148930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a7819607-f3de-45b2-8ad0-35a22e6d6ad3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159103 Aug 24 05:20:07.149513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1039/1970] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:06 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:08.170557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-59159304-f39c-46a9-a1f2-4bcb46c3ac2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:08.171211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-59159304-f39c-46a9-a1f2-4bcb46c3ac2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:08.178186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59159304-f39c-46a9-a1f2-4bcb46c3ac2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:08.178656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59159304-f39c-46a9-a1f2-4bcb46c3ac2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:08.179375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59159304-f39c-46a9-a1f2-4bcb46c3ac2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:08.180061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59159304-f39c-46a9-a1f2-4bcb46c3ac2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:08.180784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59159304-f39c-46a9-a1f2-4bcb46c3ac2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:08.181468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59159304-f39c-46a9-a1f2-4bcb46c3ac2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:08.319728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-59159304-f39c-46a9-a1f2-4bcb46c3ac2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:08.328192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-59159304-f39c-46a9-a1f2-4bcb46c3ac2f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161619 Aug 24 05:20:08.329246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 932/1971] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:08 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:09.352944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5199bd1e-9928-459e-b117-71aa44d942fc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:09.353581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5199bd1e-9928-459e-b117-71aa44d942fc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:09.360093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5199bd1e-9928-459e-b117-71aa44d942fc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:09.360568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5199bd1e-9928-459e-b117-71aa44d942fc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:09.361002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5199bd1e-9928-459e-b117-71aa44d942fc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:09.361683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5199bd1e-9928-459e-b117-71aa44d942fc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:09.362123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5199bd1e-9928-459e-b117-71aa44d942fc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:09.362542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5199bd1e-9928-459e-b117-71aa44d942fc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:09.494567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5199bd1e-9928-459e-b117-71aa44d942fc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:09.503142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5199bd1e-9928-459e-b117-71aa44d942fc tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154593 Aug 24 05:20:09.503721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1040/1972] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:09 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:10.524104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0533a012-701e-4788-9cff-d5810a994624 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:10.524716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0533a012-701e-4788-9cff-d5810a994624 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:10.527268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:10.533276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0533a012-701e-4788-9cff-d5810a994624 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:10.533749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0533a012-701e-4788-9cff-d5810a994624 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:10.534176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0533a012-701e-4788-9cff-d5810a994624 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:10.534878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0533a012-701e-4788-9cff-d5810a994624 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:10.535321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0533a012-701e-4788-9cff-d5810a994624 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:10.535733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0533a012-701e-4788-9cff-d5810a994624 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:10.670013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0533a012-701e-4788-9cff-d5810a994624 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:10.678487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0533a012-701e-4788-9cff-d5810a994624 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158778 Aug 24 05:20:10.679357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 933/1973] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:10 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:11.701119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-162fbed7-c4db-4ba8-be93-9c204859252d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:11.701732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-162fbed7-c4db-4ba8-be93-9c204859252d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:11.707851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-162fbed7-c4db-4ba8-be93-9c204859252d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:11.708322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-162fbed7-c4db-4ba8-be93-9c204859252d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:11.708758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-162fbed7-c4db-4ba8-be93-9c204859252d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:11.709448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-162fbed7-c4db-4ba8-be93-9c204859252d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:11.709900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-162fbed7-c4db-4ba8-be93-9c204859252d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:11.710319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-162fbed7-c4db-4ba8-be93-9c204859252d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:11.844620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-162fbed7-c4db-4ba8-be93-9c204859252d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:11.853479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-162fbed7-c4db-4ba8-be93-9c204859252d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157345 Aug 24 05:20:11.854003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1041/1974] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:11 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:12.875088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6d645796-8106-490e-9575-f91a9a9f0e89 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:12.875728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6d645796-8106-490e-9575-f91a9a9f0e89 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:12.883063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d645796-8106-490e-9575-f91a9a9f0e89 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:12.883542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d645796-8106-490e-9575-f91a9a9f0e89 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:12.883974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d645796-8106-490e-9575-f91a9a9f0e89 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:12.884663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d645796-8106-490e-9575-f91a9a9f0e89 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:12.885114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d645796-8106-490e-9575-f91a9a9f0e89 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:12.885533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d645796-8106-490e-9575-f91a9a9f0e89 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:13.020392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6d645796-8106-490e-9575-f91a9a9f0e89 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:13.029235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6d645796-8106-490e-9575-f91a9a9f0e89 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158108 Aug 24 05:20:13.029798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 934/1975] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:12 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:14.051338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6f4f588c-cee6-4a4f-8113-389483b452e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:14.052001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6f4f588c-cee6-4a4f-8113-389483b452e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:14.058646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f4f588c-cee6-4a4f-8113-389483b452e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:14.059150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f4f588c-cee6-4a4f-8113-389483b452e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:14.059581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f4f588c-cee6-4a4f-8113-389483b452e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:14.060253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f4f588c-cee6-4a4f-8113-389483b452e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:14.060702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f4f588c-cee6-4a4f-8113-389483b452e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:14.061115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f4f588c-cee6-4a4f-8113-389483b452e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:14.191658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6f4f588c-cee6-4a4f-8113-389483b452e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:14.202623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6f4f588c-cee6-4a4f-8113-389483b452e5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155065 Aug 24 05:20:14.203235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1042/1976] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:14 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:15.225240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-20d560d8-91c8-4119-aebe-5acc97c5c008 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:15.225875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-20d560d8-91c8-4119-aebe-5acc97c5c008 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:15.232356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20d560d8-91c8-4119-aebe-5acc97c5c008 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:15.232838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20d560d8-91c8-4119-aebe-5acc97c5c008 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:15.233274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20d560d8-91c8-4119-aebe-5acc97c5c008 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:15.233963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20d560d8-91c8-4119-aebe-5acc97c5c008 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:15.234416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20d560d8-91c8-4119-aebe-5acc97c5c008 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:15.234874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-20d560d8-91c8-4119-aebe-5acc97c5c008 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:15.362345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-20d560d8-91c8-4119-aebe-5acc97c5c008 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:15.370632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-20d560d8-91c8-4119-aebe-5acc97c5c008 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.150011 Aug 24 05:20:15.371204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 935/1977] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:15 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:16.392173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fd7c31fc-ef3f-4c01-82a1-9127aa50353c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:16.392716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fd7c31fc-ef3f-4c01-82a1-9127aa50353c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:16.394679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:16.400960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7c31fc-ef3f-4c01-82a1-9127aa50353c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:16.401428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7c31fc-ef3f-4c01-82a1-9127aa50353c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:16.401893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7c31fc-ef3f-4c01-82a1-9127aa50353c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:16.402573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7c31fc-ef3f-4c01-82a1-9127aa50353c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:16.403043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7c31fc-ef3f-4c01-82a1-9127aa50353c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:16.403455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd7c31fc-ef3f-4c01-82a1-9127aa50353c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:16.531057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fd7c31fc-ef3f-4c01-82a1-9127aa50353c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:16.540024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fd7c31fc-ef3f-4c01-82a1-9127aa50353c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.151892 Aug 24 05:20:16.540584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1043/1978] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:16 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:17.561103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-53ebe447-e2d8-4a8c-a446-4119f0996f5a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:17.561696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-53ebe447-e2d8-4a8c-a446-4119f0996f5a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:17.568440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ebe447-e2d8-4a8c-a446-4119f0996f5a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:17.568918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ebe447-e2d8-4a8c-a446-4119f0996f5a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:17.569350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ebe447-e2d8-4a8c-a446-4119f0996f5a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:17.570048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ebe447-e2d8-4a8c-a446-4119f0996f5a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:17.570497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ebe447-e2d8-4a8c-a446-4119f0996f5a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:17.570947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ebe447-e2d8-4a8c-a446-4119f0996f5a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:17.707172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-53ebe447-e2d8-4a8c-a446-4119f0996f5a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:17.715668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-53ebe447-e2d8-4a8c-a446-4119f0996f5a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158458 Aug 24 05:20:17.716245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 936/1979] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:17 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:18.737393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-569089f9-4e42-4709-98d9-ed779283af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:18.738002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-569089f9-4e42-4709-98d9-ed779283af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:18.744618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569089f9-4e42-4709-98d9-ed779283af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:18.745103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569089f9-4e42-4709-98d9-ed779283af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:18.745533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569089f9-4e42-4709-98d9-ed779283af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:18.746220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569089f9-4e42-4709-98d9-ed779283af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:18.746663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569089f9-4e42-4709-98d9-ed779283af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:18.747101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569089f9-4e42-4709-98d9-ed779283af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:18.889843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-569089f9-4e42-4709-98d9-ed779283af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:18.898921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-569089f9-4e42-4709-98d9-ed779283af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.165373 Aug 24 05:20:18.899494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1044/1980] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:18 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:19.921033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c66ebf02-d6ff-420d-8ed8-1494b4609180 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:19.921645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c66ebf02-d6ff-420d-8ed8-1494b4609180 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:19.930261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c66ebf02-d6ff-420d-8ed8-1494b4609180 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:19.930786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c66ebf02-d6ff-420d-8ed8-1494b4609180 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:19.931204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c66ebf02-d6ff-420d-8ed8-1494b4609180 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:19.931894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c66ebf02-d6ff-420d-8ed8-1494b4609180 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:19.932335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c66ebf02-d6ff-420d-8ed8-1494b4609180 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:19.932747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c66ebf02-d6ff-420d-8ed8-1494b4609180 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:20.065585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c66ebf02-d6ff-420d-8ed8-1494b4609180 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:20.074861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c66ebf02-d6ff-420d-8ed8-1494b4609180 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157639 Aug 24 05:20:20.075441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 937/1981] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:19 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:21.096376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dc7d02bb-f631-42fb-a0e0-787a33e7044a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:21.096933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dc7d02bb-f631-42fb-a0e0-787a33e7044a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:21.109956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc7d02bb-f631-42fb-a0e0-787a33e7044a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:21.110466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc7d02bb-f631-42fb-a0e0-787a33e7044a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:21.110919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc7d02bb-f631-42fb-a0e0-787a33e7044a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:21.111619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc7d02bb-f631-42fb-a0e0-787a33e7044a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:21.112063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc7d02bb-f631-42fb-a0e0-787a33e7044a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:21.112477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc7d02bb-f631-42fb-a0e0-787a33e7044a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:21.256151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dc7d02bb-f631-42fb-a0e0-787a33e7044a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:21.264531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dc7d02bb-f631-42fb-a0e0-787a33e7044a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.172164 Aug 24 05:20:21.265103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1045/1982] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:21 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:22.285530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-42544ce1-ee0e-477a-a702-95cf147540e7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:22.286220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-42544ce1-ee0e-477a-a702-95cf147540e7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:22.292853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42544ce1-ee0e-477a-a702-95cf147540e7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:22.293337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42544ce1-ee0e-477a-a702-95cf147540e7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:22.293774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42544ce1-ee0e-477a-a702-95cf147540e7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:22.294464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42544ce1-ee0e-477a-a702-95cf147540e7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:22.294946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42544ce1-ee0e-477a-a702-95cf147540e7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:22.295369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42544ce1-ee0e-477a-a702-95cf147540e7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:22.443563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-42544ce1-ee0e-477a-a702-95cf147540e7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:22.451974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-42544ce1-ee0e-477a-a702-95cf147540e7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.170182 Aug 24 05:20:22.452327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 938/1983] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:22 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:23.474185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-78858888-7d54-4c4c-a7d6-c47a09e5d834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:23.474855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-78858888-7d54-4c4c-a7d6-c47a09e5d834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:23.481291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78858888-7d54-4c4c-a7d6-c47a09e5d834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:23.481767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78858888-7d54-4c4c-a7d6-c47a09e5d834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:23.482194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78858888-7d54-4c4c-a7d6-c47a09e5d834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:23.482909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78858888-7d54-4c4c-a7d6-c47a09e5d834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:23.483362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78858888-7d54-4c4c-a7d6-c47a09e5d834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:23.483782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-78858888-7d54-4c4c-a7d6-c47a09e5d834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:23.631134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-78858888-7d54-4c4c-a7d6-c47a09e5d834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:23.640240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-78858888-7d54-4c4c-a7d6-c47a09e5d834 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.170041 Aug 24 05:20:23.640810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1046/1984] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:23 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:24.663482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4e3b83b6-950b-4c8c-b01f-e171f1a803c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:24.664114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4e3b83b6-950b-4c8c-b01f-e171f1a803c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:24.671136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e3b83b6-950b-4c8c-b01f-e171f1a803c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:24.671629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e3b83b6-950b-4c8c-b01f-e171f1a803c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:24.672067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e3b83b6-950b-4c8c-b01f-e171f1a803c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:24.672773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e3b83b6-950b-4c8c-b01f-e171f1a803c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:24.673226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e3b83b6-950b-4c8c-b01f-e171f1a803c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:24.673650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e3b83b6-950b-4c8c-b01f-e171f1a803c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:24.809226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4e3b83b6-950b-4c8c-b01f-e171f1a803c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:24.818304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4e3b83b6-950b-4c8c-b01f-e171f1a803c9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158838 Aug 24 05:20:24.818902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 939/1985] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:24 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:25.839183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-21003940-3af0-4027-8bd4-dca0e0243a98 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:25.839936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-21003940-3af0-4027-8bd4-dca0e0243a98 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:25.846288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21003940-3af0-4027-8bd4-dca0e0243a98 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:25.846801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21003940-3af0-4027-8bd4-dca0e0243a98 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:25.847237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21003940-3af0-4027-8bd4-dca0e0243a98 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:25.847915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21003940-3af0-4027-8bd4-dca0e0243a98 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:25.849240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21003940-3af0-4027-8bd4-dca0e0243a98 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:25.849673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-21003940-3af0-4027-8bd4-dca0e0243a98 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:25.986408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-21003940-3af0-4027-8bd4-dca0e0243a98 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:25.996754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-21003940-3af0-4027-8bd4-dca0e0243a98 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161049 Aug 24 05:20:25.997350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1047/1986] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:25 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:27.019523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-436c7dac-2417-4d03-9e26-9ced355360f7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:27.020126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-436c7dac-2417-4d03-9e26-9ced355360f7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:27.026850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-436c7dac-2417-4d03-9e26-9ced355360f7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:27.027336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-436c7dac-2417-4d03-9e26-9ced355360f7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:27.027772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-436c7dac-2417-4d03-9e26-9ced355360f7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:27.028469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-436c7dac-2417-4d03-9e26-9ced355360f7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:27.028925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-436c7dac-2417-4d03-9e26-9ced355360f7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:27.029350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-436c7dac-2417-4d03-9e26-9ced355360f7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:27.167663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-436c7dac-2417-4d03-9e26-9ced355360f7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:27.178617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-436c7dac-2417-4d03-9e26-9ced355360f7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162940 Aug 24 05:20:27.179547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 940/1987] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:27 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:28.200878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-703ed8c5-0a94-435b-b683-570e07244ec7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:28.201479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-703ed8c5-0a94-435b-b683-570e07244ec7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:28.208619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-703ed8c5-0a94-435b-b683-570e07244ec7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:28.209097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-703ed8c5-0a94-435b-b683-570e07244ec7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:28.209527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-703ed8c5-0a94-435b-b683-570e07244ec7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:28.210218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-703ed8c5-0a94-435b-b683-570e07244ec7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:28.210670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-703ed8c5-0a94-435b-b683-570e07244ec7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:28.211145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-703ed8c5-0a94-435b-b683-570e07244ec7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:28.350662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-703ed8c5-0a94-435b-b683-570e07244ec7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:28.361670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-703ed8c5-0a94-435b-b683-570e07244ec7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.164254 Aug 24 05:20:28.362623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1048/1988] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:28 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:29.396320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-16f657bf-7e78-444f-8e63-1c8de4ee35ff tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:29.396852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-16f657bf-7e78-444f-8e63-1c8de4ee35ff tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:29.403306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16f657bf-7e78-444f-8e63-1c8de4ee35ff tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:29.403794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16f657bf-7e78-444f-8e63-1c8de4ee35ff tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:29.404231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16f657bf-7e78-444f-8e63-1c8de4ee35ff tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:29.404919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16f657bf-7e78-444f-8e63-1c8de4ee35ff tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:29.405726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16f657bf-7e78-444f-8e63-1c8de4ee35ff tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:29.406158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16f657bf-7e78-444f-8e63-1c8de4ee35ff tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:29.783417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-16f657bf-7e78-444f-8e63-1c8de4ee35ff tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:29.792277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-16f657bf-7e78-444f-8e63-1c8de4ee35ff tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.399970 Aug 24 05:20:29.792842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 941/1989] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:29 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:30.813464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-763d6288-eb05-47a7-8ccc-53e80cfb94b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:30.814080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-763d6288-eb05-47a7-8ccc-53e80cfb94b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:30.821246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-763d6288-eb05-47a7-8ccc-53e80cfb94b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:30.821722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-763d6288-eb05-47a7-8ccc-53e80cfb94b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:30.822158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-763d6288-eb05-47a7-8ccc-53e80cfb94b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:30.822888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-763d6288-eb05-47a7-8ccc-53e80cfb94b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:30.823342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-763d6288-eb05-47a7-8ccc-53e80cfb94b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:30.823762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-763d6288-eb05-47a7-8ccc-53e80cfb94b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:30.950659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-763d6288-eb05-47a7-8ccc-53e80cfb94b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:30.959558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-763d6288-eb05-47a7-8ccc-53e80cfb94b2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.150066 Aug 24 05:20:30.960123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1049/1990] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:30 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:31.980153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c3e147dc-db8a-4b63-9194-5db568176ca1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:31.980768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c3e147dc-db8a-4b63-9194-5db568176ca1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:31.987259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3e147dc-db8a-4b63-9194-5db568176ca1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:31.987742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3e147dc-db8a-4b63-9194-5db568176ca1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:31.988172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3e147dc-db8a-4b63-9194-5db568176ca1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:31.989441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3e147dc-db8a-4b63-9194-5db568176ca1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:31.989906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3e147dc-db8a-4b63-9194-5db568176ca1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:31.990334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3e147dc-db8a-4b63-9194-5db568176ca1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:32.122147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c3e147dc-db8a-4b63-9194-5db568176ca1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:32.131512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c3e147dc-db8a-4b63-9194-5db568176ca1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155208 Aug 24 05:20:32.132089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 942/1991] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:31 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:33.152745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-47a116fb-6f65-4617-b600-7ae279f37f9e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:33.153313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-47a116fb-6f65-4617-b600-7ae279f37f9e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:33.159653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a116fb-6f65-4617-b600-7ae279f37f9e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:33.160122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a116fb-6f65-4617-b600-7ae279f37f9e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:33.161208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a116fb-6f65-4617-b600-7ae279f37f9e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:33.162280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a116fb-6f65-4617-b600-7ae279f37f9e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:33.162742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a116fb-6f65-4617-b600-7ae279f37f9e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:33.163160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47a116fb-6f65-4617-b600-7ae279f37f9e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:33.165739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:33.303328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-47a116fb-6f65-4617-b600-7ae279f37f9e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:33.311842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-47a116fb-6f65-4617-b600-7ae279f37f9e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.163075 Aug 24 05:20:33.312407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1050/1992] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:33 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:34.333689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-813f5ea3-a6ca-411d-9656-eeb3957b0aad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:34.334297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-813f5ea3-a6ca-411d-9656-eeb3957b0aad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:34.341001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-813f5ea3-a6ca-411d-9656-eeb3957b0aad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:34.341471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-813f5ea3-a6ca-411d-9656-eeb3957b0aad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:34.341895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-813f5ea3-a6ca-411d-9656-eeb3957b0aad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:34.342607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-813f5ea3-a6ca-411d-9656-eeb3957b0aad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:34.343088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-813f5ea3-a6ca-411d-9656-eeb3957b0aad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:34.343500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-813f5ea3-a6ca-411d-9656-eeb3957b0aad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:34.480229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-813f5ea3-a6ca-411d-9656-eeb3957b0aad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:34.488391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-813f5ea3-a6ca-411d-9656-eeb3957b0aad tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158989 Aug 24 05:20:34.489074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 943/1993] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:34 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:35.509362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4a3ca31e-f6c9-416a-ae50-a59c2e89d446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:35.509932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4a3ca31e-f6c9-416a-ae50-a59c2e89d446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:35.516340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a3ca31e-f6c9-416a-ae50-a59c2e89d446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:35.516815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a3ca31e-f6c9-416a-ae50-a59c2e89d446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:35.517247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a3ca31e-f6c9-416a-ae50-a59c2e89d446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:35.517934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a3ca31e-f6c9-416a-ae50-a59c2e89d446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:35.518381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a3ca31e-f6c9-416a-ae50-a59c2e89d446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:35.518831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a3ca31e-f6c9-416a-ae50-a59c2e89d446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:35.660466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4a3ca31e-f6c9-416a-ae50-a59c2e89d446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:35.668743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4a3ca31e-f6c9-416a-ae50-a59c2e89d446 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.163291 Aug 24 05:20:35.669311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1051/1994] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:35 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:36.690800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c53077be-87d1-443c-996b-34f7407c40fa tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:36.691447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c53077be-87d1-443c-996b-34f7407c40fa tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:36.698489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c53077be-87d1-443c-996b-34f7407c40fa tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:36.699000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c53077be-87d1-443c-996b-34f7407c40fa tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:36.699431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c53077be-87d1-443c-996b-34f7407c40fa tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:36.700115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c53077be-87d1-443c-996b-34f7407c40fa tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:36.700557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c53077be-87d1-443c-996b-34f7407c40fa tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:36.700971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c53077be-87d1-443c-996b-34f7407c40fa tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:36.703614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=78 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:36.835401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c53077be-87d1-443c-996b-34f7407c40fa tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:36.843933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c53077be-87d1-443c-996b-34f7407c40fa tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156944 Aug 24 05:20:36.844597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 944/1995] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:36 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:37.866375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b40475ee-5fee-45c9-8523-85654f779a7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:37.866967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b40475ee-5fee-45c9-8523-85654f779a7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:37.873495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b40475ee-5fee-45c9-8523-85654f779a7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:37.873999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b40475ee-5fee-45c9-8523-85654f779a7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:37.874430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b40475ee-5fee-45c9-8523-85654f779a7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:37.875145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b40475ee-5fee-45c9-8523-85654f779a7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:37.875592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b40475ee-5fee-45c9-8523-85654f779a7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:37.876007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b40475ee-5fee-45c9-8523-85654f779a7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:38.018420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b40475ee-5fee-45c9-8523-85654f779a7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:38.027883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b40475ee-5fee-45c9-8523-85654f779a7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.166183 Aug 24 05:20:38.028465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1052/1996] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:37 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:39.049203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-22c84f2e-c103-486d-ad35-6f06ff88b9a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:39.049818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-22c84f2e-c103-486d-ad35-6f06ff88b9a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:39.057192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22c84f2e-c103-486d-ad35-6f06ff88b9a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:39.057677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22c84f2e-c103-486d-ad35-6f06ff88b9a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:39.058117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22c84f2e-c103-486d-ad35-6f06ff88b9a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:39.058843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22c84f2e-c103-486d-ad35-6f06ff88b9a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:39.059302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22c84f2e-c103-486d-ad35-6f06ff88b9a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:39.059723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22c84f2e-c103-486d-ad35-6f06ff88b9a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:39.205431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-22c84f2e-c103-486d-ad35-6f06ff88b9a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:39.217291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-22c84f2e-c103-486d-ad35-6f06ff88b9a9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.171963 Aug 24 05:20:39.217875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 945/1997] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:39 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:40.239983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e2915a79-f4de-45a9-9aa3-049c1daeba49 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:40.240581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e2915a79-f4de-45a9-9aa3-049c1daeba49 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:40.247269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2915a79-f4de-45a9-9aa3-049c1daeba49 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:40.247746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2915a79-f4de-45a9-9aa3-049c1daeba49 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:40.248169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2915a79-f4de-45a9-9aa3-049c1daeba49 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:40.248851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2915a79-f4de-45a9-9aa3-049c1daeba49 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:40.249294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2915a79-f4de-45a9-9aa3-049c1daeba49 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:40.249708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2915a79-f4de-45a9-9aa3-049c1daeba49 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:40.392931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e2915a79-f4de-45a9-9aa3-049c1daeba49 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:40.401463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e2915a79-f4de-45a9-9aa3-049c1daeba49 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.166114 Aug 24 05:20:40.402036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1053/1998] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:40 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:41.422660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b3040832-ada8-48ef-bfef-5f5988c1dce2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:41.423217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b3040832-ada8-48ef-bfef-5f5988c1dce2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:41.425498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:41.431400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3040832-ada8-48ef-bfef-5f5988c1dce2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:41.431876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3040832-ada8-48ef-bfef-5f5988c1dce2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:41.432304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3040832-ada8-48ef-bfef-5f5988c1dce2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:41.432984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3040832-ada8-48ef-bfef-5f5988c1dce2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:41.433432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3040832-ada8-48ef-bfef-5f5988c1dce2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:41.433850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3040832-ada8-48ef-bfef-5f5988c1dce2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:41.569387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b3040832-ada8-48ef-bfef-5f5988c1dce2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:41.578006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b3040832-ada8-48ef-bfef-5f5988c1dce2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159286 Aug 24 05:20:41.578586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 946/1999] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:41 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:42.599349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2d0a7b10-720a-45f1-ba5d-0eb1663a4856 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:42.599994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2d0a7b10-720a-45f1-ba5d-0eb1663a4856 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:42.606536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d0a7b10-720a-45f1-ba5d-0eb1663a4856 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:42.607048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d0a7b10-720a-45f1-ba5d-0eb1663a4856 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:42.607486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d0a7b10-720a-45f1-ba5d-0eb1663a4856 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:42.608169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d0a7b10-720a-45f1-ba5d-0eb1663a4856 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:42.608618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d0a7b10-720a-45f1-ba5d-0eb1663a4856 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:42.609038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2d0a7b10-720a-45f1-ba5d-0eb1663a4856 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:42.748319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2d0a7b10-720a-45f1-ba5d-0eb1663a4856 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:42.757366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2d0a7b10-720a-45f1-ba5d-0eb1663a4856 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162491 Aug 24 05:20:42.757943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1054/2000] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:42 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:43.779709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f6e33404-415f-4fe7-a0dd-89117305b1a5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:43.780321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f6e33404-415f-4fe7-a0dd-89117305b1a5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:43.787599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6e33404-415f-4fe7-a0dd-89117305b1a5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:43.788083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6e33404-415f-4fe7-a0dd-89117305b1a5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:43.788520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6e33404-415f-4fe7-a0dd-89117305b1a5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:43.789219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6e33404-415f-4fe7-a0dd-89117305b1a5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:43.789670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6e33404-415f-4fe7-a0dd-89117305b1a5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:43.790094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6e33404-415f-4fe7-a0dd-89117305b1a5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:43.925277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f6e33404-415f-4fe7-a0dd-89117305b1a5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:43.934263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f6e33404-415f-4fe7-a0dd-89117305b1a5 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158338 Aug 24 05:20:43.934952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 947/2001] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:43 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:44.955730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-58874da4-fea0-46ad-a78c-7d55b2bc623f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:44.956345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-58874da4-fea0-46ad-a78c-7d55b2bc623f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:44.963359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58874da4-fea0-46ad-a78c-7d55b2bc623f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:44.963842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58874da4-fea0-46ad-a78c-7d55b2bc623f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:44.964280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58874da4-fea0-46ad-a78c-7d55b2bc623f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:44.964979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58874da4-fea0-46ad-a78c-7d55b2bc623f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:44.965429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58874da4-fea0-46ad-a78c-7d55b2bc623f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:44.965852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58874da4-fea0-46ad-a78c-7d55b2bc623f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:45.101619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-58874da4-fea0-46ad-a78c-7d55b2bc623f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:45.110062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-58874da4-fea0-46ad-a78c-7d55b2bc623f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158231 Aug 24 05:20:45.110638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1055/2002] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:44 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:46.133386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0ee453dc-87e5-4dea-8697-b8e9c724e095 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:46.133990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0ee453dc-87e5-4dea-8697-b8e9c724e095 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:46.141723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee453dc-87e5-4dea-8697-b8e9c724e095 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:46.142208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee453dc-87e5-4dea-8697-b8e9c724e095 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:46.142644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee453dc-87e5-4dea-8697-b8e9c724e095 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:46.143368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee453dc-87e5-4dea-8697-b8e9c724e095 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:46.143820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee453dc-87e5-4dea-8697-b8e9c724e095 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:46.144242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee453dc-87e5-4dea-8697-b8e9c724e095 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:46.278891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ee453dc-87e5-4dea-8697-b8e9c724e095 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:46.287284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0ee453dc-87e5-4dea-8697-b8e9c724e095 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158812 Aug 24 05:20:46.287851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 948/2003] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:46 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:46.743263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:20:46.743472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:20:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:20:47.308664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-43a48648-bc5f-4da9-9940-1f8e97f62c32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:47.309269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-43a48648-bc5f-4da9-9940-1f8e97f62c32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:47.311597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:20:47.317079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43a48648-bc5f-4da9-9940-1f8e97f62c32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:47.317558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43a48648-bc5f-4da9-9940-1f8e97f62c32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:47.317988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43a48648-bc5f-4da9-9940-1f8e97f62c32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:47.318676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43a48648-bc5f-4da9-9940-1f8e97f62c32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:47.319144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43a48648-bc5f-4da9-9940-1f8e97f62c32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:47.319563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43a48648-bc5f-4da9-9940-1f8e97f62c32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:47.460869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-43a48648-bc5f-4da9-9940-1f8e97f62c32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:47.468964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-43a48648-bc5f-4da9-9940-1f8e97f62c32 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.164106 Aug 24 05:20:47.469529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1056/2004] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:47 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:48.493053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5dd74c45-e819-49da-978f-5dac6253b853 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:48.493939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5dd74c45-e819-49da-978f-5dac6253b853 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:48.502008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5dd74c45-e819-49da-978f-5dac6253b853 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:48.502499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5dd74c45-e819-49da-978f-5dac6253b853 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:48.502966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5dd74c45-e819-49da-978f-5dac6253b853 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:48.503691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5dd74c45-e819-49da-978f-5dac6253b853 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:48.504232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5dd74c45-e819-49da-978f-5dac6253b853 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:48.505205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5dd74c45-e819-49da-978f-5dac6253b853 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:48.635808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5dd74c45-e819-49da-978f-5dac6253b853 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:48.644111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5dd74c45-e819-49da-978f-5dac6253b853 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157181 Aug 24 05:20:48.645228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 949/2005] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:48 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:49.667581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6d191e97-cf45-4d87-a3d5-ea0085f13c7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:49.668251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6d191e97-cf45-4d87-a3d5-ea0085f13c7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:49.674573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d191e97-cf45-4d87-a3d5-ea0085f13c7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:49.675083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d191e97-cf45-4d87-a3d5-ea0085f13c7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:49.675511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d191e97-cf45-4d87-a3d5-ea0085f13c7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:49.676246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d191e97-cf45-4d87-a3d5-ea0085f13c7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:49.676691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d191e97-cf45-4d87-a3d5-ea0085f13c7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:49.677102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d191e97-cf45-4d87-a3d5-ea0085f13c7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:49.817401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6d191e97-cf45-4d87-a3d5-ea0085f13c7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:49.825883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6d191e97-cf45-4d87-a3d5-ea0085f13c7e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162505 Aug 24 05:20:49.826469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1057/2006] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:49 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:50.846866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e0a4d151-5ee1-4b01-b835-ed9eaa263fc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:50.847466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e0a4d151-5ee1-4b01-b835-ed9eaa263fc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:50.854384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0a4d151-5ee1-4b01-b835-ed9eaa263fc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:50.854918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0a4d151-5ee1-4b01-b835-ed9eaa263fc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:50.855359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0a4d151-5ee1-4b01-b835-ed9eaa263fc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:50.856060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0a4d151-5ee1-4b01-b835-ed9eaa263fc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:50.856509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0a4d151-5ee1-4b01-b835-ed9eaa263fc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:50.856930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0a4d151-5ee1-4b01-b835-ed9eaa263fc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:51.000501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e0a4d151-5ee1-4b01-b835-ed9eaa263fc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:51.009691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e0a4d151-5ee1-4b01-b835-ed9eaa263fc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.166672 Aug 24 05:20:51.010266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 950/2007] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:50 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:52.031616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c75a4617-77ab-4835-a6c7-0907df44c861 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:52.032226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c75a4617-77ab-4835-a6c7-0907df44c861 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:52.039952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75a4617-77ab-4835-a6c7-0907df44c861 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:52.040441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75a4617-77ab-4835-a6c7-0907df44c861 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:52.040952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75a4617-77ab-4835-a6c7-0907df44c861 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:52.041801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75a4617-77ab-4835-a6c7-0907df44c861 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:52.042607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75a4617-77ab-4835-a6c7-0907df44c861 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:52.043372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c75a4617-77ab-4835-a6c7-0907df44c861 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:52.185413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c75a4617-77ab-4835-a6c7-0907df44c861 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:52.194268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c75a4617-77ab-4835-a6c7-0907df44c861 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.166606 Aug 24 05:20:52.194876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1058/2008] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:52 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:53.216421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-db82dc37-0868-42d2-b57f-31a187f84b47 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:53.217049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-db82dc37-0868-42d2-b57f-31a187f84b47 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:53.224040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db82dc37-0868-42d2-b57f-31a187f84b47 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:53.224520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db82dc37-0868-42d2-b57f-31a187f84b47 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:53.224948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db82dc37-0868-42d2-b57f-31a187f84b47 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:53.225642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db82dc37-0868-42d2-b57f-31a187f84b47 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:53.226073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db82dc37-0868-42d2-b57f-31a187f84b47 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:53.226488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-db82dc37-0868-42d2-b57f-31a187f84b47 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:53.359211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-db82dc37-0868-42d2-b57f-31a187f84b47 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:53.368719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-db82dc37-0868-42d2-b57f-31a187f84b47 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156147 Aug 24 05:20:53.369297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 951/2009] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:53 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:54.392178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-90a4b6c2-f4c0-418f-8748-282999e261ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:54.392785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-90a4b6c2-f4c0-418f-8748-282999e261ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:54.399534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90a4b6c2-f4c0-418f-8748-282999e261ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:54.400015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90a4b6c2-f4c0-418f-8748-282999e261ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:54.400442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90a4b6c2-f4c0-418f-8748-282999e261ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:54.401128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90a4b6c2-f4c0-418f-8748-282999e261ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:54.401574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90a4b6c2-f4c0-418f-8748-282999e261ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:54.401992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90a4b6c2-f4c0-418f-8748-282999e261ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:54.536632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-90a4b6c2-f4c0-418f-8748-282999e261ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:54.545396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-90a4b6c2-f4c0-418f-8748-282999e261ae tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159196 Aug 24 05:20:54.545986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1059/2010] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:54 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:55.568127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-60692734-40e6-4a02-ae6b-7a46812e4a09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:55.568768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-60692734-40e6-4a02-ae6b-7a46812e4a09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:55.575358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60692734-40e6-4a02-ae6b-7a46812e4a09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:55.575829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60692734-40e6-4a02-ae6b-7a46812e4a09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:55.576255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60692734-40e6-4a02-ae6b-7a46812e4a09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:55.576934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60692734-40e6-4a02-ae6b-7a46812e4a09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:55.577519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60692734-40e6-4a02-ae6b-7a46812e4a09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:55.577771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-60692734-40e6-4a02-ae6b-7a46812e4a09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:55.733515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-60692734-40e6-4a02-ae6b-7a46812e4a09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:55.741566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-60692734-40e6-4a02-ae6b-7a46812e4a09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.177866 Aug 24 05:20:55.742131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 952/2011] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:55 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:56.764345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-01874a17-092a-4350-a3e2-71031f135a33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:56.764955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-01874a17-092a-4350-a3e2-71031f135a33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:56.771972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01874a17-092a-4350-a3e2-71031f135a33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:56.772454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01874a17-092a-4350-a3e2-71031f135a33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:56.772891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01874a17-092a-4350-a3e2-71031f135a33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:56.773576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01874a17-092a-4350-a3e2-71031f135a33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:56.774026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01874a17-092a-4350-a3e2-71031f135a33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:56.774449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01874a17-092a-4350-a3e2-71031f135a33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:56.912818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-01874a17-092a-4350-a3e2-71031f135a33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:56.921457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-01874a17-092a-4350-a3e2-71031f135a33 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161012 Aug 24 05:20:56.922043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1060/2012] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:56 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:20:57.943591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-970d090d-f1a7-4324-822c-9b716117d0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:57.944210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-970d090d-f1a7-4324-822c-9b716117d0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:57.950986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-970d090d-f1a7-4324-822c-9b716117d0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:57.951471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-970d090d-f1a7-4324-822c-9b716117d0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:57.951935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-970d090d-f1a7-4324-822c-9b716117d0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:57.952682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-970d090d-f1a7-4324-822c-9b716117d0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:57.953087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-970d090d-f1a7-4324-822c-9b716117d0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:57.953510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-970d090d-f1a7-4324-822c-9b716117d0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:58.090788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-970d090d-f1a7-4324-822c-9b716117d0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:58.100119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-970d090d-f1a7-4324-822c-9b716117d0e6 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160531 Aug 24 05:20:58.100696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 953/2013] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:57 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:20:59.122599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-98b40883-9176-48e8-bd29-7077873071d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:20:59.123312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-98b40883-9176-48e8-bd29-7077873071d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:20:59.130795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98b40883-9176-48e8-bd29-7077873071d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:59.131272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98b40883-9176-48e8-bd29-7077873071d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:59.131701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98b40883-9176-48e8-bd29-7077873071d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:59.132391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98b40883-9176-48e8-bd29-7077873071d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:20:59.132833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98b40883-9176-48e8-bd29-7077873071d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:20:59.133247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98b40883-9176-48e8-bd29-7077873071d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:20:59.270143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-98b40883-9176-48e8-bd29-7077873071d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:20:59.278946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-98b40883-9176-48e8-bd29-7077873071d9 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160252 Aug 24 05:20:59.279536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1061/2014] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:20:59 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:00.301836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ad682105-bc70-4ba4-a56c-1ac62cd0f10a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:00.302449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ad682105-bc70-4ba4-a56c-1ac62cd0f10a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:00.309600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad682105-bc70-4ba4-a56c-1ac62cd0f10a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:00.310111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad682105-bc70-4ba4-a56c-1ac62cd0f10a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:00.310545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad682105-bc70-4ba4-a56c-1ac62cd0f10a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:00.311278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad682105-bc70-4ba4-a56c-1ac62cd0f10a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:00.311745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad682105-bc70-4ba4-a56c-1ac62cd0f10a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:00.312152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad682105-bc70-4ba4-a56c-1ac62cd0f10a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:00.447874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ad682105-bc70-4ba4-a56c-1ac62cd0f10a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:00.456303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ad682105-bc70-4ba4-a56c-1ac62cd0f10a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159085 Aug 24 05:21:00.457376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 954/2015] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:00 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:01.478697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-09e654a0-ed04-4b43-b24c-a75f9d2e6eab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:01.479406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-09e654a0-ed04-4b43-b24c-a75f9d2e6eab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:01.486343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e654a0-ed04-4b43-b24c-a75f9d2e6eab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:01.486849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e654a0-ed04-4b43-b24c-a75f9d2e6eab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:01.487277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e654a0-ed04-4b43-b24c-a75f9d2e6eab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:01.488007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e654a0-ed04-4b43-b24c-a75f9d2e6eab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:01.488532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e654a0-ed04-4b43-b24c-a75f9d2e6eab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:01.488925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09e654a0-ed04-4b43-b24c-a75f9d2e6eab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:01.621682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-09e654a0-ed04-4b43-b24c-a75f9d2e6eab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:01.630460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-09e654a0-ed04-4b43-b24c-a75f9d2e6eab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155912 Aug 24 05:21:01.631053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1062/2016] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:01 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:02.651543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d909fb9d-e87d-4396-bc1b-90b42cd303d2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:02.652285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d909fb9d-e87d-4396-bc1b-90b42cd303d2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:02.658531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d909fb9d-e87d-4396-bc1b-90b42cd303d2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:02.659115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d909fb9d-e87d-4396-bc1b-90b42cd303d2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:02.659571 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d909fb9d-e87d-4396-bc1b-90b42cd303d2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:02.661145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d909fb9d-e87d-4396-bc1b-90b42cd303d2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:02.661616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d909fb9d-e87d-4396-bc1b-90b42cd303d2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:02.662042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d909fb9d-e87d-4396-bc1b-90b42cd303d2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:02.799849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d909fb9d-e87d-4396-bc1b-90b42cd303d2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:02.809583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d909fb9d-e87d-4396-bc1b-90b42cd303d2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161981 Aug 24 05:21:02.810154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 955/2017] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:02 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:03.831080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-36e2d66e-c0f1-4439-8c80-db698a214151 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:03.831686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-36e2d66e-c0f1-4439-8c80-db698a214151 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:03.838309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e2d66e-c0f1-4439-8c80-db698a214151 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:03.838810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e2d66e-c0f1-4439-8c80-db698a214151 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:03.839241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e2d66e-c0f1-4439-8c80-db698a214151 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:03.839945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e2d66e-c0f1-4439-8c80-db698a214151 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:03.840389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e2d66e-c0f1-4439-8c80-db698a214151 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:03.840888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36e2d66e-c0f1-4439-8c80-db698a214151 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:03.843561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:03.983534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-36e2d66e-c0f1-4439-8c80-db698a214151 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:03.992849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-36e2d66e-c0f1-4439-8c80-db698a214151 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.165450 Aug 24 05:21:03.993349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1063/2018] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:03 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:05.018656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e05a984a-1cd0-41f0-9082-dd252ef88598 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:05.019309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e05a984a-1cd0-41f0-9082-dd252ef88598 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:05.026210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e05a984a-1cd0-41f0-9082-dd252ef88598 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:05.026727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e05a984a-1cd0-41f0-9082-dd252ef88598 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:05.027164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e05a984a-1cd0-41f0-9082-dd252ef88598 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:05.027874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e05a984a-1cd0-41f0-9082-dd252ef88598 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:05.028325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e05a984a-1cd0-41f0-9082-dd252ef88598 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:05.028747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e05a984a-1cd0-41f0-9082-dd252ef88598 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:05.164154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e05a984a-1cd0-41f0-9082-dd252ef88598 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:05.173041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e05a984a-1cd0-41f0-9082-dd252ef88598 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158293 Aug 24 05:21:05.173947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 956/2019] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:05 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:06.194417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4eb992e4-59c0-48b2-8c20-120e45b9fbc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:06.195064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4eb992e4-59c0-48b2-8c20-120e45b9fbc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:06.201983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4eb992e4-59c0-48b2-8c20-120e45b9fbc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:06.202513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4eb992e4-59c0-48b2-8c20-120e45b9fbc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:06.202968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4eb992e4-59c0-48b2-8c20-120e45b9fbc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:06.203806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4eb992e4-59c0-48b2-8c20-120e45b9fbc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:06.204254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4eb992e4-59c0-48b2-8c20-120e45b9fbc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:06.204745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4eb992e4-59c0-48b2-8c20-120e45b9fbc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:06.337589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4eb992e4-59c0-48b2-8c20-120e45b9fbc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:06.345718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4eb992e4-59c0-48b2-8c20-120e45b9fbc8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155152 Aug 24 05:21:06.346279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1064/2020] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:06 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:07.368619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c1347531-dcf7-496b-82ae-67160edd32de tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:07.369215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c1347531-dcf7-496b-82ae-67160edd32de tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:07.375361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1347531-dcf7-496b-82ae-67160edd32de tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:07.375830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1347531-dcf7-496b-82ae-67160edd32de tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:07.376254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1347531-dcf7-496b-82ae-67160edd32de tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:07.376929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1347531-dcf7-496b-82ae-67160edd32de tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:07.377367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1347531-dcf7-496b-82ae-67160edd32de tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:07.377777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1347531-dcf7-496b-82ae-67160edd32de tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:07.380996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=78 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:07.515196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c1347531-dcf7-496b-82ae-67160edd32de tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:07.524291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c1347531-dcf7-496b-82ae-67160edd32de tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159676 Aug 24 05:21:07.524854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 957/2021] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:07 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:08.545954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ea8df409-6035-4b27-954b-16633f3caa09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:08.546497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ea8df409-6035-4b27-954b-16633f3caa09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:08.553442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea8df409-6035-4b27-954b-16633f3caa09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:08.553983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea8df409-6035-4b27-954b-16633f3caa09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:08.554673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea8df409-6035-4b27-954b-16633f3caa09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:08.555387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea8df409-6035-4b27-954b-16633f3caa09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:08.555829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea8df409-6035-4b27-954b-16633f3caa09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:08.556249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea8df409-6035-4b27-954b-16633f3caa09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:08.692104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ea8df409-6035-4b27-954b-16633f3caa09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:08.700895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ea8df409-6035-4b27-954b-16633f3caa09 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158842 Aug 24 05:21:08.703045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1065/2022] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:08 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:09.722561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a908d856-7a8e-4d45-8142-d756347d3d3b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:09.723413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a908d856-7a8e-4d45-8142-d756347d3d3b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:09.729936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a908d856-7a8e-4d45-8142-d756347d3d3b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:09.730419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a908d856-7a8e-4d45-8142-d756347d3d3b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:09.730886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a908d856-7a8e-4d45-8142-d756347d3d3b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:09.731648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a908d856-7a8e-4d45-8142-d756347d3d3b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:09.732102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a908d856-7a8e-4d45-8142-d756347d3d3b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:09.732524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a908d856-7a8e-4d45-8142-d756347d3d3b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:09.863516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a908d856-7a8e-4d45-8142-d756347d3d3b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:09.871958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a908d856-7a8e-4d45-8142-d756347d3d3b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153250 Aug 24 05:21:09.872528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 958/2023] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:09 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:10.893432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-eae545d6-4eb8-4a5a-b634-055ba5366b07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:10.894618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-eae545d6-4eb8-4a5a-b634-055ba5366b07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:10.901304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae545d6-4eb8-4a5a-b634-055ba5366b07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:10.901787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae545d6-4eb8-4a5a-b634-055ba5366b07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:10.902219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae545d6-4eb8-4a5a-b634-055ba5366b07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:10.902948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae545d6-4eb8-4a5a-b634-055ba5366b07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:10.903396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae545d6-4eb8-4a5a-b634-055ba5366b07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:10.903815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eae545d6-4eb8-4a5a-b634-055ba5366b07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:11.034516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-eae545d6-4eb8-4a5a-b634-055ba5366b07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:11.043097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-eae545d6-4eb8-4a5a-b634-055ba5366b07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153486 Aug 24 05:21:11.043667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1066/2024] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:10 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:12.064743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4f9ba4af-c0c9-4732-a911-8cde2d541684 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:12.065534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4f9ba4af-c0c9-4732-a911-8cde2d541684 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:12.068253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:12.073842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f9ba4af-c0c9-4732-a911-8cde2d541684 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:12.074315 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f9ba4af-c0c9-4732-a911-8cde2d541684 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:12.074771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f9ba4af-c0c9-4732-a911-8cde2d541684 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:12.075464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f9ba4af-c0c9-4732-a911-8cde2d541684 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:12.075914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f9ba4af-c0c9-4732-a911-8cde2d541684 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:12.076332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4f9ba4af-c0c9-4732-a911-8cde2d541684 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:12.207761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4f9ba4af-c0c9-4732-a911-8cde2d541684 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:12.215932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4f9ba4af-c0c9-4732-a911-8cde2d541684 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155283 Aug 24 05:21:12.216490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 959/2025] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:12 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:21:13.238954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3cd1475b-d7e8-4db3-84fc-3ee57536869d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:13.239420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3cd1475b-d7e8-4db3-84fc-3ee57536869d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:13.246491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1475b-d7e8-4db3-84fc-3ee57536869d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:13.246997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1475b-d7e8-4db3-84fc-3ee57536869d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:13.247434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1475b-d7e8-4db3-84fc-3ee57536869d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:13.248111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1475b-d7e8-4db3-84fc-3ee57536869d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:13.248553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1475b-d7e8-4db3-84fc-3ee57536869d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:13.248966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1475b-d7e8-4db3-84fc-3ee57536869d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:13.384608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3cd1475b-d7e8-4db3-84fc-3ee57536869d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:13.393089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3cd1475b-d7e8-4db3-84fc-3ee57536869d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158310 Aug 24 05:21:13.393653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1067/2026] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:13 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:14.414504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d1abbbbb-a17f-4a3c-a871-6d8da92dcaa3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:14.415123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d1abbbbb-a17f-4a3c-a871-6d8da92dcaa3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:14.421531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1abbbbb-a17f-4a3c-a871-6d8da92dcaa3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:14.422006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1abbbbb-a17f-4a3c-a871-6d8da92dcaa3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:14.422436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1abbbbb-a17f-4a3c-a871-6d8da92dcaa3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:14.423153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1abbbbb-a17f-4a3c-a871-6d8da92dcaa3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:14.423599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1abbbbb-a17f-4a3c-a871-6d8da92dcaa3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:14.424016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1abbbbb-a17f-4a3c-a871-6d8da92dcaa3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:14.562601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d1abbbbb-a17f-4a3c-a871-6d8da92dcaa3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:14.571555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d1abbbbb-a17f-4a3c-a871-6d8da92dcaa3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161017 Aug 24 05:21:14.572122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 960/2027] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:14 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:15.592742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9768a3be-a59f-4333-825e-de69fbd6aef8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:15.593309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9768a3be-a59f-4333-825e-de69fbd6aef8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:15.599283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9768a3be-a59f-4333-825e-de69fbd6aef8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:15.599759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9768a3be-a59f-4333-825e-de69fbd6aef8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:15.600190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9768a3be-a59f-4333-825e-de69fbd6aef8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:15.600868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9768a3be-a59f-4333-825e-de69fbd6aef8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:15.601309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9768a3be-a59f-4333-825e-de69fbd6aef8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:15.601724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9768a3be-a59f-4333-825e-de69fbd6aef8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:15.741311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9768a3be-a59f-4333-825e-de69fbd6aef8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:15.750724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9768a3be-a59f-4333-825e-de69fbd6aef8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161213 Aug 24 05:21:15.750993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1068/2028] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:15 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:16.772207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b7d0f0dc-c876-4ba0-a0a7-44dad329d251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:16.772855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b7d0f0dc-c876-4ba0-a0a7-44dad329d251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:16.779666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7d0f0dc-c876-4ba0-a0a7-44dad329d251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:16.780151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7d0f0dc-c876-4ba0-a0a7-44dad329d251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:16.780584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7d0f0dc-c876-4ba0-a0a7-44dad329d251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:16.781287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7d0f0dc-c876-4ba0-a0a7-44dad329d251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:16.781736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7d0f0dc-c876-4ba0-a0a7-44dad329d251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:16.782158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7d0f0dc-c876-4ba0-a0a7-44dad329d251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:16.917631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b7d0f0dc-c876-4ba0-a0a7-44dad329d251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:16.926580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b7d0f0dc-c876-4ba0-a0a7-44dad329d251 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158703 Aug 24 05:21:16.927413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 961/2029] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:16 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:17.950114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ca1870d9-f987-41d7-83cc-8d8b6c7f7a38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:17.950746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ca1870d9-f987-41d7-83cc-8d8b6c7f7a38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:17.953253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:17.958797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1870d9-f987-41d7-83cc-8d8b6c7f7a38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:17.959292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1870d9-f987-41d7-83cc-8d8b6c7f7a38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:17.959718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1870d9-f987-41d7-83cc-8d8b6c7f7a38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:17.960405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1870d9-f987-41d7-83cc-8d8b6c7f7a38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:17.960855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1870d9-f987-41d7-83cc-8d8b6c7f7a38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:17.961270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca1870d9-f987-41d7-83cc-8d8b6c7f7a38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:18.090282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ca1870d9-f987-41d7-83cc-8d8b6c7f7a38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:18.098559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ca1870d9-f987-41d7-83cc-8d8b6c7f7a38 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152889 Aug 24 05:21:18.099147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1069/2030] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:17 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:19.120489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e842dc44-1da6-43c9-b138-6d086c311d3e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:19.121056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e842dc44-1da6-43c9-b138-6d086c311d3e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:19.127806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e842dc44-1da6-43c9-b138-6d086c311d3e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:19.128976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e842dc44-1da6-43c9-b138-6d086c311d3e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:19.129421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e842dc44-1da6-43c9-b138-6d086c311d3e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:19.130127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e842dc44-1da6-43c9-b138-6d086c311d3e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:19.130579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e842dc44-1da6-43c9-b138-6d086c311d3e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:19.131029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e842dc44-1da6-43c9-b138-6d086c311d3e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:19.270361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e842dc44-1da6-43c9-b138-6d086c311d3e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:19.279820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e842dc44-1da6-43c9-b138-6d086c311d3e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.163360 Aug 24 05:21:19.280595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 962/2031] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:19 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:21:20.301710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f940c170-3deb-4ced-9c1a-2ff8a3624b5d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:20.302326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f940c170-3deb-4ced-9c1a-2ff8a3624b5d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:20.311642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f940c170-3deb-4ced-9c1a-2ff8a3624b5d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:20.311642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f940c170-3deb-4ced-9c1a-2ff8a3624b5d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:20.311642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f940c170-3deb-4ced-9c1a-2ff8a3624b5d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:20.311642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f940c170-3deb-4ced-9c1a-2ff8a3624b5d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:20.312345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f940c170-3deb-4ced-9c1a-2ff8a3624b5d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:20.312345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f940c170-3deb-4ced-9c1a-2ff8a3624b5d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:20.450492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f940c170-3deb-4ced-9c1a-2ff8a3624b5d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:20.459483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f940c170-3deb-4ced-9c1a-2ff8a3624b5d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161978 Aug 24 05:21:20.460051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1070/2032] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:20 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:21.481171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-df1a28d5-cf32-455b-8d1a-a9e4e111c486 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:21.481765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-df1a28d5-cf32-455b-8d1a-a9e4e111c486 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:21.488386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df1a28d5-cf32-455b-8d1a-a9e4e111c486 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:21.488828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df1a28d5-cf32-455b-8d1a-a9e4e111c486 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:21.489252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df1a28d5-cf32-455b-8d1a-a9e4e111c486 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:21.489957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df1a28d5-cf32-455b-8d1a-a9e4e111c486 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:21.490398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df1a28d5-cf32-455b-8d1a-a9e4e111c486 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:21.490833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df1a28d5-cf32-455b-8d1a-a9e4e111c486 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:21.623374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-df1a28d5-cf32-455b-8d1a-a9e4e111c486 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:21.632491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-df1a28d5-cf32-455b-8d1a-a9e4e111c486 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155226 Aug 24 05:21:21.633059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 963/2033] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:21 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:22.654958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-27c213b4-aa5e-49df-b399-4f12e9ef561c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:22.655596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-27c213b4-aa5e-49df-b399-4f12e9ef561c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:22.662900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27c213b4-aa5e-49df-b399-4f12e9ef561c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:22.663385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27c213b4-aa5e-49df-b399-4f12e9ef561c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:22.663829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27c213b4-aa5e-49df-b399-4f12e9ef561c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:22.664526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27c213b4-aa5e-49df-b399-4f12e9ef561c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:22.664977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27c213b4-aa5e-49df-b399-4f12e9ef561c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:22.665402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27c213b4-aa5e-49df-b399-4f12e9ef561c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:22.807252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-27c213b4-aa5e-49df-b399-4f12e9ef561c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:22.815895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-27c213b4-aa5e-49df-b399-4f12e9ef561c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.164622 Aug 24 05:21:22.816483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1071/2034] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:22 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:23.840930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eefbcf61-4c2f-4b1d-a615-a93a671770b7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:23.841511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-eefbcf61-4c2f-4b1d-a615-a93a671770b7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:23.848366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eefbcf61-4c2f-4b1d-a615-a93a671770b7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:23.848841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eefbcf61-4c2f-4b1d-a615-a93a671770b7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:23.849265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eefbcf61-4c2f-4b1d-a615-a93a671770b7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:23.849955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eefbcf61-4c2f-4b1d-a615-a93a671770b7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:23.850397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eefbcf61-4c2f-4b1d-a615-a93a671770b7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:23.850843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eefbcf61-4c2f-4b1d-a615-a93a671770b7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:23.997515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-eefbcf61-4c2f-4b1d-a615-a93a671770b7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:24.006235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-eefbcf61-4c2f-4b1d-a615-a93a671770b7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.169155 Aug 24 05:21:24.006833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 964/2035] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:23 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:25.027573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-90de6150-28bf-4a9a-bf1c-afb7fd298975 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:25.028348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-90de6150-28bf-4a9a-bf1c-afb7fd298975 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:25.035473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90de6150-28bf-4a9a-bf1c-afb7fd298975 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:25.035945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90de6150-28bf-4a9a-bf1c-afb7fd298975 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:25.036374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90de6150-28bf-4a9a-bf1c-afb7fd298975 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:25.037062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90de6150-28bf-4a9a-bf1c-afb7fd298975 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:25.037505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90de6150-28bf-4a9a-bf1c-afb7fd298975 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:25.037950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90de6150-28bf-4a9a-bf1c-afb7fd298975 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:25.181793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-90de6150-28bf-4a9a-bf1c-afb7fd298975 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:25.190102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-90de6150-28bf-4a9a-bf1c-afb7fd298975 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.166352 Aug 24 05:21:25.190855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1072/2036] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:25 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:26.211596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8f5881b4-9e27-4867-850a-5f4e3c5a4223 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:26.212186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8f5881b4-9e27-4867-850a-5f4e3c5a4223 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:26.218735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f5881b4-9e27-4867-850a-5f4e3c5a4223 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:26.219221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f5881b4-9e27-4867-850a-5f4e3c5a4223 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:26.219650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f5881b4-9e27-4867-850a-5f4e3c5a4223 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:26.220365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f5881b4-9e27-4867-850a-5f4e3c5a4223 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:26.220811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f5881b4-9e27-4867-850a-5f4e3c5a4223 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:26.221258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f5881b4-9e27-4867-850a-5f4e3c5a4223 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:26.361729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8f5881b4-9e27-4867-850a-5f4e3c5a4223 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:26.370564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8f5881b4-9e27-4867-850a-5f4e3c5a4223 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162817 Aug 24 05:21:26.371093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 965/2037] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:26 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:27.391948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-569409fa-fcbd-4ede-a4fc-9b2be025efca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:27.392561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-569409fa-fcbd-4ede-a4fc-9b2be025efca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:27.399337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569409fa-fcbd-4ede-a4fc-9b2be025efca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:27.399834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569409fa-fcbd-4ede-a4fc-9b2be025efca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:27.400253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569409fa-fcbd-4ede-a4fc-9b2be025efca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:27.400941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569409fa-fcbd-4ede-a4fc-9b2be025efca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:27.401392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569409fa-fcbd-4ede-a4fc-9b2be025efca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:27.401811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-569409fa-fcbd-4ede-a4fc-9b2be025efca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:27.534160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-569409fa-fcbd-4ede-a4fc-9b2be025efca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:27.543078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-569409fa-fcbd-4ede-a4fc-9b2be025efca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154889 Aug 24 05:21:27.543646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1073/2038] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:27 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:28.568820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-de4dc731-ebec-4a51-a9f0-041af5da6a64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:28.569446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-de4dc731-ebec-4a51-a9f0-041af5da6a64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:28.576317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de4dc731-ebec-4a51-a9f0-041af5da6a64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:28.576796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de4dc731-ebec-4a51-a9f0-041af5da6a64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:28.577348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de4dc731-ebec-4a51-a9f0-041af5da6a64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:28.578589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de4dc731-ebec-4a51-a9f0-041af5da6a64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:28.579541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de4dc731-ebec-4a51-a9f0-041af5da6a64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:28.580323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-de4dc731-ebec-4a51-a9f0-041af5da6a64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:28.728656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-de4dc731-ebec-4a51-a9f0-041af5da6a64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:28.737319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-de4dc731-ebec-4a51-a9f0-041af5da6a64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.174978 Aug 24 05:21:28.738420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 966/2039] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:28 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:29.759650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5a6bbfc3-0bac-45b7-b116-ec8cc4b99ba2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:29.760219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5a6bbfc3-0bac-45b7-b116-ec8cc4b99ba2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:29.766774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a6bbfc3-0bac-45b7-b116-ec8cc4b99ba2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:29.767249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a6bbfc3-0bac-45b7-b116-ec8cc4b99ba2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:29.767682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a6bbfc3-0bac-45b7-b116-ec8cc4b99ba2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:29.768361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a6bbfc3-0bac-45b7-b116-ec8cc4b99ba2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:29.768911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a6bbfc3-0bac-45b7-b116-ec8cc4b99ba2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:29.769331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a6bbfc3-0bac-45b7-b116-ec8cc4b99ba2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:29.906427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5a6bbfc3-0bac-45b7-b116-ec8cc4b99ba2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:29.915334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5a6bbfc3-0bac-45b7-b116-ec8cc4b99ba2 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159584 Aug 24 05:21:29.915903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1074/2040] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:29 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:30.937503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4496af97-29dd-41f7-8afc-08f2084842ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:30.938156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4496af97-29dd-41f7-8afc-08f2084842ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:30.945378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4496af97-29dd-41f7-8afc-08f2084842ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:30.945864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4496af97-29dd-41f7-8afc-08f2084842ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:30.946298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4496af97-29dd-41f7-8afc-08f2084842ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:30.947067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4496af97-29dd-41f7-8afc-08f2084842ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:30.947475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4496af97-29dd-41f7-8afc-08f2084842ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:30.947895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4496af97-29dd-41f7-8afc-08f2084842ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:31.080636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4496af97-29dd-41f7-8afc-08f2084842ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:31.089666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4496af97-29dd-41f7-8afc-08f2084842ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156066 Aug 24 05:21:31.090176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 967/2041] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:30 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:32.110156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fff15243-76ef-4a53-9047-34efc1956f04 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:32.110773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fff15243-76ef-4a53-9047-34efc1956f04 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:32.118527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fff15243-76ef-4a53-9047-34efc1956f04 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:32.119047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fff15243-76ef-4a53-9047-34efc1956f04 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:32.119476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fff15243-76ef-4a53-9047-34efc1956f04 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:32.120171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fff15243-76ef-4a53-9047-34efc1956f04 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:32.120609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fff15243-76ef-4a53-9047-34efc1956f04 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:32.121030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fff15243-76ef-4a53-9047-34efc1956f04 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:32.399394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fff15243-76ef-4a53-9047-34efc1956f04 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:32.407631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fff15243-76ef-4a53-9047-34efc1956f04 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.301343 Aug 24 05:21:32.408226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1075/2042] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:32 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:33.430811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b261c4d5-9a54-4bd8-84df-11a040f3bc1a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:33.431429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b261c4d5-9a54-4bd8-84df-11a040f3bc1a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:33.438624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b261c4d5-9a54-4bd8-84df-11a040f3bc1a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:33.439136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b261c4d5-9a54-4bd8-84df-11a040f3bc1a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:33.439566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b261c4d5-9a54-4bd8-84df-11a040f3bc1a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:33.440259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b261c4d5-9a54-4bd8-84df-11a040f3bc1a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:33.440708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b261c4d5-9a54-4bd8-84df-11a040f3bc1a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:33.441211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b261c4d5-9a54-4bd8-84df-11a040f3bc1a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:33.577190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b261c4d5-9a54-4bd8-84df-11a040f3bc1a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:33.585498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b261c4d5-9a54-4bd8-84df-11a040f3bc1a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159017 Aug 24 05:21:33.586060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 968/2043] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:33 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:34.606710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0282032e-4f62-45af-a5e8-9a0776ab345c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:34.607307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0282032e-4f62-45af-a5e8-9a0776ab345c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:34.614605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0282032e-4f62-45af-a5e8-9a0776ab345c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:34.615116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0282032e-4f62-45af-a5e8-9a0776ab345c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:34.615546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0282032e-4f62-45af-a5e8-9a0776ab345c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:34.616241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0282032e-4f62-45af-a5e8-9a0776ab345c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:34.616690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0282032e-4f62-45af-a5e8-9a0776ab345c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:34.617107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0282032e-4f62-45af-a5e8-9a0776ab345c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:34.619861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:34.750417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0282032e-4f62-45af-a5e8-9a0776ab345c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:34.759989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0282032e-4f62-45af-a5e8-9a0776ab345c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157094 Aug 24 05:21:34.760565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1076/2044] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:34 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:35.781123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-15fb790d-1f05-4ff8-a9ff-c457690d9a73 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:35.781766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-15fb790d-1f05-4ff8-a9ff-c457690d9a73 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:35.788643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15fb790d-1f05-4ff8-a9ff-c457690d9a73 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:35.789156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15fb790d-1f05-4ff8-a9ff-c457690d9a73 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:35.789590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15fb790d-1f05-4ff8-a9ff-c457690d9a73 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:35.790290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15fb790d-1f05-4ff8-a9ff-c457690d9a73 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:35.790780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15fb790d-1f05-4ff8-a9ff-c457690d9a73 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:35.791204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15fb790d-1f05-4ff8-a9ff-c457690d9a73 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:35.940097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-15fb790d-1f05-4ff8-a9ff-c457690d9a73 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:35.949325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-15fb790d-1f05-4ff8-a9ff-c457690d9a73 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.172231 Aug 24 05:21:35.949901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 969/2045] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:35 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:36.971032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-964efd9c-1748-4df2-984e-14d83b68ab64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:36.971638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-964efd9c-1748-4df2-984e-14d83b68ab64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:36.978802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-964efd9c-1748-4df2-984e-14d83b68ab64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:36.979285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-964efd9c-1748-4df2-984e-14d83b68ab64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:36.979717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-964efd9c-1748-4df2-984e-14d83b68ab64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:36.980402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-964efd9c-1748-4df2-984e-14d83b68ab64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:36.980846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-964efd9c-1748-4df2-984e-14d83b68ab64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:36.981262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-964efd9c-1748-4df2-984e-14d83b68ab64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:37.118836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-964efd9c-1748-4df2-984e-14d83b68ab64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:37.127150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-964efd9c-1748-4df2-984e-14d83b68ab64 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159895 Aug 24 05:21:37.127727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1077/2046] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:36 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:21:38.148608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7f599125-7f8b-43b1-b9c8-75d104cb1be7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:38.149220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7f599125-7f8b-43b1-b9c8-75d104cb1be7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:38.155464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f599125-7f8b-43b1-b9c8-75d104cb1be7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:38.155941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f599125-7f8b-43b1-b9c8-75d104cb1be7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:38.156369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f599125-7f8b-43b1-b9c8-75d104cb1be7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:38.157056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f599125-7f8b-43b1-b9c8-75d104cb1be7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:38.157503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f599125-7f8b-43b1-b9c8-75d104cb1be7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:38.157922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f599125-7f8b-43b1-b9c8-75d104cb1be7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:38.162490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=78 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:38.357395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7f599125-7f8b-43b1-b9c8-75d104cb1be7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:38.366470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7f599125-7f8b-43b1-b9c8-75d104cb1be7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.221775 Aug 24 05:21:38.367071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 970/2047] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:38 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:39.388166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a7480f4b-45e7-45c9-9984-9c554418cd3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:39.388773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a7480f4b-45e7-45c9-9984-9c554418cd3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:39.396350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7480f4b-45e7-45c9-9984-9c554418cd3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:39.396823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7480f4b-45e7-45c9-9984-9c554418cd3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:39.397251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7480f4b-45e7-45c9-9984-9c554418cd3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:39.397930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7480f4b-45e7-45c9-9984-9c554418cd3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:39.398372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7480f4b-45e7-45c9-9984-9c554418cd3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:39.398831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7480f4b-45e7-45c9-9984-9c554418cd3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:39.587820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a7480f4b-45e7-45c9-9984-9c554418cd3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:39.596280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a7480f4b-45e7-45c9-9984-9c554418cd3c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.211961 Aug 24 05:21:39.596896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1078/2048] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:39 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:40.617661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7ddc38d0-6c46-46e2-8836-3e34a258c56c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:40.618261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7ddc38d0-6c46-46e2-8836-3e34a258c56c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:40.624854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ddc38d0-6c46-46e2-8836-3e34a258c56c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:40.625339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ddc38d0-6c46-46e2-8836-3e34a258c56c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:40.625764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ddc38d0-6c46-46e2-8836-3e34a258c56c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:40.626452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ddc38d0-6c46-46e2-8836-3e34a258c56c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:40.626926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ddc38d0-6c46-46e2-8836-3e34a258c56c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:40.627340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ddc38d0-6c46-46e2-8836-3e34a258c56c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:40.764116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7ddc38d0-6c46-46e2-8836-3e34a258c56c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:40.773323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7ddc38d0-6c46-46e2-8836-3e34a258c56c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159617 Aug 24 05:21:40.773907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 971/2049] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:40 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:41.795266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-728b488f-0c8d-4b1f-b5e7-9f980646ca02 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:41.795885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-728b488f-0c8d-4b1f-b5e7-9f980646ca02 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:41.802747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728b488f-0c8d-4b1f-b5e7-9f980646ca02 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:41.803235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728b488f-0c8d-4b1f-b5e7-9f980646ca02 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:41.803670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728b488f-0c8d-4b1f-b5e7-9f980646ca02 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:41.804616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728b488f-0c8d-4b1f-b5e7-9f980646ca02 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:41.805076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728b488f-0c8d-4b1f-b5e7-9f980646ca02 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:41.805496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728b488f-0c8d-4b1f-b5e7-9f980646ca02 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:41.943393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-728b488f-0c8d-4b1f-b5e7-9f980646ca02 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:41.951757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-728b488f-0c8d-4b1f-b5e7-9f980646ca02 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160834 Aug 24 05:21:41.952323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1079/2050] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:41 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:42.973952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-835517e2-13bc-4c78-bb51-4cc54caa1f6c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:42.974596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-835517e2-13bc-4c78-bb51-4cc54caa1f6c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:42.976951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:42.982213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-835517e2-13bc-4c78-bb51-4cc54caa1f6c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:42.982708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-835517e2-13bc-4c78-bb51-4cc54caa1f6c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:42.983137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-835517e2-13bc-4c78-bb51-4cc54caa1f6c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:42.983825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-835517e2-13bc-4c78-bb51-4cc54caa1f6c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:42.984264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-835517e2-13bc-4c78-bb51-4cc54caa1f6c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:42.984677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-835517e2-13bc-4c78-bb51-4cc54caa1f6c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:43.122351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-835517e2-13bc-4c78-bb51-4cc54caa1f6c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:43.131412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-835517e2-13bc-4c78-bb51-4cc54caa1f6c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161869 Aug 24 05:21:43.131983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 972/2051] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:42 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:44.153487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e4a00a89-d510-4ecf-b08e-efa3f22752c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:44.154091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e4a00a89-d510-4ecf-b08e-efa3f22752c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:44.160746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4a00a89-d510-4ecf-b08e-efa3f22752c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:44.161216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4a00a89-d510-4ecf-b08e-efa3f22752c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:44.161641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4a00a89-d510-4ecf-b08e-efa3f22752c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:44.162322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4a00a89-d510-4ecf-b08e-efa3f22752c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:44.162794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4a00a89-d510-4ecf-b08e-efa3f22752c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:44.163240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4a00a89-d510-4ecf-b08e-efa3f22752c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:44.302099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e4a00a89-d510-4ecf-b08e-efa3f22752c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:44.311139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e4a00a89-d510-4ecf-b08e-efa3f22752c3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161508 Aug 24 05:21:44.311718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1080/2052] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:44 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:45.333144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e40c605e-4ed9-4ae2-a937-e1b392ee50d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:45.333777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e40c605e-4ed9-4ae2-a937-e1b392ee50d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:45.340393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e40c605e-4ed9-4ae2-a937-e1b392ee50d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:45.340876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e40c605e-4ed9-4ae2-a937-e1b392ee50d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:45.341311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e40c605e-4ed9-4ae2-a937-e1b392ee50d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:45.342001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e40c605e-4ed9-4ae2-a937-e1b392ee50d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:45.342451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e40c605e-4ed9-4ae2-a937-e1b392ee50d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:45.342908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e40c605e-4ed9-4ae2-a937-e1b392ee50d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:45.481555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e40c605e-4ed9-4ae2-a937-e1b392ee50d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:45.489961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e40c605e-4ed9-4ae2-a937-e1b392ee50d0 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160798 Aug 24 05:21:45.490531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 973/2053] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:45 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:46.510877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ebb7740a-e4df-4e27-af6c-9530f6691e8c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:46.511492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ebb7740a-e4df-4e27-af6c-9530f6691e8c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:46.517656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebb7740a-e4df-4e27-af6c-9530f6691e8c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:46.518135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebb7740a-e4df-4e27-af6c-9530f6691e8c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:46.519118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebb7740a-e4df-4e27-af6c-9530f6691e8c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:46.519843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebb7740a-e4df-4e27-af6c-9530f6691e8c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:46.520394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebb7740a-e4df-4e27-af6c-9530f6691e8c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:46.520819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ebb7740a-e4df-4e27-af6c-9530f6691e8c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:46.660601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ebb7740a-e4df-4e27-af6c-9530f6691e8c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:46.669041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ebb7740a-e4df-4e27-af6c-9530f6691e8c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161984 Aug 24 05:21:46.669617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1081/2054] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:46 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:47.689505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0dc21b34-1536-40a7-a1a9-3c8c3ac3180f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:47.690135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0dc21b34-1536-40a7-a1a9-3c8c3ac3180f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:47.696560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0dc21b34-1536-40a7-a1a9-3c8c3ac3180f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:47.697027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0dc21b34-1536-40a7-a1a9-3c8c3ac3180f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:47.697449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0dc21b34-1536-40a7-a1a9-3c8c3ac3180f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:47.698124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0dc21b34-1536-40a7-a1a9-3c8c3ac3180f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:47.698564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0dc21b34-1536-40a7-a1a9-3c8c3ac3180f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:47.699008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0dc21b34-1536-40a7-a1a9-3c8c3ac3180f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:47.843215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0dc21b34-1536-40a7-a1a9-3c8c3ac3180f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:47.852435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0dc21b34-1536-40a7-a1a9-3c8c3ac3180f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.166809 Aug 24 05:21:47.853016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 974/2055] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:47 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:48.873530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fa655d87-9934-4e95-82cc-57c056c29601 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:48.874099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fa655d87-9934-4e95-82cc-57c056c29601 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:48.876350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:21:48.882093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa655d87-9934-4e95-82cc-57c056c29601 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:48.882563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa655d87-9934-4e95-82cc-57c056c29601 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:48.883021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa655d87-9934-4e95-82cc-57c056c29601 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:48.883700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa655d87-9934-4e95-82cc-57c056c29601 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:48.884140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa655d87-9934-4e95-82cc-57c056c29601 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:48.884552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa655d87-9934-4e95-82cc-57c056c29601 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:49.020067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fa655d87-9934-4e95-82cc-57c056c29601 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:49.028323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fa655d87-9934-4e95-82cc-57c056c29601 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158749 Aug 24 05:21:49.028886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1082/2056] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:48 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:50.051543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-662cfc6b-2a17-47fd-a19f-f40edd385431 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:50.052197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-662cfc6b-2a17-47fd-a19f-f40edd385431 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:50.058972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-662cfc6b-2a17-47fd-a19f-f40edd385431 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:50.059447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-662cfc6b-2a17-47fd-a19f-f40edd385431 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:50.059875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-662cfc6b-2a17-47fd-a19f-f40edd385431 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:50.060560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-662cfc6b-2a17-47fd-a19f-f40edd385431 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:50.061005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-662cfc6b-2a17-47fd-a19f-f40edd385431 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:50.061419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-662cfc6b-2a17-47fd-a19f-f40edd385431 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:50.198267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-662cfc6b-2a17-47fd-a19f-f40edd385431 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:50.207230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-662cfc6b-2a17-47fd-a19f-f40edd385431 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160380 Aug 24 05:21:50.207817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 975/2057] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:50 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:51.228874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-be12352b-80df-4bd0-9325-39b264d4b3ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:51.229514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-be12352b-80df-4bd0-9325-39b264d4b3ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:51.236043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be12352b-80df-4bd0-9325-39b264d4b3ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:51.236520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be12352b-80df-4bd0-9325-39b264d4b3ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:51.236952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be12352b-80df-4bd0-9325-39b264d4b3ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:51.238421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be12352b-80df-4bd0-9325-39b264d4b3ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:51.238902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be12352b-80df-4bd0-9325-39b264d4b3ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:51.239319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be12352b-80df-4bd0-9325-39b264d4b3ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:51.373007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-be12352b-80df-4bd0-9325-39b264d4b3ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:51.381642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-be12352b-80df-4bd0-9325-39b264d4b3ef tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156745 Aug 24 05:21:51.382212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1083/2058] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:51 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:52.403128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6b42ebe0-0ad2-4fdb-aab3-6fd17c859fd7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:52.403705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6b42ebe0-0ad2-4fdb-aab3-6fd17c859fd7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:52.410145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b42ebe0-0ad2-4fdb-aab3-6fd17c859fd7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:52.410627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b42ebe0-0ad2-4fdb-aab3-6fd17c859fd7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:52.411104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b42ebe0-0ad2-4fdb-aab3-6fd17c859fd7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:52.411803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b42ebe0-0ad2-4fdb-aab3-6fd17c859fd7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:52.412262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b42ebe0-0ad2-4fdb-aab3-6fd17c859fd7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:52.412684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6b42ebe0-0ad2-4fdb-aab3-6fd17c859fd7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:52.550275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6b42ebe0-0ad2-4fdb-aab3-6fd17c859fd7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:52.559081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6b42ebe0-0ad2-4fdb-aab3-6fd17c859fd7 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159950 Aug 24 05:21:52.559648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 976/2059] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:52 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:53.580869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6eee9ac4-2e3d-4970-9e9c-d92106b6f89d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:53.581490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6eee9ac4-2e3d-4970-9e9c-d92106b6f89d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:53.588112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6eee9ac4-2e3d-4970-9e9c-d92106b6f89d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:53.588587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6eee9ac4-2e3d-4970-9e9c-d92106b6f89d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:53.589019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6eee9ac4-2e3d-4970-9e9c-d92106b6f89d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:53.589708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6eee9ac4-2e3d-4970-9e9c-d92106b6f89d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:53.590151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6eee9ac4-2e3d-4970-9e9c-d92106b6f89d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:53.590577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6eee9ac4-2e3d-4970-9e9c-d92106b6f89d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:53.723294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6eee9ac4-2e3d-4970-9e9c-d92106b6f89d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:53.731430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6eee9ac4-2e3d-4970-9e9c-d92106b6f89d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154441 Aug 24 05:21:53.731996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1084/2060] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:53 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:54.752196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-92aa020b-ff0d-404e-8b77-b7ebbea7db4d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:54.752936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-92aa020b-ff0d-404e-8b77-b7ebbea7db4d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:54.759700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92aa020b-ff0d-404e-8b77-b7ebbea7db4d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:54.760182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92aa020b-ff0d-404e-8b77-b7ebbea7db4d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:54.760615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92aa020b-ff0d-404e-8b77-b7ebbea7db4d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:54.761311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92aa020b-ff0d-404e-8b77-b7ebbea7db4d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:54.761762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92aa020b-ff0d-404e-8b77-b7ebbea7db4d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:54.762179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92aa020b-ff0d-404e-8b77-b7ebbea7db4d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:54.894229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-92aa020b-ff0d-404e-8b77-b7ebbea7db4d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:54.902586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-92aa020b-ff0d-404e-8b77-b7ebbea7db4d tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.154289 Aug 24 05:21:54.903182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 977/2061] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:54 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:55.923648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d7b41105-346e-42c7-bfc9-2e98602bf6ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:55.924257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d7b41105-346e-42c7-bfc9-2e98602bf6ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:55.931699 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7b41105-346e-42c7-bfc9-2e98602bf6ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:55.932176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7b41105-346e-42c7-bfc9-2e98602bf6ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:55.932606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7b41105-346e-42c7-bfc9-2e98602bf6ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:55.933289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7b41105-346e-42c7-bfc9-2e98602bf6ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:55.933735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7b41105-346e-42c7-bfc9-2e98602bf6ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:55.934153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7b41105-346e-42c7-bfc9-2e98602bf6ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:56.075182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d7b41105-346e-42c7-bfc9-2e98602bf6ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:56.083422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d7b41105-346e-42c7-bfc9-2e98602bf6ac tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.163680 Aug 24 05:21:56.084005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1085/2062] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:55 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:57.104370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e34a1cf7-b16a-4f15-a1cc-92245975e763 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:57.104998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e34a1cf7-b16a-4f15-a1cc-92245975e763 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:57.111503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e34a1cf7-b16a-4f15-a1cc-92245975e763 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:57.112046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e34a1cf7-b16a-4f15-a1cc-92245975e763 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:57.112684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e34a1cf7-b16a-4f15-a1cc-92245975e763 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:57.113310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e34a1cf7-b16a-4f15-a1cc-92245975e763 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:57.113754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e34a1cf7-b16a-4f15-a1cc-92245975e763 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:57.114165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e34a1cf7-b16a-4f15-a1cc-92245975e763 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:57.247086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e34a1cf7-b16a-4f15-a1cc-92245975e763 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:57.256511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e34a1cf7-b16a-4f15-a1cc-92245975e763 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155941 Aug 24 05:21:57.257093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 978/2063] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:57 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:58.278469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1778903a-a05c-4804-b075-8e63e6c71c77 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:58.279118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1778903a-a05c-4804-b075-8e63e6c71c77 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:58.286468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1778903a-a05c-4804-b075-8e63e6c71c77 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:58.286969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1778903a-a05c-4804-b075-8e63e6c71c77 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:58.287399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1778903a-a05c-4804-b075-8e63e6c71c77 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:58.288083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1778903a-a05c-4804-b075-8e63e6c71c77 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:58.288530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1778903a-a05c-4804-b075-8e63e6c71c77 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:58.288946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1778903a-a05c-4804-b075-8e63e6c71c77 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:58.424318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1778903a-a05c-4804-b075-8e63e6c71c77 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:58.433771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1778903a-a05c-4804-b075-8e63e6c71c77 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159176 Aug 24 05:21:58.434338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1086/2064] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:58 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:21:59.455370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-624a2f1f-1d7a-450d-b0f8-0e0762ceb585 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:21:59.456123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-624a2f1f-1d7a-450d-b0f8-0e0762ceb585 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:21:59.462770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-624a2f1f-1d7a-450d-b0f8-0e0762ceb585 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:59.463251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-624a2f1f-1d7a-450d-b0f8-0e0762ceb585 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:59.463682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-624a2f1f-1d7a-450d-b0f8-0e0762ceb585 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:59.464372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-624a2f1f-1d7a-450d-b0f8-0e0762ceb585 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:21:59.464818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-624a2f1f-1d7a-450d-b0f8-0e0762ceb585 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:21:59.465233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-624a2f1f-1d7a-450d-b0f8-0e0762ceb585 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:21:59.604487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-624a2f1f-1d7a-450d-b0f8-0e0762ceb585 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:21:59.613694 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-624a2f1f-1d7a-450d-b0f8-0e0762ceb585 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162149 Aug 24 05:21:59.614263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 979/2065] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:21:59 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:00.634913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5665d60e-82b5-40cd-aa2f-107136d25514 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:00.635488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5665d60e-82b5-40cd-aa2f-107136d25514 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:00.641875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5665d60e-82b5-40cd-aa2f-107136d25514 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:00.642357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5665d60e-82b5-40cd-aa2f-107136d25514 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:00.642897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5665d60e-82b5-40cd-aa2f-107136d25514 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:00.644224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5665d60e-82b5-40cd-aa2f-107136d25514 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:00.644649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5665d60e-82b5-40cd-aa2f-107136d25514 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:00.645115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5665d60e-82b5-40cd-aa2f-107136d25514 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:00.781732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5665d60e-82b5-40cd-aa2f-107136d25514 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:00.790661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5665d60e-82b5-40cd-aa2f-107136d25514 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159657 Aug 24 05:22:00.791249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1087/2066] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:00 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:01.812818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4e0e8802-4b60-41f9-9340-73e35e7f85ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:01.813381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4e0e8802-4b60-41f9-9340-73e35e7f85ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:01.820952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e0e8802-4b60-41f9-9340-73e35e7f85ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:01.821440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e0e8802-4b60-41f9-9340-73e35e7f85ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:01.821872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e0e8802-4b60-41f9-9340-73e35e7f85ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:01.822585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e0e8802-4b60-41f9-9340-73e35e7f85ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:01.823064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e0e8802-4b60-41f9-9340-73e35e7f85ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:01.823514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4e0e8802-4b60-41f9-9340-73e35e7f85ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:01.956909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4e0e8802-4b60-41f9-9340-73e35e7f85ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:01.965121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4e0e8802-4b60-41f9-9340-73e35e7f85ca tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156230 Aug 24 05:22:01.965680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 980/2067] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:01 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:02.987479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f83accc-bf4b-4c0b-8022-14e5258789a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:02.988142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1f83accc-bf4b-4c0b-8022-14e5258789a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:02.994522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f83accc-bf4b-4c0b-8022-14e5258789a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:02.995035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f83accc-bf4b-4c0b-8022-14e5258789a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:02.995471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f83accc-bf4b-4c0b-8022-14e5258789a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:02.996155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f83accc-bf4b-4c0b-8022-14e5258789a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:02.996606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f83accc-bf4b-4c0b-8022-14e5258789a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:02.997027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f83accc-bf4b-4c0b-8022-14e5258789a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:03.128232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1f83accc-bf4b-4c0b-8022-14e5258789a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:03.136509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1f83accc-bf4b-4c0b-8022-14e5258789a8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153482 Aug 24 05:22:03.137076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1088/2068] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:02 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:04.157865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-68ebbee2-0107-4dba-ae18-6a6c77fc18ab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:04.158468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-68ebbee2-0107-4dba-ae18-6a6c77fc18ab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:04.165370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68ebbee2-0107-4dba-ae18-6a6c77fc18ab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:04.165840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68ebbee2-0107-4dba-ae18-6a6c77fc18ab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:04.166267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68ebbee2-0107-4dba-ae18-6a6c77fc18ab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:04.166972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68ebbee2-0107-4dba-ae18-6a6c77fc18ab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:04.167416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68ebbee2-0107-4dba-ae18-6a6c77fc18ab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:04.167830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68ebbee2-0107-4dba-ae18-6a6c77fc18ab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:04.309662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-68ebbee2-0107-4dba-ae18-6a6c77fc18ab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:04.318670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-68ebbee2-0107-4dba-ae18-6a6c77fc18ab tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.164703 Aug 24 05:22:04.319254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 981/2069] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:04 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:05.339965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e6077aad-b558-4bde-b17a-c17500c7a7f1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:05.340573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e6077aad-b558-4bde-b17a-c17500c7a7f1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:05.347864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6077aad-b558-4bde-b17a-c17500c7a7f1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:05.348336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6077aad-b558-4bde-b17a-c17500c7a7f1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:05.348776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6077aad-b558-4bde-b17a-c17500c7a7f1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:05.349456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6077aad-b558-4bde-b17a-c17500c7a7f1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:05.349906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6077aad-b558-4bde-b17a-c17500c7a7f1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:05.350325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6077aad-b558-4bde-b17a-c17500c7a7f1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:05.352906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:05.482999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e6077aad-b558-4bde-b17a-c17500c7a7f1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:05.492241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e6077aad-b558-4bde-b17a-c17500c7a7f1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.156093 Aug 24 05:22:05.492826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1089/2070] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:05 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:06.513669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bc25a32f-4fa1-4397-8b3d-162ca6ad15a3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:06.514431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bc25a32f-4fa1-4397-8b3d-162ca6ad15a3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:06.521120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc25a32f-4fa1-4397-8b3d-162ca6ad15a3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:06.521605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc25a32f-4fa1-4397-8b3d-162ca6ad15a3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:06.522044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc25a32f-4fa1-4397-8b3d-162ca6ad15a3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:06.522795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc25a32f-4fa1-4397-8b3d-162ca6ad15a3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:06.523329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc25a32f-4fa1-4397-8b3d-162ca6ad15a3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:06.523758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc25a32f-4fa1-4397-8b3d-162ca6ad15a3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:06.662486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bc25a32f-4fa1-4397-8b3d-162ca6ad15a3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:06.670749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bc25a32f-4fa1-4397-8b3d-162ca6ad15a3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161109 Aug 24 05:22:06.671309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 982/2071] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:06 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:07.692378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-85e802a6-1f82-4ec8-8fd0-7dbcc9b5a61e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:07.692988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-85e802a6-1f82-4ec8-8fd0-7dbcc9b5a61e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:07.699513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85e802a6-1f82-4ec8-8fd0-7dbcc9b5a61e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:07.699995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85e802a6-1f82-4ec8-8fd0-7dbcc9b5a61e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:07.700426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85e802a6-1f82-4ec8-8fd0-7dbcc9b5a61e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:07.701105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85e802a6-1f82-4ec8-8fd0-7dbcc9b5a61e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:07.701550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85e802a6-1f82-4ec8-8fd0-7dbcc9b5a61e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:07.701967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-85e802a6-1f82-4ec8-8fd0-7dbcc9b5a61e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:07.841830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-85e802a6-1f82-4ec8-8fd0-7dbcc9b5a61e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:07.850563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-85e802a6-1f82-4ec8-8fd0-7dbcc9b5a61e tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162058 Aug 24 05:22:07.851090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1090/2072] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:07 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:08.872366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c613a5d8-e8b7-42a6-9346-1dd44a1f4f54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:08.872993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c613a5d8-e8b7-42a6-9346-1dd44a1f4f54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:08.879852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c613a5d8-e8b7-42a6-9346-1dd44a1f4f54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:08.880321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c613a5d8-e8b7-42a6-9346-1dd44a1f4f54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:08.880750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c613a5d8-e8b7-42a6-9346-1dd44a1f4f54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:08.881420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c613a5d8-e8b7-42a6-9346-1dd44a1f4f54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:08.881864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c613a5d8-e8b7-42a6-9346-1dd44a1f4f54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:08.882278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c613a5d8-e8b7-42a6-9346-1dd44a1f4f54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:08.886103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=78 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:09.018476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c613a5d8-e8b7-42a6-9346-1dd44a1f4f54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:09.026503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c613a5d8-e8b7-42a6-9346-1dd44a1f4f54 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.158169 Aug 24 05:22:09.027091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 983/2073] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:08 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:10.048123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e7ae6e05-e421-408d-ba9a-4781ef7b1b5b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:10.048758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e7ae6e05-e421-408d-ba9a-4781ef7b1b5b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:10.056217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7ae6e05-e421-408d-ba9a-4781ef7b1b5b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:10.056700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7ae6e05-e421-408d-ba9a-4781ef7b1b5b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:10.057132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7ae6e05-e421-408d-ba9a-4781ef7b1b5b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:10.057828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7ae6e05-e421-408d-ba9a-4781ef7b1b5b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:10.058273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7ae6e05-e421-408d-ba9a-4781ef7b1b5b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:10.058712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7ae6e05-e421-408d-ba9a-4781ef7b1b5b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:10.197678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e7ae6e05-e421-408d-ba9a-4781ef7b1b5b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:10.206064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e7ae6e05-e421-408d-ba9a-4781ef7b1b5b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161768 Aug 24 05:22:10.206785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1091/2074] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:10 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:11.227728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-97caaecf-f8d3-49ca-a101-95ad1280af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:11.228343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-97caaecf-f8d3-49ca-a101-95ad1280af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:11.234790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97caaecf-f8d3-49ca-a101-95ad1280af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:11.235274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97caaecf-f8d3-49ca-a101-95ad1280af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:11.235706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97caaecf-f8d3-49ca-a101-95ad1280af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:11.236391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97caaecf-f8d3-49ca-a101-95ad1280af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:11.237441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97caaecf-f8d3-49ca-a101-95ad1280af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:11.237868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97caaecf-f8d3-49ca-a101-95ad1280af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:11.371145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-97caaecf-f8d3-49ca-a101-95ad1280af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:11.379452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-97caaecf-f8d3-49ca-a101-95ad1280af4c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155678 Aug 24 05:22:11.380021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 984/2075] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:11 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:12.400228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b5c38472-72c8-4875-9d47-7e24cc749f6f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:12.400788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b5c38472-72c8-4875-9d47-7e24cc749f6f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:12.407207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5c38472-72c8-4875-9d47-7e24cc749f6f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:12.407687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5c38472-72c8-4875-9d47-7e24cc749f6f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:12.408122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5c38472-72c8-4875-9d47-7e24cc749f6f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:12.408933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5c38472-72c8-4875-9d47-7e24cc749f6f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:12.409382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5c38472-72c8-4875-9d47-7e24cc749f6f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:12.409804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5c38472-72c8-4875-9d47-7e24cc749f6f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:12.541173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b5c38472-72c8-4875-9d47-7e24cc749f6f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:12.550075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b5c38472-72c8-4875-9d47-7e24cc749f6f tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153131 Aug 24 05:22:12.550645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1092/2076] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:12 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:13.571260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0822492c-d36c-4eb8-96cd-f6aa78fef7a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:13.571843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0822492c-d36c-4eb8-96cd-f6aa78fef7a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:13.574231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:13.579618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0822492c-d36c-4eb8-96cd-f6aa78fef7a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:13.580106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0822492c-d36c-4eb8-96cd-f6aa78fef7a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:13.580675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0822492c-d36c-4eb8-96cd-f6aa78fef7a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:13.581417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0822492c-d36c-4eb8-96cd-f6aa78fef7a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:13.581866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0822492c-d36c-4eb8-96cd-f6aa78fef7a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:13.582290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0822492c-d36c-4eb8-96cd-f6aa78fef7a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:13.713929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0822492c-d36c-4eb8-96cd-f6aa78fef7a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:13.722950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0822492c-d36c-4eb8-96cd-f6aa78fef7a4 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155568 Aug 24 05:22:13.723521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 985/2077] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:13 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:14.744052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e190e157-a9b5-4943-955a-46be704f8552 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:14.744666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e190e157-a9b5-4943-955a-46be704f8552 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:14.751312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e190e157-a9b5-4943-955a-46be704f8552 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:14.751801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e190e157-a9b5-4943-955a-46be704f8552 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:14.752756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e190e157-a9b5-4943-955a-46be704f8552 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:14.753555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e190e157-a9b5-4943-955a-46be704f8552 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:14.754025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e190e157-a9b5-4943-955a-46be704f8552 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:14.754448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e190e157-a9b5-4943-955a-46be704f8552 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:14.891730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e190e157-a9b5-4943-955a-46be704f8552 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:14.900884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e190e157-a9b5-4943-955a-46be704f8552 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160652 Aug 24 05:22:14.901457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1093/2078] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:14 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:15.922065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9e43a2c6-63d4-417f-a9ba-367fe26d4968 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:15.922665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9e43a2c6-63d4-417f-a9ba-367fe26d4968 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:15.929224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e43a2c6-63d4-417f-a9ba-367fe26d4968 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:15.929960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e43a2c6-63d4-417f-a9ba-367fe26d4968 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:15.930382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e43a2c6-63d4-417f-a9ba-367fe26d4968 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:15.931084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e43a2c6-63d4-417f-a9ba-367fe26d4968 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:15.931555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e43a2c6-63d4-417f-a9ba-367fe26d4968 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:15.931969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e43a2c6-63d4-417f-a9ba-367fe26d4968 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:16.064228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9e43a2c6-63d4-417f-a9ba-367fe26d4968 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:16.073255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9e43a2c6-63d4-417f-a9ba-367fe26d4968 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155028 Aug 24 05:22:16.073820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 986/2079] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:15 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:17.095253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-13e415d6-260e-45a5-8102-7259a5d06c3a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:17.096427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-13e415d6-260e-45a5-8102-7259a5d06c3a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:17.102894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13e415d6-260e-45a5-8102-7259a5d06c3a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:17.103386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13e415d6-260e-45a5-8102-7259a5d06c3a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:17.103827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13e415d6-260e-45a5-8102-7259a5d06c3a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:17.104537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13e415d6-260e-45a5-8102-7259a5d06c3a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:17.104992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13e415d6-260e-45a5-8102-7259a5d06c3a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:17.105415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13e415d6-260e-45a5-8102-7259a5d06c3a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:17.242401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-13e415d6-260e-45a5-8102-7259a5d06c3a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:17.250623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-13e415d6-260e-45a5-8102-7259a5d06c3a tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.159963 Aug 24 05:22:17.251284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1094/2080] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:17 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:18.271593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bcd2ea84-1276-445d-a38e-7228c6951edd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:18.272287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bcd2ea84-1276-445d-a38e-7228c6951edd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:18.278679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcd2ea84-1276-445d-a38e-7228c6951edd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:18.279174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcd2ea84-1276-445d-a38e-7228c6951edd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:18.279599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcd2ea84-1276-445d-a38e-7228c6951edd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:18.280272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcd2ea84-1276-445d-a38e-7228c6951edd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:18.280715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcd2ea84-1276-445d-a38e-7228c6951edd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:18.281128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bcd2ea84-1276-445d-a38e-7228c6951edd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:18.411868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bcd2ea84-1276-445d-a38e-7228c6951edd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:18.420471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bcd2ea84-1276-445d-a38e-7228c6951edd tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.152885 Aug 24 05:22:18.421038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 987/2081] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:18 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:19.442421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-64376671-b614-4fd3-bb3c-b44df9acf98c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:19.443063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-64376671-b614-4fd3-bb3c-b44df9acf98c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:19.445879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:19.455400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64376671-b614-4fd3-bb3c-b44df9acf98c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:19.455982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64376671-b614-4fd3-bb3c-b44df9acf98c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:19.456414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64376671-b614-4fd3-bb3c-b44df9acf98c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:19.457097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64376671-b614-4fd3-bb3c-b44df9acf98c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:19.457634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64376671-b614-4fd3-bb3c-b44df9acf98c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:19.458391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64376671-b614-4fd3-bb3c-b44df9acf98c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:19.591138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-64376671-b614-4fd3-bb3c-b44df9acf98c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:19.599941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-64376671-b614-4fd3-bb3c-b44df9acf98c tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161402 Aug 24 05:22:19.600510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1095/2082] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:19 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:20.621453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-417c52a4-5549-4d92-b44f-d45501cca492 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:20.622048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-417c52a4-5549-4d92-b44f-d45501cca492 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:20.628724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-417c52a4-5549-4d92-b44f-d45501cca492 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:20.629205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-417c52a4-5549-4d92-b44f-d45501cca492 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:20.629644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-417c52a4-5549-4d92-b44f-d45501cca492 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:20.630330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-417c52a4-5549-4d92-b44f-d45501cca492 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:20.630816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-417c52a4-5549-4d92-b44f-d45501cca492 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:20.631243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-417c52a4-5549-4d92-b44f-d45501cca492 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:20.767245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-417c52a4-5549-4d92-b44f-d45501cca492 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:20.778467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-417c52a4-5549-4d92-b44f-d45501cca492 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.160927 Aug 24 05:22:20.779081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 988/2083] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:20 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:21.801543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-58aa9efb-59a7-4cff-9278-6190ea9c14b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:21.802182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-58aa9efb-59a7-4cff-9278-6190ea9c14b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:21.809052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58aa9efb-59a7-4cff-9278-6190ea9c14b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:21.809530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58aa9efb-59a7-4cff-9278-6190ea9c14b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:21.809960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58aa9efb-59a7-4cff-9278-6190ea9c14b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:21.810646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58aa9efb-59a7-4cff-9278-6190ea9c14b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:21.811118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58aa9efb-59a7-4cff-9278-6190ea9c14b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:21.811537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58aa9efb-59a7-4cff-9278-6190ea9c14b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:21.946015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-58aa9efb-59a7-4cff-9278-6190ea9c14b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:21.954119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-58aa9efb-59a7-4cff-9278-6190ea9c14b1 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157142 Aug 24 05:22:21.954701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1096/2084] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:21 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:22.975567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dd1de461-d407-48cd-a405-54f850ac6dc3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:22.976162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dd1de461-d407-48cd-a405-54f850ac6dc3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:22.982664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd1de461-d407-48cd-a405-54f850ac6dc3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:22.983179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd1de461-d407-48cd-a405-54f850ac6dc3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:22.983603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd1de461-d407-48cd-a405-54f850ac6dc3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:22.984281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd1de461-d407-48cd-a405-54f850ac6dc3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:22.984726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd1de461-d407-48cd-a405-54f850ac6dc3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:22.985189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd1de461-d407-48cd-a405-54f850ac6dc3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:23.117057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dd1de461-d407-48cd-a405-54f850ac6dc3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:23.125481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dd1de461-d407-48cd-a405-54f850ac6dc3 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153858 Aug 24 05:22:23.126042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 989/2085] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:22 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:24.147818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9efa481c-9b0d-40eb-9aa2-1841adcccb9b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:24.148442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9efa481c-9b0d-40eb-9aa2-1841adcccb9b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:24.154943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9efa481c-9b0d-40eb-9aa2-1841adcccb9b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:24.155426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9efa481c-9b0d-40eb-9aa2-1841adcccb9b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:24.155861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9efa481c-9b0d-40eb-9aa2-1841adcccb9b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:24.156547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9efa481c-9b0d-40eb-9aa2-1841adcccb9b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:24.156999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9efa481c-9b0d-40eb-9aa2-1841adcccb9b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:24.157423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9efa481c-9b0d-40eb-9aa2-1841adcccb9b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:24.324486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9efa481c-9b0d-40eb-9aa2-1841adcccb9b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:24.333073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9efa481c-9b0d-40eb-9aa2-1841adcccb9b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.189444 Aug 24 05:22:24.333651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1097/2086] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:24 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:25.353332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bd326726-6c94-4f4f-9890-4b5bc184af92 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:25.353932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bd326726-6c94-4f4f-9890-4b5bc184af92 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:25.360462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd326726-6c94-4f4f-9890-4b5bc184af92 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:25.360935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd326726-6c94-4f4f-9890-4b5bc184af92 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:25.361995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd326726-6c94-4f4f-9890-4b5bc184af92 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:25.362670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd326726-6c94-4f4f-9890-4b5bc184af92 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:25.363133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd326726-6c94-4f4f-9890-4b5bc184af92 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:25.363547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd326726-6c94-4f4f-9890-4b5bc184af92 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:25.494917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bd326726-6c94-4f4f-9890-4b5bc184af92 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:25.503498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bd326726-6c94-4f4f-9890-4b5bc184af92 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153908 Aug 24 05:22:25.504070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 990/2087] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:25 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:26.524583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-26620ee2-5506-4b85-8bec-910ff336fada tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:26.525308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-26620ee2-5506-4b85-8bec-910ff336fada tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:26.531566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26620ee2-5506-4b85-8bec-910ff336fada tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:26.532039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26620ee2-5506-4b85-8bec-910ff336fada tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:26.532466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26620ee2-5506-4b85-8bec-910ff336fada tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:26.533175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26620ee2-5506-4b85-8bec-910ff336fada tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:26.534321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26620ee2-5506-4b85-8bec-910ff336fada tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:26.534765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26620ee2-5506-4b85-8bec-910ff336fada tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:26.669263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-26620ee2-5506-4b85-8bec-910ff336fada tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:26.678120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-26620ee2-5506-4b85-8bec-910ff336fada tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.157532 Aug 24 05:22:26.678679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1098/2088] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:26 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:27.700363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ae934d43-fc8e-4155-b52f-383ffc45eb07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:27.700997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ae934d43-fc8e-4155-b52f-383ffc45eb07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:27.707449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae934d43-fc8e-4155-b52f-383ffc45eb07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:27.707918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae934d43-fc8e-4155-b52f-383ffc45eb07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:27.708370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae934d43-fc8e-4155-b52f-383ffc45eb07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:27.709044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae934d43-fc8e-4155-b52f-383ffc45eb07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:27.709484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae934d43-fc8e-4155-b52f-383ffc45eb07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:27.709894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae934d43-fc8e-4155-b52f-383ffc45eb07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:27.850822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ae934d43-fc8e-4155-b52f-383ffc45eb07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:27.859022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ae934d43-fc8e-4155-b52f-383ffc45eb07 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162534 Aug 24 05:22:27.859579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 991/2089] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:27 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:28.880647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6a4bcb36-e5e8-42cd-8397-e32b6bb71f29 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:28.881255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6a4bcb36-e5e8-42cd-8397-e32b6bb71f29 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:28.888018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a4bcb36-e5e8-42cd-8397-e32b6bb71f29 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:28.888496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a4bcb36-e5e8-42cd-8397-e32b6bb71f29 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:28.888928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a4bcb36-e5e8-42cd-8397-e32b6bb71f29 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:28.889639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a4bcb36-e5e8-42cd-8397-e32b6bb71f29 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:28.890087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a4bcb36-e5e8-42cd-8397-e32b6bb71f29 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:28.890509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a4bcb36-e5e8-42cd-8397-e32b6bb71f29 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:29.019143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6a4bcb36-e5e8-42cd-8397-e32b6bb71f29 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:29.027519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6a4bcb36-e5e8-42cd-8397-e32b6bb71f29 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.151381 Aug 24 05:22:29.028085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1099/2090] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:28 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:22:30.048954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eff37c75-4052-446b-84f2-a457dadbfda8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:30.049507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-eff37c75-4052-446b-84f2-a457dadbfda8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:30.056986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eff37c75-4052-446b-84f2-a457dadbfda8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:30.057456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eff37c75-4052-446b-84f2-a457dadbfda8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:30.057878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eff37c75-4052-446b-84f2-a457dadbfda8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:30.058552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eff37c75-4052-446b-84f2-a457dadbfda8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:30.059036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eff37c75-4052-446b-84f2-a457dadbfda8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:30.059450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eff37c75-4052-446b-84f2-a457dadbfda8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:30.199222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-eff37c75-4052-446b-84f2-a457dadbfda8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:30.207903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-eff37c75-4052-446b-84f2-a457dadbfda8 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.162891 Aug 24 05:22:30.208475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 992/2091] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:30 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:31.229434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-79c94aa5-aaed-42da-a694-d9f6f56ac742 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:31.230055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-79c94aa5-aaed-42da-a694-d9f6f56ac742 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:31.237045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79c94aa5-aaed-42da-a694-d9f6f56ac742 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:31.238263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79c94aa5-aaed-42da-a694-d9f6f56ac742 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:31.238741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79c94aa5-aaed-42da-a694-d9f6f56ac742 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:31.239457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79c94aa5-aaed-42da-a694-d9f6f56ac742 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:31.239909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79c94aa5-aaed-42da-a694-d9f6f56ac742 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:31.240331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79c94aa5-aaed-42da-a694-d9f6f56ac742 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:31.377765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-79c94aa5-aaed-42da-a694-d9f6f56ac742 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:31.386375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-79c94aa5-aaed-42da-a694-d9f6f56ac742 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161076 Aug 24 05:22:31.386976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1100/2092] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:31 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:32.409332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-425f3196-38ee-400d-a7b1-110768044cbb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:32.409927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-425f3196-38ee-400d-a7b1-110768044cbb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:32.416330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-425f3196-38ee-400d-a7b1-110768044cbb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:32.416810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-425f3196-38ee-400d-a7b1-110768044cbb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:32.417241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-425f3196-38ee-400d-a7b1-110768044cbb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:32.417925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-425f3196-38ee-400d-a7b1-110768044cbb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:32.418373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-425f3196-38ee-400d-a7b1-110768044cbb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:32.418815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-425f3196-38ee-400d-a7b1-110768044cbb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:32.551072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-425f3196-38ee-400d-a7b1-110768044cbb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:32.559547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-425f3196-38ee-400d-a7b1-110768044cbb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.155220 Aug 24 05:22:32.560106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 993/2093] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:32 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:33.580579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cb1774a4-a08d-4fba-98c9-6d53590f604b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:33.581343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cb1774a4-a08d-4fba-98c9-6d53590f604b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:33.588911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1774a4-a08d-4fba-98c9-6d53590f604b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:33.589394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1774a4-a08d-4fba-98c9-6d53590f604b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:33.589831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1774a4-a08d-4fba-98c9-6d53590f604b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:33.590519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1774a4-a08d-4fba-98c9-6d53590f604b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:33.590993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1774a4-a08d-4fba-98c9-6d53590f604b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:33.591422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1774a4-a08d-4fba-98c9-6d53590f604b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:33.718330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cb1774a4-a08d-4fba-98c9-6d53590f604b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:33.727238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cb1774a4-a08d-4fba-98c9-6d53590f604b tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.150502 Aug 24 05:22:33.727797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1101/2094] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:33 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:34.748722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4166b0d3-c4ce-48cb-8d33-e554177a01cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:34.749259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4166b0d3-c4ce-48cb-8d33-e554177a01cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:34.756152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4166b0d3-c4ce-48cb-8d33-e554177a01cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:34.756661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4166b0d3-c4ce-48cb-8d33-e554177a01cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:34.757094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4166b0d3-c4ce-48cb-8d33-e554177a01cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:34.757786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4166b0d3-c4ce-48cb-8d33-e554177a01cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:34.758237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4166b0d3-c4ce-48cb-8d33-e554177a01cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:34.758657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4166b0d3-c4ce-48cb-8d33-e554177a01cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:34.889300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4166b0d3-c4ce-48cb-8d33-e554177a01cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:34.898384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4166b0d3-c4ce-48cb-8d33-e554177a01cb tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153579 Aug 24 05:22:34.899006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 994/2095] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:34 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:35.920201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-103b0e83-be3c-40c0-b6a1-93f094274f08 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:35.920751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-103b0e83-be3c-40c0-b6a1-93f094274f08 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:35.927417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103b0e83-be3c-40c0-b6a1-93f094274f08 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:35.927887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103b0e83-be3c-40c0-b6a1-93f094274f08 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:35.928312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103b0e83-be3c-40c0-b6a1-93f094274f08 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:35.928983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103b0e83-be3c-40c0-b6a1-93f094274f08 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:35.929425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103b0e83-be3c-40c0-b6a1-93f094274f08 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:35.930111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103b0e83-be3c-40c0-b6a1-93f094274f08 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:35.932644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=78 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:36.069379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-103b0e83-be3c-40c0-b6a1-93f094274f08 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:36.077526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-103b0e83-be3c-40c0-b6a1-93f094274f08 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.161326 Aug 24 05:22:36.078084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1102/2096] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:35 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:37.098973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2168c943-35fe-4eb1-b3af-6953062a9293 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:37.099576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2168c943-35fe-4eb1-b3af-6953062a9293 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] [instance: 61f9cc46-e608-4e87-8a41-cbd6058576a0] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:37.105735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2168c943-35fe-4eb1-b3af-6953062a9293 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:37.106243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2168c943-35fe-4eb1-b3af-6953062a9293 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:37.106705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2168c943-35fe-4eb1-b3af-6953062a9293 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:37.107405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2168c943-35fe-4eb1-b3af-6953062a9293 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:37.107857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2168c943-35fe-4eb1-b3af-6953062a9293 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:37.108282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2168c943-35fe-4eb1-b3af-6953062a9293 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:37.239403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2168c943-35fe-4eb1-b3af-6953062a9293 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde5a0eecb8d411c82238c1ac3d4c0f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b37fd4d710b4a7ba471c224324d2a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:37.247593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2168c943-35fe-4eb1-b3af-6953062a9293 tempest-VolumesSnapshotTestJSON-2011091351 tempest-VolumesSnapshotTestJSON-2011091351-project] 10.222.0.97 "GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0" status: 200 len: 1559 microversion: 2.1 time: 0.153224 Aug 24 05:22:37.248159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 995/2097] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:37 2022] GET /compute/v2.1/servers/61f9cc46-e608-4e87-8a41-cbd6058576a0 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:37.538278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:37.538830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:37.545267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:37.545750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:37.546185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:37.547163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:37.548063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:37.548611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:37.577838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Going to try to terminate instance {{(pid=120558) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:22:37.601011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:37.602316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:37.609061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:37.609882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:37.610654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:37.611781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:37.612512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:37.613832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:37.647284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR oslo.messaging._drivers.impl_rabbit [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [b32f773c-4331-46e2-9129-be6791e14ccb] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:22:37.647858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Going to try to terminate instance {{(pid=120557) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:22:37.708340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR oslo.messaging._drivers.impl_rabbit [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [14204b2e-2799-4c1c-aec5-4108a696bd51] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:22:38.655016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [b32f773c-4331-46e2-9129-be6791e14ccb] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 49846. Aug 24 05:22:38.675224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-33c64f4d-c7dc-4422-8cc7-9602cfd507f1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 204 len: 0 microversion: 2.1 time: 1.140786 Aug 24 05:22:38.675841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1103/2098] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:22:37 2022] DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:22:38.682731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f3eb59d8-b83f-4121-aa01-562fc5a07fe8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:38.683317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f3eb59d8-b83f-4121-aa01-562fc5a07fe8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:38.689913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3eb59d8-b83f-4121-aa01-562fc5a07fe8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:38.690386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3eb59d8-b83f-4121-aa01-562fc5a07fe8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:38.690870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3eb59d8-b83f-4121-aa01-562fc5a07fe8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:38.692079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3eb59d8-b83f-4121-aa01-562fc5a07fe8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:38.692533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3eb59d8-b83f-4121-aa01-562fc5a07fe8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:38.692949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3eb59d8-b83f-4121-aa01-562fc5a07fe8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:38.716836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [14204b2e-2799-4c1c-aec5-4108a696bd51] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 49850. Aug 24 05:22:38.718879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f3eb59d8-b83f-4121-aa01-562fc5a07fe8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Going to try to terminate instance {{(pid=120558) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:22:38.737370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-03cc1dad-baa2-4432-be54-8e7c4411eba6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 204 len: 0 microversion: 2.1 time: 1.140609 Aug 24 05:22:38.738015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 996/2099] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:22:37 2022] DELETE /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 0 bytes in 1142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:22:38.743601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9fb20fa2-adc5-44e2-b571-c7c1eaebb772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:38.744293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9fb20fa2-adc5-44e2-b571-c7c1eaebb772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:38.755756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fb20fa2-adc5-44e2-b571-c7c1eaebb772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:38.756325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fb20fa2-adc5-44e2-b571-c7c1eaebb772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:38.756843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fb20fa2-adc5-44e2-b571-c7c1eaebb772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:38.757744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fb20fa2-adc5-44e2-b571-c7c1eaebb772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:38.758303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fb20fa2-adc5-44e2-b571-c7c1eaebb772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:38.758828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9fb20fa2-adc5-44e2-b571-c7c1eaebb772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:38.799775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f3eb59d8-b83f-4121-aa01-562fc5a07fe8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "DELETE /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 204 len: 0 microversion: 2.1 time: 0.122501 Aug 24 05:22:38.800476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1104/2100] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:22:38 2022] DELETE /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:22:38.806833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aabd9e26-1fac-4b9f-8033-16b8deb9bcc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:38.807546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aabd9e26-1fac-4b9f-8033-16b8deb9bcc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:38.813899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aabd9e26-1fac-4b9f-8033-16b8deb9bcc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:38.814392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aabd9e26-1fac-4b9f-8033-16b8deb9bcc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:38.814881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aabd9e26-1fac-4b9f-8033-16b8deb9bcc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:38.815614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aabd9e26-1fac-4b9f-8033-16b8deb9bcc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:38.816067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aabd9e26-1fac-4b9f-8033-16b8deb9bcc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:38.816559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aabd9e26-1fac-4b9f-8033-16b8deb9bcc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:38.923452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9fb20fa2-adc5-44e2-b571-c7c1eaebb772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:38.926438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:38.935237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9fb20fa2-adc5-44e2-b571-c7c1eaebb772 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1726 microversion: 2.1 time: 0.195740 Aug 24 05:22:38.935838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 997/2101] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:38.941083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-464801a7-400f-4f2c-ba11-db8fca3d1ea5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:38.941757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-464801a7-400f-4f2c-ba11-db8fca3d1ea5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:38.952125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-464801a7-400f-4f2c-ba11-db8fca3d1ea5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:38.952606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-464801a7-400f-4f2c-ba11-db8fca3d1ea5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:38.953041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-464801a7-400f-4f2c-ba11-db8fca3d1ea5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:38.953736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-464801a7-400f-4f2c-ba11-db8fca3d1ea5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:38.954186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-464801a7-400f-4f2c-ba11-db8fca3d1ea5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:38.954604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-464801a7-400f-4f2c-ba11-db8fca3d1ea5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:38.981587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aabd9e26-1fac-4b9f-8033-16b8deb9bcc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:38.990642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aabd9e26-1fac-4b9f-8033-16b8deb9bcc0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1722 microversion: 2.1 time: 0.188860 Aug 24 05:22:38.991243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1105/2102] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:39.085030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-464801a7-400f-4f2c-ba11-db8fca3d1ea5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:39.093341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-464801a7-400f-4f2c-ba11-db8fca3d1ea5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1719 microversion: 2.1 time: 0.156368 Aug 24 05:22:39.093906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 998/2103] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:39.957325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8b5f3e0b-9754-41f6-b4df-ebd5abaa0e17 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:39.958066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8b5f3e0b-9754-41f6-b4df-ebd5abaa0e17 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:39.964581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b5f3e0b-9754-41f6-b4df-ebd5abaa0e17 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:39.965061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b5f3e0b-9754-41f6-b4df-ebd5abaa0e17 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:39.965493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b5f3e0b-9754-41f6-b4df-ebd5abaa0e17 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:39.966173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b5f3e0b-9754-41f6-b4df-ebd5abaa0e17 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:39.966622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b5f3e0b-9754-41f6-b4df-ebd5abaa0e17 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:39.967070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b5f3e0b-9754-41f6-b4df-ebd5abaa0e17 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:40.011670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-72df567e-ea37-47ae-8563-359f5cc2cb55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:40.012213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-72df567e-ea37-47ae-8563-359f5cc2cb55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:40.018639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72df567e-ea37-47ae-8563-359f5cc2cb55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:40.019160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72df567e-ea37-47ae-8563-359f5cc2cb55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:40.020156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72df567e-ea37-47ae-8563-359f5cc2cb55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:40.020850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72df567e-ea37-47ae-8563-359f5cc2cb55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:40.021302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72df567e-ea37-47ae-8563-359f5cc2cb55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:40.021723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72df567e-ea37-47ae-8563-359f5cc2cb55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:40.101751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8b5f3e0b-9754-41f6-b4df-ebd5abaa0e17 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:40.110424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8b5f3e0b-9754-41f6-b4df-ebd5abaa0e17 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1726 microversion: 2.1 time: 0.156612 Aug 24 05:22:40.111035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1106/2104] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:40.116308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2943ef74-5789-42d5-a6ba-e9fa8611d102 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:40.116918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2943ef74-5789-42d5-a6ba-e9fa8611d102 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:40.122911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2943ef74-5789-42d5-a6ba-e9fa8611d102 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:40.123397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2943ef74-5789-42d5-a6ba-e9fa8611d102 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:40.123833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2943ef74-5789-42d5-a6ba-e9fa8611d102 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:40.124729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2943ef74-5789-42d5-a6ba-e9fa8611d102 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:40.125181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2943ef74-5789-42d5-a6ba-e9fa8611d102 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:40.125796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2943ef74-5789-42d5-a6ba-e9fa8611d102 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:40.158897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-72df567e-ea37-47ae-8563-359f5cc2cb55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:40.168135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-72df567e-ea37-47ae-8563-359f5cc2cb55 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1722 microversion: 2.1 time: 0.160276 Aug 24 05:22:40.168721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 999/2105] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:22:40.262142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2943ef74-5789-42d5-a6ba-e9fa8611d102 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:40.270475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2943ef74-5789-42d5-a6ba-e9fa8611d102 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1719 microversion: 2.1 time: 0.158481 Aug 24 05:22:40.271074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1107/2106] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:40.621303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:22:40.621547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:22:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:22:41.134301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-88a43a39-71f5-4820-bb20-e50250e6efc1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:41.135790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-88a43a39-71f5-4820-bb20-e50250e6efc1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:41.143392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88a43a39-71f5-4820-bb20-e50250e6efc1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:41.143893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88a43a39-71f5-4820-bb20-e50250e6efc1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:41.144553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88a43a39-71f5-4820-bb20-e50250e6efc1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:41.145277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88a43a39-71f5-4820-bb20-e50250e6efc1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:41.145947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88a43a39-71f5-4820-bb20-e50250e6efc1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:41.146381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88a43a39-71f5-4820-bb20-e50250e6efc1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:41.161921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:22:41.165491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:22:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 (ip 10.222.0.97) !!! Aug 24 05:22:41.192145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f9ffbb9b-c90b-4ce9-9830-e21d8e068942 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:41.193831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f9ffbb9b-c90b-4ce9-9830-e21d8e068942 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:41.201634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9ffbb9b-c90b-4ce9-9830-e21d8e068942 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:41.202466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9ffbb9b-c90b-4ce9-9830-e21d8e068942 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:41.203862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9ffbb9b-c90b-4ce9-9830-e21d8e068942 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:41.204657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9ffbb9b-c90b-4ce9-9830-e21d8e068942 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:41.205180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9ffbb9b-c90b-4ce9-9830-e21d8e068942 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:41.205869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9ffbb9b-c90b-4ce9-9830-e21d8e068942 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:41.516975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-88a43a39-71f5-4820-bb20-e50250e6efc1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:41.529469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-88a43a39-71f5-4820-bb20-e50250e6efc1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1726 microversion: 2.1 time: 0.400106 Aug 24 05:22:41.538552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1000/2107] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:41 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1726 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:41.538552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8f1c3afd-09e1-4bf6-a546-eda24e9a6792 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:41.538552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8f1c3afd-09e1-4bf6-a546-eda24e9a6792 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:41.544712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c3afd-09e1-4bf6-a546-eda24e9a6792 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:41.545509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c3afd-09e1-4bf6-a546-eda24e9a6792 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:41.546117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c3afd-09e1-4bf6-a546-eda24e9a6792 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:41.547365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c3afd-09e1-4bf6-a546-eda24e9a6792 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:41.547834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c3afd-09e1-4bf6-a546-eda24e9a6792 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:41.548260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1c3afd-09e1-4bf6-a546-eda24e9a6792 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:41.683645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f9ffbb9b-c90b-4ce9-9830-e21d8e068942 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:41.693468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f9ffbb9b-c90b-4ce9-9830-e21d8e068942 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1722 microversion: 2.1 time: 0.505290 Aug 24 05:22:41.695114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1108/2108] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1722 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:41.897074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8f1c3afd-09e1-4bf6-a546-eda24e9a6792 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:41.909931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8f1c3afd-09e1-4bf6-a546-eda24e9a6792 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1719 microversion: 2.1 time: 0.378653 Aug 24 05:22:41.917463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1001/2109] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1719 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:42.270294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-064172e2-64c4-47ad-a6bc-14208c983c72 req-ecd69b7b-7c6c-4dfe-b384-9aaa49e31b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0463d0c-9ee3-4f76-91c6-2fcbdfb55053", "name": "network-vif-deleted", "tag": "6cf34b36-25b7-4379-a2c5-fda35bfb9740"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:22:42.281492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-064172e2-64c4-47ad-a6bc-14208c983c72 req-ecd69b7b-7c6c-4dfe-b384-9aaa49e31b1a service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:42.282120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-064172e2-64c4-47ad-a6bc-14208c983c72 req-ecd69b7b-7c6c-4dfe-b384-9aaa49e31b1a service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:42.282831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-064172e2-64c4-47ad-a6bc-14208c983c72 req-ecd69b7b-7c6c-4dfe-b384-9aaa49e31b1a service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:42.296746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-064172e2-64c4-47ad-a6bc-14208c983c72 req-ecd69b7b-7c6c-4dfe-b384-9aaa49e31b1a service nova] Creating event network-vif-deleted:6cf34b36-25b7-4379-a2c5-fda35bfb9740 for instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 on hv-cinder-85426 Aug 24 05:22:42.304284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-064172e2-64c4-47ad-a6bc-14208c983c72 req-ecd69b7b-7c6c-4dfe-b384-9aaa49e31b1a service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128381 Aug 24 05:22:42.305730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1109/2110] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:22:42.557034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-84e4c9e1-8c76-459d-8548-2bf4be7abbf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:42.557864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-84e4c9e1-8c76-459d-8548-2bf4be7abbf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:42.565315 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-84e4c9e1-8c76-459d-8548-2bf4be7abbf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:42.565951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-84e4c9e1-8c76-459d-8548-2bf4be7abbf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:42.567226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-84e4c9e1-8c76-459d-8548-2bf4be7abbf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:42.568788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-84e4c9e1-8c76-459d-8548-2bf4be7abbf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:42.571089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-84e4c9e1-8c76-459d-8548-2bf4be7abbf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:42.571633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-84e4c9e1-8c76-459d-8548-2bf4be7abbf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:42.714540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-84e4c9e1-8c76-459d-8548-2bf4be7abbf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:42.715626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e19cb155-20ea-4b2d-a6a8-67768658254c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:42.716738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e19cb155-20ea-4b2d-a6a8-67768658254c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:42.726045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e19cb155-20ea-4b2d-a6a8-67768658254c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:42.726473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-84e4c9e1-8c76-459d-8548-2bf4be7abbf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.177070 Aug 24 05:22:42.727454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e19cb155-20ea-4b2d-a6a8-67768658254c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:42.728171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e19cb155-20ea-4b2d-a6a8-67768658254c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:42.736769 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1002/2111] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:42.738743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e19cb155-20ea-4b2d-a6a8-67768658254c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:42.740037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e19cb155-20ea-4b2d-a6a8-67768658254c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:42.740713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e19cb155-20ea-4b2d-a6a8-67768658254c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:42.813495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e19cb155-20ea-4b2d-a6a8-67768658254c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:42.822890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e19cb155-20ea-4b2d-a6a8-67768658254c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1655 microversion: 2.1 time: 0.112448 Aug 24 05:22:42.823461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1110/2112] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1655 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:22:42.943722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-98f78a19-2f5b-45b8-8a94-091d5b556add tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:42.944695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-98f78a19-2f5b-45b8-8a94-091d5b556add tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:42.962667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98f78a19-2f5b-45b8-8a94-091d5b556add tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:42.963282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98f78a19-2f5b-45b8-8a94-091d5b556add tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:42.963948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98f78a19-2f5b-45b8-8a94-091d5b556add tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:42.964908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98f78a19-2f5b-45b8-8a94-091d5b556add tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:42.966220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98f78a19-2f5b-45b8-8a94-091d5b556add tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:42.967335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-98f78a19-2f5b-45b8-8a94-091d5b556add tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:43.134216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-8c54fd89-98e4-4d75-8908-b6ba94d606af req-10fd8643-69ea-4fa0-87ba-8f840480bb89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598c5040-751c-4914-906d-031f0abe36aa", "name": "network-vif-deleted", "tag": "bdbf7cbc-ecbc-4cba-98a8-1e7f94e21fbc"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:22:43.168985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-8c54fd89-98e4-4d75-8908-b6ba94d606af req-10fd8643-69ea-4fa0-87ba-8f840480bb89 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:43.171209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-8c54fd89-98e4-4d75-8908-b6ba94d606af req-10fd8643-69ea-4fa0-87ba-8f840480bb89 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:43.174969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-8c54fd89-98e4-4d75-8908-b6ba94d606af req-10fd8643-69ea-4fa0-87ba-8f840480bb89 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:43.206075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-8c54fd89-98e4-4d75-8908-b6ba94d606af req-10fd8643-69ea-4fa0-87ba-8f840480bb89 service nova] Creating event network-vif-deleted:bdbf7cbc-ecbc-4cba-98a8-1e7f94e21fbc for instance 598c5040-751c-4914-906d-031f0abe36aa on hv-cinder-85426 Aug 24 05:22:43.219697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-8c54fd89-98e4-4d75-8908-b6ba94d606af req-10fd8643-69ea-4fa0-87ba-8f840480bb89 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195867 Aug 24 05:22:43.223768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1111/2113] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:22:43.345295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-98f78a19-2f5b-45b8-8a94-091d5b556add tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:43.355735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-98f78a19-2f5b-45b8-8a94-091d5b556add tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1651 microversion: 2.1 time: 0.417841 Aug 24 05:22:43.356464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1003/2114] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1651 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:43.757480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9fab1ec0-ea07-436c-b3a3-6ff3d270da74 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:43.758332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9fab1ec0-ea07-436c-b3a3-6ff3d270da74 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:43.765212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fab1ec0-ea07-436c-b3a3-6ff3d270da74 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:43.765697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fab1ec0-ea07-436c-b3a3-6ff3d270da74 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:43.766136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fab1ec0-ea07-436c-b3a3-6ff3d270da74 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:43.766889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fab1ec0-ea07-436c-b3a3-6ff3d270da74 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:43.767635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fab1ec0-ea07-436c-b3a3-6ff3d270da74 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:43.768063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fab1ec0-ea07-436c-b3a3-6ff3d270da74 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:43.846063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-59016b6f-327d-4f7e-88f4-ea105fe56dad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:43.847245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9fab1ec0-ea07-436c-b3a3-6ff3d270da74 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:43.847446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-59016b6f-327d-4f7e-88f4-ea105fe56dad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:43.850776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:43.862661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9fab1ec0-ea07-436c-b3a3-6ff3d270da74 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.114305 Aug 24 05:22:43.863676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1112/2115] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:43.864688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59016b6f-327d-4f7e-88f4-ea105fe56dad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:43.865371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59016b6f-327d-4f7e-88f4-ea105fe56dad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:43.865914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59016b6f-327d-4f7e-88f4-ea105fe56dad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:43.866769 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59016b6f-327d-4f7e-88f4-ea105fe56dad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:43.867483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59016b6f-327d-4f7e-88f4-ea105fe56dad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:43.868009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59016b6f-327d-4f7e-88f4-ea105fe56dad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:43.949961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-59016b6f-327d-4f7e-88f4-ea105fe56dad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:43.960776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-59016b6f-327d-4f7e-88f4-ea105fe56dad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.119999 Aug 24 05:22:43.961259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1004/2116] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:43 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:22:44.377875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0c49112b-350d-4a86-aa9b-0a6e16930cbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:44.378811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0c49112b-350d-4a86-aa9b-0a6e16930cbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:44.386416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c49112b-350d-4a86-aa9b-0a6e16930cbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:44.386935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c49112b-350d-4a86-aa9b-0a6e16930cbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:44.387558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c49112b-350d-4a86-aa9b-0a6e16930cbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:44.388422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c49112b-350d-4a86-aa9b-0a6e16930cbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:44.388867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c49112b-350d-4a86-aa9b-0a6e16930cbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:44.389429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0c49112b-350d-4a86-aa9b-0a6e16930cbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:44.464205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0c49112b-350d-4a86-aa9b-0a6e16930cbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:44.473592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0c49112b-350d-4a86-aa9b-0a6e16930cbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.099560 Aug 24 05:22:44.474187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1113/2117] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:44.884999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-632040c4-538d-4c3c-832f-06dd6e8b3209 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:44.885605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-632040c4-538d-4c3c-832f-06dd6e8b3209 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:44.892296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-632040c4-538d-4c3c-832f-06dd6e8b3209 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:44.892774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-632040c4-538d-4c3c-832f-06dd6e8b3209 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:44.893204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-632040c4-538d-4c3c-832f-06dd6e8b3209 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:44.893893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-632040c4-538d-4c3c-832f-06dd6e8b3209 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:44.895058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-632040c4-538d-4c3c-832f-06dd6e8b3209 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:44.895658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-632040c4-538d-4c3c-832f-06dd6e8b3209 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:44.969472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-632040c4-538d-4c3c-832f-06dd6e8b3209 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:44.978774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-632040c4-538d-4c3c-832f-06dd6e8b3209 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.097633 Aug 24 05:22:44.979354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1005/2118] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:44.989587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c347529d-55a0-4577-acf9-1727c71918e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:44.990110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c347529d-55a0-4577-acf9-1727c71918e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:44.996273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c347529d-55a0-4577-acf9-1727c71918e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:44.996760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c347529d-55a0-4577-acf9-1727c71918e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:44.997193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c347529d-55a0-4577-acf9-1727c71918e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:44.997886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c347529d-55a0-4577-acf9-1727c71918e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:44.998334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c347529d-55a0-4577-acf9-1727c71918e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:44.998783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c347529d-55a0-4577-acf9-1727c71918e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:45.063671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c347529d-55a0-4577-acf9-1727c71918e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:45.072495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c347529d-55a0-4577-acf9-1727c71918e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087467 Aug 24 05:22:45.073070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1114/2119] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:45.236498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-429681e0-efab-429c-9847-49c76ed83c46 req-bd276940-f0d6-443a-b0cd-35ba3eefd598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "246c7f17-b6b8-470f-aa27-f23cac6e0df5", "name": "network-vif-deleted", "tag": "0cfe0fe5-d04b-4a23-8aaa-9d12f5721acd"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:22:45.248614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-429681e0-efab-429c-9847-49c76ed83c46 req-bd276940-f0d6-443a-b0cd-35ba3eefd598 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:45.248997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-429681e0-efab-429c-9847-49c76ed83c46 req-bd276940-f0d6-443a-b0cd-35ba3eefd598 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:45.249426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-429681e0-efab-429c-9847-49c76ed83c46 req-bd276940-f0d6-443a-b0cd-35ba3eefd598 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:45.263835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-429681e0-efab-429c-9847-49c76ed83c46 req-bd276940-f0d6-443a-b0cd-35ba3eefd598 service nova] Creating event network-vif-deleted:0cfe0fe5-d04b-4a23-8aaa-9d12f5721acd for instance 246c7f17-b6b8-470f-aa27-f23cac6e0df5 on hv-cinder-85426 Aug 24 05:22:45.269008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-429681e0-efab-429c-9847-49c76ed83c46 req-bd276940-f0d6-443a-b0cd-35ba3eefd598 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036252 Aug 24 05:22:45.270325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1006/2120] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:22:45.497468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2e12cdcb-f182-4076-8180-536dd3b4c71a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:45.498106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2e12cdcb-f182-4076-8180-536dd3b4c71a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:45.504916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e12cdcb-f182-4076-8180-536dd3b4c71a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:45.505420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e12cdcb-f182-4076-8180-536dd3b4c71a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:45.505858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e12cdcb-f182-4076-8180-536dd3b4c71a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:45.506554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e12cdcb-f182-4076-8180-536dd3b4c71a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:45.508684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e12cdcb-f182-4076-8180-536dd3b4c71a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:45.508684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e12cdcb-f182-4076-8180-536dd3b4c71a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:45.571442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2e12cdcb-f182-4076-8180-536dd3b4c71a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:45.580058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2e12cdcb-f182-4076-8180-536dd3b4c71a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086408 Aug 24 05:22:45.580623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1115/2121] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:46.003055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cfc1c05a-338a-4024-a94a-6c3095ea2a76 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:46.004618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cfc1c05a-338a-4024-a94a-6c3095ea2a76 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:46.010659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfc1c05a-338a-4024-a94a-6c3095ea2a76 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:46.011184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfc1c05a-338a-4024-a94a-6c3095ea2a76 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:46.011617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfc1c05a-338a-4024-a94a-6c3095ea2a76 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:46.012307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfc1c05a-338a-4024-a94a-6c3095ea2a76 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:46.012760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfc1c05a-338a-4024-a94a-6c3095ea2a76 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:46.013175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfc1c05a-338a-4024-a94a-6c3095ea2a76 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:46.078537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cfc1c05a-338a-4024-a94a-6c3095ea2a76 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:46.087314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cfc1c05a-338a-4024-a94a-6c3095ea2a76 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089689 Aug 24 05:22:46.087887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1007/2122] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:46.093330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-12db2888-61ef-4489-8483-fe03fa5b1279 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:46.093930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-12db2888-61ef-4489-8483-fe03fa5b1279 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:46.100582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12db2888-61ef-4489-8483-fe03fa5b1279 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:46.101080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12db2888-61ef-4489-8483-fe03fa5b1279 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:46.101508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12db2888-61ef-4489-8483-fe03fa5b1279 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:46.102184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12db2888-61ef-4489-8483-fe03fa5b1279 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:46.102624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12db2888-61ef-4489-8483-fe03fa5b1279 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:46.103060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12db2888-61ef-4489-8483-fe03fa5b1279 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:46.166316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-12db2888-61ef-4489-8483-fe03fa5b1279 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:46.168676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:46.176609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-12db2888-61ef-4489-8483-fe03fa5b1279 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086454 Aug 24 05:22:46.177189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1116/2123] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:46.610175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2c8863eb-72dd-40e4-869c-622fa1f199ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:46.610855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2c8863eb-72dd-40e4-869c-622fa1f199ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:46.617430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c8863eb-72dd-40e4-869c-622fa1f199ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:46.617912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c8863eb-72dd-40e4-869c-622fa1f199ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:46.618344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c8863eb-72dd-40e4-869c-622fa1f199ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:46.619073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c8863eb-72dd-40e4-869c-622fa1f199ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:46.619518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c8863eb-72dd-40e4-869c-622fa1f199ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:46.620265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c8863eb-72dd-40e4-869c-622fa1f199ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:46.692079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2c8863eb-72dd-40e4-869c-622fa1f199ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:46.700582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2c8863eb-72dd-40e4-869c-622fa1f199ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.098534 Aug 24 05:22:46.701160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1008/2124] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:47.109053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-52c34bfe-b6d8-48b6-ab1d-4105e4aa1157 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:47.109634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-52c34bfe-b6d8-48b6-ab1d-4105e4aa1157 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:47.117489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c34bfe-b6d8-48b6-ab1d-4105e4aa1157 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:47.117965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c34bfe-b6d8-48b6-ab1d-4105e4aa1157 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:47.118391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c34bfe-b6d8-48b6-ab1d-4105e4aa1157 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:47.119122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c34bfe-b6d8-48b6-ab1d-4105e4aa1157 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:47.119563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c34bfe-b6d8-48b6-ab1d-4105e4aa1157 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:47.119970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c34bfe-b6d8-48b6-ab1d-4105e4aa1157 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:47.187372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-52c34bfe-b6d8-48b6-ab1d-4105e4aa1157 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:47.196608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-52c34bfe-b6d8-48b6-ab1d-4105e4aa1157 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091462 Aug 24 05:22:47.197175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1117/2125] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:47.197855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a7e7e635-0d40-4004-903b-eb5dc05626a4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:47.199039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a7e7e635-0d40-4004-903b-eb5dc05626a4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:47.205768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7e7e635-0d40-4004-903b-eb5dc05626a4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:47.206296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7e7e635-0d40-4004-903b-eb5dc05626a4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:47.206681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7e7e635-0d40-4004-903b-eb5dc05626a4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:47.208082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7e7e635-0d40-4004-903b-eb5dc05626a4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:47.208502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7e7e635-0d40-4004-903b-eb5dc05626a4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:47.208923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7e7e635-0d40-4004-903b-eb5dc05626a4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:47.273986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a7e7e635-0d40-4004-903b-eb5dc05626a4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:47.282369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a7e7e635-0d40-4004-903b-eb5dc05626a4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088250 Aug 24 05:22:47.282980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1009/2126] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:22:47.723329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-52c3159e-8879-41d6-b05a-450d678904fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:47.723981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-52c3159e-8879-41d6-b05a-450d678904fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:47.730134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c3159e-8879-41d6-b05a-450d678904fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:47.730619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c3159e-8879-41d6-b05a-450d678904fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:47.731090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c3159e-8879-41d6-b05a-450d678904fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:47.731794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c3159e-8879-41d6-b05a-450d678904fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:47.732246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c3159e-8879-41d6-b05a-450d678904fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:47.732670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52c3159e-8879-41d6-b05a-450d678904fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:47.808718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-52c3159e-8879-41d6-b05a-450d678904fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:47.819322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-52c3159e-8879-41d6-b05a-450d678904fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.099621 Aug 24 05:22:47.820258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1118/2127] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:48.218147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-529b38d1-7714-4993-b9d8-304693bc79e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:48.219416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-529b38d1-7714-4993-b9d8-304693bc79e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:48.227004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-529b38d1-7714-4993-b9d8-304693bc79e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:48.227493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-529b38d1-7714-4993-b9d8-304693bc79e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:48.228116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-529b38d1-7714-4993-b9d8-304693bc79e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:48.228816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-529b38d1-7714-4993-b9d8-304693bc79e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:48.229271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-529b38d1-7714-4993-b9d8-304693bc79e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:48.229695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-529b38d1-7714-4993-b9d8-304693bc79e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:48.298494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-529b38d1-7714-4993-b9d8-304693bc79e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:48.307561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4efc2b1d-739a-4ccd-a3a0-4ef46b08d44b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:48.308127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-529b38d1-7714-4993-b9d8-304693bc79e6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093529 Aug 24 05:22:48.308362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4efc2b1d-739a-4ccd-a3a0-4ef46b08d44b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:48.308472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1010/2128] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:48.317743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4efc2b1d-739a-4ccd-a3a0-4ef46b08d44b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:48.318511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4efc2b1d-739a-4ccd-a3a0-4ef46b08d44b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:48.319248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4efc2b1d-739a-4ccd-a3a0-4ef46b08d44b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:48.320334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4efc2b1d-739a-4ccd-a3a0-4ef46b08d44b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:48.321075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4efc2b1d-739a-4ccd-a3a0-4ef46b08d44b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:48.321743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4efc2b1d-739a-4ccd-a3a0-4ef46b08d44b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:48.387120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4efc2b1d-739a-4ccd-a3a0-4ef46b08d44b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:48.395984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4efc2b1d-739a-4ccd-a3a0-4ef46b08d44b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.095116 Aug 24 05:22:48.396558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1119/2129] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:48.709982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:22:48.710210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:22:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:22:48.841695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-15594ae0-db6f-4a8b-abfc-2a4ddb0273c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:48.842326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-15594ae0-db6f-4a8b-abfc-2a4ddb0273c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:48.849094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15594ae0-db6f-4a8b-abfc-2a4ddb0273c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:48.849575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15594ae0-db6f-4a8b-abfc-2a4ddb0273c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:48.850011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15594ae0-db6f-4a8b-abfc-2a4ddb0273c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:48.850737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15594ae0-db6f-4a8b-abfc-2a4ddb0273c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:48.851196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15594ae0-db6f-4a8b-abfc-2a4ddb0273c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:48.851620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15594ae0-db6f-4a8b-abfc-2a4ddb0273c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:48.915920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-15594ae0-db6f-4a8b-abfc-2a4ddb0273c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:48.924217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-15594ae0-db6f-4a8b-abfc-2a4ddb0273c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086595 Aug 24 05:22:48.924774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1011/2130] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:49.328352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6088d7c1-2008-4b41-87a3-8db4abd42f43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:49.328964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6088d7c1-2008-4b41-87a3-8db4abd42f43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:49.336840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6088d7c1-2008-4b41-87a3-8db4abd42f43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:49.337320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6088d7c1-2008-4b41-87a3-8db4abd42f43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:49.337756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6088d7c1-2008-4b41-87a3-8db4abd42f43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:49.338446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6088d7c1-2008-4b41-87a3-8db4abd42f43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:49.338926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6088d7c1-2008-4b41-87a3-8db4abd42f43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:49.339349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6088d7c1-2008-4b41-87a3-8db4abd42f43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:49.404190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6088d7c1-2008-4b41-87a3-8db4abd42f43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:49.413431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6088d7c1-2008-4b41-87a3-8db4abd42f43 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088885 Aug 24 05:22:49.414000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1120/2131] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:49.416522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dd24f3d8-d2a3-4453-8b44-625b7bd75af4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:49.417140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dd24f3d8-d2a3-4453-8b44-625b7bd75af4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:49.423587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd24f3d8-d2a3-4453-8b44-625b7bd75af4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:49.424068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd24f3d8-d2a3-4453-8b44-625b7bd75af4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:49.424497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd24f3d8-d2a3-4453-8b44-625b7bd75af4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:49.425183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd24f3d8-d2a3-4453-8b44-625b7bd75af4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:49.425680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd24f3d8-d2a3-4453-8b44-625b7bd75af4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:49.426235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd24f3d8-d2a3-4453-8b44-625b7bd75af4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:49.491828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dd24f3d8-d2a3-4453-8b44-625b7bd75af4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:49.505696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dd24f3d8-d2a3-4453-8b44-625b7bd75af4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092978 Aug 24 05:22:49.506277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1012/2132] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:22:49.946233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6346fca8-12ab-41bc-a8fb-8ef753cf8c18 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:49.946893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6346fca8-12ab-41bc-a8fb-8ef753cf8c18 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:49.948797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:49.954048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6346fca8-12ab-41bc-a8fb-8ef753cf8c18 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:49.954530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6346fca8-12ab-41bc-a8fb-8ef753cf8c18 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:49.954989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6346fca8-12ab-41bc-a8fb-8ef753cf8c18 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:49.955706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6346fca8-12ab-41bc-a8fb-8ef753cf8c18 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:49.956155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6346fca8-12ab-41bc-a8fb-8ef753cf8c18 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:49.956572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6346fca8-12ab-41bc-a8fb-8ef753cf8c18 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:50.031272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6346fca8-12ab-41bc-a8fb-8ef753cf8c18 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:50.042461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6346fca8-12ab-41bc-a8fb-8ef753cf8c18 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.100287 Aug 24 05:22:50.043081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1121/2133] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:50.434297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f85c66f9-5030-403d-968c-0d84bec204b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:50.434940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f85c66f9-5030-403d-968c-0d84bec204b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:50.442307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85c66f9-5030-403d-968c-0d84bec204b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:50.442818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85c66f9-5030-403d-968c-0d84bec204b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:50.443256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85c66f9-5030-403d-968c-0d84bec204b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:50.443952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85c66f9-5030-403d-968c-0d84bec204b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:50.444494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85c66f9-5030-403d-968c-0d84bec204b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:50.444967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f85c66f9-5030-403d-968c-0d84bec204b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:50.509230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f85c66f9-5030-403d-968c-0d84bec204b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:50.517513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f85c66f9-5030-403d-968c-0d84bec204b5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086959 Aug 24 05:22:50.518081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1013/2134] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:50.526611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-24686d67-29a7-4e3d-ae79-435430d698f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:50.527265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-24686d67-29a7-4e3d-ae79-435430d698f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:50.533930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24686d67-29a7-4e3d-ae79-435430d698f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:50.534413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24686d67-29a7-4e3d-ae79-435430d698f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:50.535460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24686d67-29a7-4e3d-ae79-435430d698f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:50.536259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24686d67-29a7-4e3d-ae79-435430d698f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:50.536714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24686d67-29a7-4e3d-ae79-435430d698f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:50.537149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24686d67-29a7-4e3d-ae79-435430d698f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:50.607853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-24686d67-29a7-4e3d-ae79-435430d698f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:50.616779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-24686d67-29a7-4e3d-ae79-435430d698f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093573 Aug 24 05:22:50.616983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1122/2135] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:51.064542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-59a49b98-6cb1-4ef8-81ec-fcfc11283bc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:51.079648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-59a49b98-6cb1-4ef8-81ec-fcfc11283bc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:51.080457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59a49b98-6cb1-4ef8-81ec-fcfc11283bc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:51.080941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59a49b98-6cb1-4ef8-81ec-fcfc11283bc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:51.081373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59a49b98-6cb1-4ef8-81ec-fcfc11283bc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:51.082573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59a49b98-6cb1-4ef8-81ec-fcfc11283bc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:51.083160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59a49b98-6cb1-4ef8-81ec-fcfc11283bc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:51.083572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59a49b98-6cb1-4ef8-81ec-fcfc11283bc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:51.153322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-59a49b98-6cb1-4ef8-81ec-fcfc11283bc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:51.162031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-59a49b98-6cb1-4ef8-81ec-fcfc11283bc8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.101528 Aug 24 05:22:51.162602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1014/2136] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:51.540245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1fab9c0c-3532-4317-904b-d7444ac8f554 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:51.540862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1fab9c0c-3532-4317-904b-d7444ac8f554 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:51.547501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fab9c0c-3532-4317-904b-d7444ac8f554 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:51.547985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fab9c0c-3532-4317-904b-d7444ac8f554 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:51.548420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fab9c0c-3532-4317-904b-d7444ac8f554 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:51.549106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fab9c0c-3532-4317-904b-d7444ac8f554 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:51.549555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fab9c0c-3532-4317-904b-d7444ac8f554 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:51.549978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fab9c0c-3532-4317-904b-d7444ac8f554 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:51.615294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1fab9c0c-3532-4317-904b-d7444ac8f554 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:51.624564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1fab9c0c-3532-4317-904b-d7444ac8f554 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088248 Aug 24 05:22:51.625138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1123/2137] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:51.637110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ff788ea8-a3e2-4042-9c4d-07edef08dd27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:51.637809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ff788ea8-a3e2-4042-9c4d-07edef08dd27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:51.644425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff788ea8-a3e2-4042-9c4d-07edef08dd27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:51.644938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff788ea8-a3e2-4042-9c4d-07edef08dd27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:51.645440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff788ea8-a3e2-4042-9c4d-07edef08dd27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:51.646146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff788ea8-a3e2-4042-9c4d-07edef08dd27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:51.646601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff788ea8-a3e2-4042-9c4d-07edef08dd27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:51.647064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff788ea8-a3e2-4042-9c4d-07edef08dd27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:51.649916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:51.712214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ff788ea8-a3e2-4042-9c4d-07edef08dd27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:51.721041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ff788ea8-a3e2-4042-9c4d-07edef08dd27 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087801 Aug 24 05:22:51.721603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1015/2138] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:52.183412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2a3851d6-b4f5-4420-a310-21df8ec3c3cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:52.184018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2a3851d6-b4f5-4420-a310-21df8ec3c3cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:52.189974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a3851d6-b4f5-4420-a310-21df8ec3c3cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:52.190450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a3851d6-b4f5-4420-a310-21df8ec3c3cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:52.190913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a3851d6-b4f5-4420-a310-21df8ec3c3cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:52.192118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a3851d6-b4f5-4420-a310-21df8ec3c3cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:52.192757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a3851d6-b4f5-4420-a310-21df8ec3c3cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:52.193176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a3851d6-b4f5-4420-a310-21df8ec3c3cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:52.257133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2a3851d6-b4f5-4420-a310-21df8ec3c3cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:52.265503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2a3851d6-b4f5-4420-a310-21df8ec3c3cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086170 Aug 24 05:22:52.266074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1124/2139] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:52.645882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bc3ee79f-770e-41b8-8d0c-363dd3b442be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:52.646791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bc3ee79f-770e-41b8-8d0c-363dd3b442be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:52.654462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3ee79f-770e-41b8-8d0c-363dd3b442be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:52.654965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3ee79f-770e-41b8-8d0c-363dd3b442be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:52.655406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3ee79f-770e-41b8-8d0c-363dd3b442be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:52.656110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3ee79f-770e-41b8-8d0c-363dd3b442be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:52.656563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3ee79f-770e-41b8-8d0c-363dd3b442be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:52.656996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3ee79f-770e-41b8-8d0c-363dd3b442be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:52.724472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bc3ee79f-770e-41b8-8d0c-363dd3b442be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:52.734194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bc3ee79f-770e-41b8-8d0c-363dd3b442be tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092514 Aug 24 05:22:52.734820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1016/2140] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:52.746488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f10687fc-60ac-46d6-a9fd-abc571bd6b9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:52.747153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f10687fc-60ac-46d6-a9fd-abc571bd6b9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:52.753216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f10687fc-60ac-46d6-a9fd-abc571bd6b9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:52.754324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f10687fc-60ac-46d6-a9fd-abc571bd6b9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:52.754789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f10687fc-60ac-46d6-a9fd-abc571bd6b9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:52.755482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f10687fc-60ac-46d6-a9fd-abc571bd6b9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:52.755931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f10687fc-60ac-46d6-a9fd-abc571bd6b9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:52.756349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f10687fc-60ac-46d6-a9fd-abc571bd6b9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:52.825272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f10687fc-60ac-46d6-a9fd-abc571bd6b9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:52.834274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f10687fc-60ac-46d6-a9fd-abc571bd6b9e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094156 Aug 24 05:22:52.834887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1125/2141] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:22:53.287765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-62a8b4cb-34ff-42bd-927f-528d304b2004 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:53.288374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-62a8b4cb-34ff-42bd-927f-528d304b2004 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:53.294562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a8b4cb-34ff-42bd-927f-528d304b2004 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:53.295071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a8b4cb-34ff-42bd-927f-528d304b2004 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:53.295504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a8b4cb-34ff-42bd-927f-528d304b2004 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:53.296194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a8b4cb-34ff-42bd-927f-528d304b2004 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:53.296643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a8b4cb-34ff-42bd-927f-528d304b2004 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:53.297065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-62a8b4cb-34ff-42bd-927f-528d304b2004 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:53.370309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-62a8b4cb-34ff-42bd-927f-528d304b2004 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:53.378757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-62a8b4cb-34ff-42bd-927f-528d304b2004 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.095307 Aug 24 05:22:53.379339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1017/2142] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:53.756404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8f7cedba-d4bc-4e85-a6cc-aaa91e0b5b71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:53.757050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8f7cedba-d4bc-4e85-a6cc-aaa91e0b5b71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:53.763817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f7cedba-d4bc-4e85-a6cc-aaa91e0b5b71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:53.764334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f7cedba-d4bc-4e85-a6cc-aaa91e0b5b71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:53.764772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f7cedba-d4bc-4e85-a6cc-aaa91e0b5b71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:53.765471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f7cedba-d4bc-4e85-a6cc-aaa91e0b5b71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:53.765918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f7cedba-d4bc-4e85-a6cc-aaa91e0b5b71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:53.766338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8f7cedba-d4bc-4e85-a6cc-aaa91e0b5b71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:53.830374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8f7cedba-d4bc-4e85-a6cc-aaa91e0b5b71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:53.839238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8f7cedba-d4bc-4e85-a6cc-aaa91e0b5b71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087268 Aug 24 05:22:53.839814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1126/2143] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:22:53.854907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7b7acc87-f28a-4bcc-bfbe-395d3d64287d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:53.855542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7b7acc87-f28a-4bcc-bfbe-395d3d64287d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:53.862050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7acc87-f28a-4bcc-bfbe-395d3d64287d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:53.862526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7acc87-f28a-4bcc-bfbe-395d3d64287d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:53.863755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7acc87-f28a-4bcc-bfbe-395d3d64287d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:53.864453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7acc87-f28a-4bcc-bfbe-395d3d64287d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:53.864901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7acc87-f28a-4bcc-bfbe-395d3d64287d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:53.865316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7acc87-f28a-4bcc-bfbe-395d3d64287d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:53.932109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7b7acc87-f28a-4bcc-bfbe-395d3d64287d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:53.940527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7b7acc87-f28a-4bcc-bfbe-395d3d64287d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089601 Aug 24 05:22:53.941197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1018/2144] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:54.400084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-333fdeb6-414a-460a-b44b-b300e4d12054 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:54.400700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-333fdeb6-414a-460a-b44b-b300e4d12054 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:54.406843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-333fdeb6-414a-460a-b44b-b300e4d12054 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:54.407329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-333fdeb6-414a-460a-b44b-b300e4d12054 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:54.407769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-333fdeb6-414a-460a-b44b-b300e4d12054 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:54.408465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-333fdeb6-414a-460a-b44b-b300e4d12054 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:54.408916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-333fdeb6-414a-460a-b44b-b300e4d12054 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:54.409335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-333fdeb6-414a-460a-b44b-b300e4d12054 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:54.473953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-333fdeb6-414a-460a-b44b-b300e4d12054 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:54.482428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-333fdeb6-414a-460a-b44b-b300e4d12054 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086307 Aug 24 05:22:54.483043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1127/2145] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:54.861431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8256b08-2d27-47f8-92be-62c75f7b075f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:54.862073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c8256b08-2d27-47f8-92be-62c75f7b075f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:54.869989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8256b08-2d27-47f8-92be-62c75f7b075f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:54.870478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8256b08-2d27-47f8-92be-62c75f7b075f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:54.870945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8256b08-2d27-47f8-92be-62c75f7b075f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:54.871648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8256b08-2d27-47f8-92be-62c75f7b075f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:54.872105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8256b08-2d27-47f8-92be-62c75f7b075f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:54.872525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8256b08-2d27-47f8-92be-62c75f7b075f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:54.937138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c8256b08-2d27-47f8-92be-62c75f7b075f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:54.946301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c8256b08-2d27-47f8-92be-62c75f7b075f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088773 Aug 24 05:22:54.947261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1019/2146] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:54.961272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5f5cfb51-8dcc-429a-b607-6f681c9aecc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:54.961888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5f5cfb51-8dcc-429a-b607-6f681c9aecc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:54.968450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5cfb51-8dcc-429a-b607-6f681c9aecc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:54.968929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5cfb51-8dcc-429a-b607-6f681c9aecc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:54.969365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5cfb51-8dcc-429a-b607-6f681c9aecc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:54.970178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5cfb51-8dcc-429a-b607-6f681c9aecc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:54.970623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5cfb51-8dcc-429a-b607-6f681c9aecc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:54.971068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5cfb51-8dcc-429a-b607-6f681c9aecc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:55.036783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5f5cfb51-8dcc-429a-b607-6f681c9aecc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:55.047166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5f5cfb51-8dcc-429a-b607-6f681c9aecc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089653 Aug 24 05:22:55.047750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1128/2147] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:55.503801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-53d6d2fe-ebcd-4799-bb14-9981bef46a14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:55.504426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-53d6d2fe-ebcd-4799-bb14-9981bef46a14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:55.513457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53d6d2fe-ebcd-4799-bb14-9981bef46a14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:55.514201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53d6d2fe-ebcd-4799-bb14-9981bef46a14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:55.514975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53d6d2fe-ebcd-4799-bb14-9981bef46a14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:55.516124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53d6d2fe-ebcd-4799-bb14-9981bef46a14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:55.516842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53d6d2fe-ebcd-4799-bb14-9981bef46a14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:55.517446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53d6d2fe-ebcd-4799-bb14-9981bef46a14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:55.587831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-53d6d2fe-ebcd-4799-bb14-9981bef46a14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:55.596219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-53d6d2fe-ebcd-4799-bb14-9981bef46a14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.096313 Aug 24 05:22:55.596789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1020/2148] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:22:55.967646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-36baf980-c858-43da-946f-26670340d681 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:55.968453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-36baf980-c858-43da-946f-26670340d681 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:55.975716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36baf980-c858-43da-946f-26670340d681 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:55.976192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36baf980-c858-43da-946f-26670340d681 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:55.976632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36baf980-c858-43da-946f-26670340d681 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:55.977321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36baf980-c858-43da-946f-26670340d681 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:55.977768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36baf980-c858-43da-946f-26670340d681 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:55.978186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36baf980-c858-43da-946f-26670340d681 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:56.047629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-36baf980-c858-43da-946f-26670340d681 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:56.057584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-36baf980-c858-43da-946f-26670340d681 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093789 Aug 24 05:22:56.058190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1129/2149] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:56.069118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0fd8aca7-19d2-4263-9d45-ef970d95d594 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:56.069807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0fd8aca7-19d2-4263-9d45-ef970d95d594 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:56.077290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fd8aca7-19d2-4263-9d45-ef970d95d594 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:56.077920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fd8aca7-19d2-4263-9d45-ef970d95d594 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:56.078405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fd8aca7-19d2-4263-9d45-ef970d95d594 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:56.079275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fd8aca7-19d2-4263-9d45-ef970d95d594 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:56.079770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fd8aca7-19d2-4263-9d45-ef970d95d594 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:56.080228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fd8aca7-19d2-4263-9d45-ef970d95d594 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:56.145954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0fd8aca7-19d2-4263-9d45-ef970d95d594 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:56.154781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0fd8aca7-19d2-4263-9d45-ef970d95d594 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090529 Aug 24 05:22:56.155366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1021/2150] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:56.618646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-88aee9c0-d75f-417e-b940-cd1f4ed89134 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:56.619311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-88aee9c0-d75f-417e-b940-cd1f4ed89134 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:56.625663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88aee9c0-d75f-417e-b940-cd1f4ed89134 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:56.626145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88aee9c0-d75f-417e-b940-cd1f4ed89134 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:56.626579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88aee9c0-d75f-417e-b940-cd1f4ed89134 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:56.627309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88aee9c0-d75f-417e-b940-cd1f4ed89134 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:56.627761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88aee9c0-d75f-417e-b940-cd1f4ed89134 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:56.628182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88aee9c0-d75f-417e-b940-cd1f4ed89134 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:56.692981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-88aee9c0-d75f-417e-b940-cd1f4ed89134 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:56.701374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-88aee9c0-d75f-417e-b940-cd1f4ed89134 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086547 Aug 24 05:22:56.701954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1130/2151] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:57.079460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1a379e6b-c437-4608-9968-af1e40ba4bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:57.080078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1a379e6b-c437-4608-9968-af1e40ba4bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:57.087484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a379e6b-c437-4608-9968-af1e40ba4bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:57.087992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a379e6b-c437-4608-9968-af1e40ba4bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:57.088419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a379e6b-c437-4608-9968-af1e40ba4bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:57.089109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a379e6b-c437-4608-9968-af1e40ba4bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:57.089552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a379e6b-c437-4608-9968-af1e40ba4bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:57.089968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1a379e6b-c437-4608-9968-af1e40ba4bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:57.158398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1a379e6b-c437-4608-9968-af1e40ba4bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:57.168201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1a379e6b-c437-4608-9968-af1e40ba4bd9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092507 Aug 24 05:22:57.168792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1022/2152] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:57.176117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a6e8c4cb-95e3-4e06-95ca-729c4583d8eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:57.176959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a6e8c4cb-95e3-4e06-95ca-729c4583d8eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:57.183646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6e8c4cb-95e3-4e06-95ca-729c4583d8eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:57.184126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6e8c4cb-95e3-4e06-95ca-729c4583d8eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:57.184558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6e8c4cb-95e3-4e06-95ca-729c4583d8eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:57.185243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6e8c4cb-95e3-4e06-95ca-729c4583d8eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:57.185689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6e8c4cb-95e3-4e06-95ca-729c4583d8eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:57.186108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a6e8c4cb-95e3-4e06-95ca-729c4583d8eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:57.250197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a6e8c4cb-95e3-4e06-95ca-729c4583d8eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:57.259567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a6e8c4cb-95e3-4e06-95ca-729c4583d8eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087785 Aug 24 05:22:57.260143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1131/2153] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:57.728865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b07ae19a-d188-4df0-a6a4-abe27cdb0e85 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:57.729473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b07ae19a-d188-4df0-a6a4-abe27cdb0e85 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:57.735734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b07ae19a-d188-4df0-a6a4-abe27cdb0e85 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:57.736853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b07ae19a-d188-4df0-a6a4-abe27cdb0e85 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:57.737293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b07ae19a-d188-4df0-a6a4-abe27cdb0e85 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:57.738041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b07ae19a-d188-4df0-a6a4-abe27cdb0e85 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:57.738495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b07ae19a-d188-4df0-a6a4-abe27cdb0e85 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:57.738943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b07ae19a-d188-4df0-a6a4-abe27cdb0e85 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:57.805381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b07ae19a-d188-4df0-a6a4-abe27cdb0e85 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:57.816586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b07ae19a-d188-4df0-a6a4-abe27cdb0e85 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091508 Aug 24 05:22:57.817300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1023/2154] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:58.190450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-26434d5a-65a7-482b-9abc-0d9db0287388 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:58.191829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-26434d5a-65a7-482b-9abc-0d9db0287388 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:58.198570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26434d5a-65a7-482b-9abc-0d9db0287388 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:58.199083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26434d5a-65a7-482b-9abc-0d9db0287388 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:58.199521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26434d5a-65a7-482b-9abc-0d9db0287388 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:58.200214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26434d5a-65a7-482b-9abc-0d9db0287388 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:58.200666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26434d5a-65a7-482b-9abc-0d9db0287388 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:58.201089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26434d5a-65a7-482b-9abc-0d9db0287388 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:58.264312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-26434d5a-65a7-482b-9abc-0d9db0287388 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:58.272896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-26434d5a-65a7-482b-9abc-0d9db0287388 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086304 Aug 24 05:22:58.273461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1132/2155] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:58.281075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dd86997a-4522-46c8-834a-d54434bb97de tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:58.281713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dd86997a-4522-46c8-834a-d54434bb97de tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:58.289142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd86997a-4522-46c8-834a-d54434bb97de tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:58.289619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd86997a-4522-46c8-834a-d54434bb97de tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:58.290053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd86997a-4522-46c8-834a-d54434bb97de tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:58.290771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd86997a-4522-46c8-834a-d54434bb97de tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:58.291222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd86997a-4522-46c8-834a-d54434bb97de tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:58.291638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd86997a-4522-46c8-834a-d54434bb97de tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:58.355627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dd86997a-4522-46c8-834a-d54434bb97de tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:58.365089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dd86997a-4522-46c8-834a-d54434bb97de tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088017 Aug 24 05:22:58.365657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1024/2156] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:58.838291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f58ab44f-88f6-4bbb-afc4-22ea5d1b9a13 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:58.838947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f58ab44f-88f6-4bbb-afc4-22ea5d1b9a13 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:58.845001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f58ab44f-88f6-4bbb-afc4-22ea5d1b9a13 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:58.845473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f58ab44f-88f6-4bbb-afc4-22ea5d1b9a13 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:58.845899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f58ab44f-88f6-4bbb-afc4-22ea5d1b9a13 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:58.846575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f58ab44f-88f6-4bbb-afc4-22ea5d1b9a13 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:58.847068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f58ab44f-88f6-4bbb-afc4-22ea5d1b9a13 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:58.848359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f58ab44f-88f6-4bbb-afc4-22ea5d1b9a13 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:58.865578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:22:58.925259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f58ab44f-88f6-4bbb-afc4-22ea5d1b9a13 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:58.934393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f58ab44f-88f6-4bbb-afc4-22ea5d1b9a13 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.099858 Aug 24 05:22:58.935006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1133/2157] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:59.295483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d3d0d0a5-cb9c-49ee-b0d9-8a7b9f50eba7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:59.296500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d3d0d0a5-cb9c-49ee-b0d9-8a7b9f50eba7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:59.303619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3d0d0a5-cb9c-49ee-b0d9-8a7b9f50eba7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:59.304098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3d0d0a5-cb9c-49ee-b0d9-8a7b9f50eba7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:59.304529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3d0d0a5-cb9c-49ee-b0d9-8a7b9f50eba7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:59.305472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3d0d0a5-cb9c-49ee-b0d9-8a7b9f50eba7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:59.305912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3d0d0a5-cb9c-49ee-b0d9-8a7b9f50eba7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:59.306327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d3d0d0a5-cb9c-49ee-b0d9-8a7b9f50eba7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:59.370645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d3d0d0a5-cb9c-49ee-b0d9-8a7b9f50eba7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:59.380112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d3d0d0a5-cb9c-49ee-b0d9-8a7b9f50eba7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088274 Aug 24 05:22:59.380705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1025/2158] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:59.386099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9c7b217c-2b4d-4bdf-9468-51e04a425d73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:59.386731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9c7b217c-2b4d-4bdf-9468-51e04a425d73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:59.393616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c7b217c-2b4d-4bdf-9468-51e04a425d73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:59.394095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c7b217c-2b4d-4bdf-9468-51e04a425d73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:59.394532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c7b217c-2b4d-4bdf-9468-51e04a425d73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:59.395357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c7b217c-2b4d-4bdf-9468-51e04a425d73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:59.395815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c7b217c-2b4d-4bdf-9468-51e04a425d73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:59.396265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c7b217c-2b4d-4bdf-9468-51e04a425d73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:59.460605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9c7b217c-2b4d-4bdf-9468-51e04a425d73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:22:59.469971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9c7b217c-2b4d-4bdf-9468-51e04a425d73 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087675 Aug 24 05:22:59.470576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1134/2159] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:59 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:22:59.956399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a8c1dae6-fadf-4598-8398-66f8df03180b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:22:59.957619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a8c1dae6-fadf-4598-8398-66f8df03180b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:22:59.963714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8c1dae6-fadf-4598-8398-66f8df03180b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:59.964198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8c1dae6-fadf-4598-8398-66f8df03180b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:59.964630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8c1dae6-fadf-4598-8398-66f8df03180b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:22:59.965322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8c1dae6-fadf-4598-8398-66f8df03180b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:22:59.965770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8c1dae6-fadf-4598-8398-66f8df03180b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:22:59.966188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8c1dae6-fadf-4598-8398-66f8df03180b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:00.037617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a8c1dae6-fadf-4598-8398-66f8df03180b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:00.046189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a8c1dae6-fadf-4598-8398-66f8df03180b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093669 Aug 24 05:23:00.046791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1026/2160] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:22:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:00.401513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-15695a9e-19c7-407d-a981-f14599a9a246 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:00.402053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-15695a9e-19c7-407d-a981-f14599a9a246 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:00.408870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15695a9e-19c7-407d-a981-f14599a9a246 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:00.409359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15695a9e-19c7-407d-a981-f14599a9a246 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:00.410544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15695a9e-19c7-407d-a981-f14599a9a246 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:00.411340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15695a9e-19c7-407d-a981-f14599a9a246 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:00.411814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15695a9e-19c7-407d-a981-f14599a9a246 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:00.412314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15695a9e-19c7-407d-a981-f14599a9a246 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:00.483781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-15695a9e-19c7-407d-a981-f14599a9a246 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:00.492133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7e8f193e-c62f-4bf7-b97b-02555aad568a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:00.493603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7e8f193e-c62f-4bf7-b97b-02555aad568a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:00.494181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-15695a9e-19c7-407d-a981-f14599a9a246 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.096498 Aug 24 05:23:00.495212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1135/2161] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:00.501879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e8f193e-c62f-4bf7-b97b-02555aad568a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:00.502578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e8f193e-c62f-4bf7-b97b-02555aad568a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:00.504828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e8f193e-c62f-4bf7-b97b-02555aad568a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:00.506120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e8f193e-c62f-4bf7-b97b-02555aad568a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:00.508359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e8f193e-c62f-4bf7-b97b-02555aad568a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:00.509539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7e8f193e-c62f-4bf7-b97b-02555aad568a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:00.580696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7e8f193e-c62f-4bf7-b97b-02555aad568a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:00.589993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7e8f193e-c62f-4bf7-b97b-02555aad568a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.102108 Aug 24 05:23:00.590571 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1027/2162] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:01.068194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-550155be-d5eb-477a-96b3-626cea25f9cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:01.068724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-550155be-d5eb-477a-96b3-626cea25f9cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:01.074821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-550155be-d5eb-477a-96b3-626cea25f9cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:01.075299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-550155be-d5eb-477a-96b3-626cea25f9cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:01.075731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-550155be-d5eb-477a-96b3-626cea25f9cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:01.076413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-550155be-d5eb-477a-96b3-626cea25f9cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:01.076865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-550155be-d5eb-477a-96b3-626cea25f9cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:01.077290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-550155be-d5eb-477a-96b3-626cea25f9cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:01.142108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-550155be-d5eb-477a-96b3-626cea25f9cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:01.151530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-550155be-d5eb-477a-96b3-626cea25f9cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087315 Aug 24 05:23:01.152105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1136/2163] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:01.520662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2ffdb066-588a-4b04-a0a0-3597321e2fe1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:01.521328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2ffdb066-588a-4b04-a0a0-3597321e2fe1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:01.528085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ffdb066-588a-4b04-a0a0-3597321e2fe1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:01.528581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ffdb066-588a-4b04-a0a0-3597321e2fe1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:01.529025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ffdb066-588a-4b04-a0a0-3597321e2fe1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:01.529726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ffdb066-588a-4b04-a0a0-3597321e2fe1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:01.530179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ffdb066-588a-4b04-a0a0-3597321e2fe1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:01.530602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ffdb066-588a-4b04-a0a0-3597321e2fe1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:01.594015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2ffdb066-588a-4b04-a0a0-3597321e2fe1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:01.602650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2ffdb066-588a-4b04-a0a0-3597321e2fe1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086564 Aug 24 05:23:01.603276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1028/2164] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:01.610579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e1ce4865-79e3-493f-bf29-2ecd7b30a49c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:01.611217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e1ce4865-79e3-493f-bf29-2ecd7b30a49c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:01.618497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1ce4865-79e3-493f-bf29-2ecd7b30a49c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:01.619010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1ce4865-79e3-493f-bf29-2ecd7b30a49c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:01.619445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1ce4865-79e3-493f-bf29-2ecd7b30a49c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:01.620138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1ce4865-79e3-493f-bf29-2ecd7b30a49c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:01.620584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1ce4865-79e3-493f-bf29-2ecd7b30a49c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:01.621002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1ce4865-79e3-493f-bf29-2ecd7b30a49c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:01.689126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e1ce4865-79e3-493f-bf29-2ecd7b30a49c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:01.698513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e1ce4865-79e3-493f-bf29-2ecd7b30a49c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091658 Aug 24 05:23:01.699110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1137/2165] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:02.173540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9492d2a0-964a-43f2-89e9-81e24703e5a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:02.174156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9492d2a0-964a-43f2-89e9-81e24703e5a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:02.181270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9492d2a0-964a-43f2-89e9-81e24703e5a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:02.181756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9492d2a0-964a-43f2-89e9-81e24703e5a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:02.182193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9492d2a0-964a-43f2-89e9-81e24703e5a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:02.182931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9492d2a0-964a-43f2-89e9-81e24703e5a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:02.183374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9492d2a0-964a-43f2-89e9-81e24703e5a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:02.183795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9492d2a0-964a-43f2-89e9-81e24703e5a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:02.247198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9492d2a0-964a-43f2-89e9-81e24703e5a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:02.255839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9492d2a0-964a-43f2-89e9-81e24703e5a6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086199 Aug 24 05:23:02.256425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1029/2166] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:02.624445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b08ae03f-0588-4eed-a562-76705b030d34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:02.625071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b08ae03f-0588-4eed-a562-76705b030d34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:02.631647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b08ae03f-0588-4eed-a562-76705b030d34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:02.632129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b08ae03f-0588-4eed-a562-76705b030d34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:02.632557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b08ae03f-0588-4eed-a562-76705b030d34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:02.633241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b08ae03f-0588-4eed-a562-76705b030d34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:02.633687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b08ae03f-0588-4eed-a562-76705b030d34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:02.634102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b08ae03f-0588-4eed-a562-76705b030d34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:02.698568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b08ae03f-0588-4eed-a562-76705b030d34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:02.707757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b08ae03f-0588-4eed-a562-76705b030d34 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087184 Aug 24 05:23:02.708653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1138/2167] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:02.719546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5754f96f-2a89-4b36-b87e-a74e0839ee91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:02.720271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5754f96f-2a89-4b36-b87e-a74e0839ee91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:02.727254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5754f96f-2a89-4b36-b87e-a74e0839ee91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:02.727741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5754f96f-2a89-4b36-b87e-a74e0839ee91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:02.728180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5754f96f-2a89-4b36-b87e-a74e0839ee91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:02.728882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5754f96f-2a89-4b36-b87e-a74e0839ee91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:02.729337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5754f96f-2a89-4b36-b87e-a74e0839ee91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:02.729762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5754f96f-2a89-4b36-b87e-a74e0839ee91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:02.801338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5754f96f-2a89-4b36-b87e-a74e0839ee91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:02.810002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5754f96f-2a89-4b36-b87e-a74e0839ee91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094281 Aug 24 05:23:02.810574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1030/2168] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:03.276245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-54d0c489-b021-46b0-b167-b3e8b29df768 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:03.276848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-54d0c489-b021-46b0-b167-b3e8b29df768 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:03.282826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54d0c489-b021-46b0-b167-b3e8b29df768 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:03.283301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54d0c489-b021-46b0-b167-b3e8b29df768 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:03.283729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54d0c489-b021-46b0-b167-b3e8b29df768 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:03.284400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54d0c489-b021-46b0-b167-b3e8b29df768 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:03.285713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54d0c489-b021-46b0-b167-b3e8b29df768 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:03.286135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54d0c489-b021-46b0-b167-b3e8b29df768 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:03.349681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-54d0c489-b021-46b0-b167-b3e8b29df768 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:03.357940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-54d0c489-b021-46b0-b167-b3e8b29df768 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085563 Aug 24 05:23:03.358501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1139/2169] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:03 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:03.728618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9155ff65-198b-4128-83f4-4b1829910889 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:03.729226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9155ff65-198b-4128-83f4-4b1829910889 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:03.735974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9155ff65-198b-4128-83f4-4b1829910889 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:03.736456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9155ff65-198b-4128-83f4-4b1829910889 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:03.736887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9155ff65-198b-4128-83f4-4b1829910889 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:03.737604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9155ff65-198b-4128-83f4-4b1829910889 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:03.738194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9155ff65-198b-4128-83f4-4b1829910889 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:03.738876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9155ff65-198b-4128-83f4-4b1829910889 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:03.806623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9155ff65-198b-4128-83f4-4b1829910889 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:03.808849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:03.819230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9155ff65-198b-4128-83f4-4b1829910889 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.094347 Aug 24 05:23:03.819831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1031/2170] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:03.831227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-36b735ff-c83a-430b-86f2-fee00db8b0c9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:03.832479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-36b735ff-c83a-430b-86f2-fee00db8b0c9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:03.839311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36b735ff-c83a-430b-86f2-fee00db8b0c9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:03.839793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36b735ff-c83a-430b-86f2-fee00db8b0c9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:03.840231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36b735ff-c83a-430b-86f2-fee00db8b0c9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:03.840956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36b735ff-c83a-430b-86f2-fee00db8b0c9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:03.841409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36b735ff-c83a-430b-86f2-fee00db8b0c9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:03.841832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36b735ff-c83a-430b-86f2-fee00db8b0c9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:03.905265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-36b735ff-c83a-430b-86f2-fee00db8b0c9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:03.914329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-36b735ff-c83a-430b-86f2-fee00db8b0c9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086926 Aug 24 05:23:03.914932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1140/2171] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:03 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:04.379693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8a0dac6d-994e-43a8-9223-1aa1527a8c34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:04.380337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8a0dac6d-994e-43a8-9223-1aa1527a8c34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:04.386715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a0dac6d-994e-43a8-9223-1aa1527a8c34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:04.387218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a0dac6d-994e-43a8-9223-1aa1527a8c34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:04.387647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a0dac6d-994e-43a8-9223-1aa1527a8c34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:04.388363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a0dac6d-994e-43a8-9223-1aa1527a8c34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:04.388804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a0dac6d-994e-43a8-9223-1aa1527a8c34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:04.389215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a0dac6d-994e-43a8-9223-1aa1527a8c34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:04.458566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8a0dac6d-994e-43a8-9223-1aa1527a8c34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:04.467057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8a0dac6d-994e-43a8-9223-1aa1527a8c34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091198 Aug 24 05:23:04.467639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1032/2172] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:04.841076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-144be52f-3e07-4710-874c-004974b52c26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:04.842085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-144be52f-3e07-4710-874c-004974b52c26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:04.848653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-144be52f-3e07-4710-874c-004974b52c26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:04.849207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-144be52f-3e07-4710-874c-004974b52c26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:04.849666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-144be52f-3e07-4710-874c-004974b52c26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:04.850361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-144be52f-3e07-4710-874c-004974b52c26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:04.850857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-144be52f-3e07-4710-874c-004974b52c26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:04.851285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-144be52f-3e07-4710-874c-004974b52c26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:04.920570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-144be52f-3e07-4710-874c-004974b52c26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:04.932333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-144be52f-3e07-4710-874c-004974b52c26 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.094961 Aug 24 05:23:04.933316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1141/2173] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:04.935248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5665122e-2ab0-40b7-99f6-831817f2fac6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:04.935858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5665122e-2ab0-40b7-99f6-831817f2fac6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:04.943642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5665122e-2ab0-40b7-99f6-831817f2fac6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:04.944413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5665122e-2ab0-40b7-99f6-831817f2fac6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:04.944838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5665122e-2ab0-40b7-99f6-831817f2fac6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:04.945742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5665122e-2ab0-40b7-99f6-831817f2fac6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:04.946197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5665122e-2ab0-40b7-99f6-831817f2fac6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:04.946619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5665122e-2ab0-40b7-99f6-831817f2fac6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:05.009807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5665122e-2ab0-40b7-99f6-831817f2fac6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:05.018185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5665122e-2ab0-40b7-99f6-831817f2fac6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086808 Aug 24 05:23:05.018834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1033/2174] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:05.488932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a0aa256e-d9a3-494d-bd34-df48f864ff22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:05.489542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a0aa256e-d9a3-494d-bd34-df48f864ff22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:05.495543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a0aa256e-d9a3-494d-bd34-df48f864ff22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:05.496026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a0aa256e-d9a3-494d-bd34-df48f864ff22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:05.496461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a0aa256e-d9a3-494d-bd34-df48f864ff22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:05.497151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a0aa256e-d9a3-494d-bd34-df48f864ff22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:05.497604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a0aa256e-d9a3-494d-bd34-df48f864ff22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:05.498030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a0aa256e-d9a3-494d-bd34-df48f864ff22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:05.562972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a0aa256e-d9a3-494d-bd34-df48f864ff22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:05.571402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a0aa256e-d9a3-494d-bd34-df48f864ff22 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087063 Aug 24 05:23:05.571977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1142/2175] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:05.953418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c35633fc-9f97-4a7a-9421-4529646e853e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:05.954037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c35633fc-9f97-4a7a-9421-4529646e853e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:05.961568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c35633fc-9f97-4a7a-9421-4529646e853e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:05.962059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c35633fc-9f97-4a7a-9421-4529646e853e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:05.962528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c35633fc-9f97-4a7a-9421-4529646e853e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:05.963232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c35633fc-9f97-4a7a-9421-4529646e853e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:05.963683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c35633fc-9f97-4a7a-9421-4529646e853e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:05.964103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c35633fc-9f97-4a7a-9421-4529646e853e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:06.033141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c35633fc-9f97-4a7a-9421-4529646e853e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:06.039477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-857ce7c5-229e-4173-9fed-e1f2593767a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:06.040098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-857ce7c5-229e-4173-9fed-e1f2593767a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:06.045443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c35633fc-9f97-4a7a-9421-4529646e853e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095792 Aug 24 05:23:06.053639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1034/2176] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:06.053867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-857ce7c5-229e-4173-9fed-e1f2593767a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:06.053867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-857ce7c5-229e-4173-9fed-e1f2593767a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:06.053867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-857ce7c5-229e-4173-9fed-e1f2593767a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:06.053867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-857ce7c5-229e-4173-9fed-e1f2593767a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:06.054237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-857ce7c5-229e-4173-9fed-e1f2593767a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:06.054237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-857ce7c5-229e-4173-9fed-e1f2593767a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:06.113663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-857ce7c5-229e-4173-9fed-e1f2593767a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:06.122073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-857ce7c5-229e-4173-9fed-e1f2593767a9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086376 Aug 24 05:23:06.122658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1143/2177] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:06.592159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b54f62b8-f62b-4e80-8b5e-4965c5281f7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:06.592763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b54f62b8-f62b-4e80-8b5e-4965c5281f7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:06.599562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b54f62b8-f62b-4e80-8b5e-4965c5281f7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:06.600024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b54f62b8-f62b-4e80-8b5e-4965c5281f7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:06.600452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b54f62b8-f62b-4e80-8b5e-4965c5281f7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:06.601140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b54f62b8-f62b-4e80-8b5e-4965c5281f7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:06.601585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b54f62b8-f62b-4e80-8b5e-4965c5281f7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:06.601998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b54f62b8-f62b-4e80-8b5e-4965c5281f7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:06.672557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b54f62b8-f62b-4e80-8b5e-4965c5281f7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:06.683046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b54f62b8-f62b-4e80-8b5e-4965c5281f7f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.094739 Aug 24 05:23:06.683634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1035/2178] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:07.066830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-97efa2b6-f9c1-452e-8ac0-5f9284c99e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:07.067444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-97efa2b6-f9c1-452e-8ac0-5f9284c99e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:07.074091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-97efa2b6-f9c1-452e-8ac0-5f9284c99e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:07.074581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-97efa2b6-f9c1-452e-8ac0-5f9284c99e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:07.075047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-97efa2b6-f9c1-452e-8ac0-5f9284c99e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:07.075746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-97efa2b6-f9c1-452e-8ac0-5f9284c99e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:07.076331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-97efa2b6-f9c1-452e-8ac0-5f9284c99e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:07.076758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-97efa2b6-f9c1-452e-8ac0-5f9284c99e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:07.143970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-97efa2b6-f9c1-452e-8ac0-5f9284c99e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:07.144938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-52bcbc19-079f-4e1f-a577-afd58b74c8d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:07.145765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-52bcbc19-079f-4e1f-a577-afd58b74c8d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:07.155215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-97efa2b6-f9c1-452e-8ac0-5f9284c99e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092424 Aug 24 05:23:07.155570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52bcbc19-079f-4e1f-a577-afd58b74c8d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:07.155806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1144/2179] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:07.156068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52bcbc19-079f-4e1f-a577-afd58b74c8d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:07.156498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52bcbc19-079f-4e1f-a577-afd58b74c8d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:07.157192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52bcbc19-079f-4e1f-a577-afd58b74c8d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:07.157636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52bcbc19-079f-4e1f-a577-afd58b74c8d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:07.158048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52bcbc19-079f-4e1f-a577-afd58b74c8d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:07.226625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-52bcbc19-079f-4e1f-a577-afd58b74c8d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:07.235044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-52bcbc19-079f-4e1f-a577-afd58b74c8d0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.095605 Aug 24 05:23:07.235630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1036/2180] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:07.703963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3f05da50-e56c-4d10-938a-8fa92189f793 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:07.704573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3f05da50-e56c-4d10-938a-8fa92189f793 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:07.711390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f05da50-e56c-4d10-938a-8fa92189f793 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:07.711871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f05da50-e56c-4d10-938a-8fa92189f793 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:07.712307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f05da50-e56c-4d10-938a-8fa92189f793 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:07.713004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f05da50-e56c-4d10-938a-8fa92189f793 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:07.713457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f05da50-e56c-4d10-938a-8fa92189f793 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:07.713882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f05da50-e56c-4d10-938a-8fa92189f793 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:07.780781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3f05da50-e56c-4d10-938a-8fa92189f793 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:07.789921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3f05da50-e56c-4d10-938a-8fa92189f793 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089847 Aug 24 05:23:07.790488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1145/2181] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:08.176786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e369383e-1a76-48c2-9487-4e2cb531caec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:08.177337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e369383e-1a76-48c2-9487-4e2cb531caec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:08.184278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e369383e-1a76-48c2-9487-4e2cb531caec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:08.184758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e369383e-1a76-48c2-9487-4e2cb531caec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:08.185193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e369383e-1a76-48c2-9487-4e2cb531caec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:08.185879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e369383e-1a76-48c2-9487-4e2cb531caec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:08.186328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e369383e-1a76-48c2-9487-4e2cb531caec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:08.186777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e369383e-1a76-48c2-9487-4e2cb531caec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:08.250549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e369383e-1a76-48c2-9487-4e2cb531caec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:08.257230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-47f3bef0-7884-45d6-9682-08dc89d533fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:08.257873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-47f3bef0-7884-45d6-9682-08dc89d533fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:08.260384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e369383e-1a76-48c2-9487-4e2cb531caec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087818 Aug 24 05:23:08.261255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1037/2182] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:08.264399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47f3bef0-7884-45d6-9682-08dc89d533fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:08.264879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47f3bef0-7884-45d6-9682-08dc89d533fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:08.265317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47f3bef0-7884-45d6-9682-08dc89d533fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:08.266004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47f3bef0-7884-45d6-9682-08dc89d533fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:08.266457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47f3bef0-7884-45d6-9682-08dc89d533fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:08.266905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47f3bef0-7884-45d6-9682-08dc89d533fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:08.333011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-47f3bef0-7884-45d6-9682-08dc89d533fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:08.341410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-47f3bef0-7884-45d6-9682-08dc89d533fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088952 Aug 24 05:23:08.341983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1146/2183] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:08.811660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b40d583e-c6c9-428d-8106-b7353ee00df1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:08.812268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b40d583e-c6c9-428d-8106-b7353ee00df1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:08.819104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40d583e-c6c9-428d-8106-b7353ee00df1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:08.819591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40d583e-c6c9-428d-8106-b7353ee00df1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:08.820025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40d583e-c6c9-428d-8106-b7353ee00df1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:08.820718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40d583e-c6c9-428d-8106-b7353ee00df1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:08.821167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40d583e-c6c9-428d-8106-b7353ee00df1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:08.821588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b40d583e-c6c9-428d-8106-b7353ee00df1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:08.888873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b40d583e-c6c9-428d-8106-b7353ee00df1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:08.899664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b40d583e-c6c9-428d-8106-b7353ee00df1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091503 Aug 24 05:23:08.900659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1038/2184] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:09.282377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2a6f81a3-3f36-459c-a3da-7cd01a5166d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:09.283100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2a6f81a3-3f36-459c-a3da-7cd01a5166d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:09.289797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a6f81a3-3f36-459c-a3da-7cd01a5166d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:09.290279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a6f81a3-3f36-459c-a3da-7cd01a5166d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:09.290737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a6f81a3-3f36-459c-a3da-7cd01a5166d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:09.291433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a6f81a3-3f36-459c-a3da-7cd01a5166d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:09.291881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a6f81a3-3f36-459c-a3da-7cd01a5166d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:09.292301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2a6f81a3-3f36-459c-a3da-7cd01a5166d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:09.356819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2a6f81a3-3f36-459c-a3da-7cd01a5166d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:09.361140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d8eb9fa2-cfdf-451b-9aa5-8c60803ad60c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:09.361756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d8eb9fa2-cfdf-451b-9aa5-8c60803ad60c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:09.366059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2a6f81a3-3f36-459c-a3da-7cd01a5166d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087459 Aug 24 05:23:09.366632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1147/2185] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:09.372265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8eb9fa2-cfdf-451b-9aa5-8c60803ad60c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:09.373152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8eb9fa2-cfdf-451b-9aa5-8c60803ad60c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:09.373955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8eb9fa2-cfdf-451b-9aa5-8c60803ad60c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:09.375241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8eb9fa2-cfdf-451b-9aa5-8c60803ad60c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:09.376117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8eb9fa2-cfdf-451b-9aa5-8c60803ad60c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:09.376904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d8eb9fa2-cfdf-451b-9aa5-8c60803ad60c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:09.450255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d8eb9fa2-cfdf-451b-9aa5-8c60803ad60c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:09.458961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d8eb9fa2-cfdf-451b-9aa5-8c60803ad60c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.101558 Aug 24 05:23:09.459547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1039/2186] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:09.921188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fa8da5c0-f926-49ae-a151-67d90739dcc3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:09.921804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fa8da5c0-f926-49ae-a151-67d90739dcc3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:09.929115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8da5c0-f926-49ae-a151-67d90739dcc3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:09.929602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8da5c0-f926-49ae-a151-67d90739dcc3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:09.930300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8da5c0-f926-49ae-a151-67d90739dcc3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:09.931029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8da5c0-f926-49ae-a151-67d90739dcc3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:09.931481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8da5c0-f926-49ae-a151-67d90739dcc3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:09.931903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8da5c0-f926-49ae-a151-67d90739dcc3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:09.995946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fa8da5c0-f926-49ae-a151-67d90739dcc3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:10.005551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fa8da5c0-f926-49ae-a151-67d90739dcc3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087811 Aug 24 05:23:10.005874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1148/2187] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:10.400019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ffd1ef13-a87a-4f57-b54c-190440b747b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:10.400616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ffd1ef13-a87a-4f57-b54c-190440b747b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:10.407095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd1ef13-a87a-4f57-b54c-190440b747b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:10.407567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd1ef13-a87a-4f57-b54c-190440b747b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:10.407992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd1ef13-a87a-4f57-b54c-190440b747b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:10.408669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd1ef13-a87a-4f57-b54c-190440b747b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:10.409111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd1ef13-a87a-4f57-b54c-190440b747b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:10.409571 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ffd1ef13-a87a-4f57-b54c-190440b747b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:10.475223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ffd1ef13-a87a-4f57-b54c-190440b747b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:10.480386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-915868d7-5c72-4dde-a320-27251476dd47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:10.481117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-915868d7-5c72-4dde-a320-27251476dd47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:10.483759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ffd1ef13-a87a-4f57-b54c-190440b747b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087556 Aug 24 05:23:10.484612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1040/2188] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:10.489458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-915868d7-5c72-4dde-a320-27251476dd47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:10.489944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-915868d7-5c72-4dde-a320-27251476dd47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:10.490381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-915868d7-5c72-4dde-a320-27251476dd47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:10.491109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-915868d7-5c72-4dde-a320-27251476dd47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:10.491566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-915868d7-5c72-4dde-a320-27251476dd47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:10.491992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-915868d7-5c72-4dde-a320-27251476dd47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:10.561727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-915868d7-5c72-4dde-a320-27251476dd47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:10.570422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-915868d7-5c72-4dde-a320-27251476dd47 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093817 Aug 24 05:23:10.571065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1149/2189] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:11.029675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0a24b88b-2428-4f86-890a-bd2f38b854ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:11.030192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0a24b88b-2428-4f86-890a-bd2f38b854ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:11.037008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a24b88b-2428-4f86-890a-bd2f38b854ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:11.037487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a24b88b-2428-4f86-890a-bd2f38b854ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:11.037918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a24b88b-2428-4f86-890a-bd2f38b854ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:11.038604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a24b88b-2428-4f86-890a-bd2f38b854ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:11.039073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a24b88b-2428-4f86-890a-bd2f38b854ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:11.039489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a24b88b-2428-4f86-890a-bd2f38b854ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:11.103486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0a24b88b-2428-4f86-890a-bd2f38b854ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:11.111942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0a24b88b-2428-4f86-890a-bd2f38b854ed tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086417 Aug 24 05:23:11.112541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1041/2190] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:11.506676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dd9c818b-feff-4d8c-984a-c8ffedb3feb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:11.507339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dd9c818b-feff-4d8c-984a-c8ffedb3feb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:11.513806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9c818b-feff-4d8c-984a-c8ffedb3feb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:11.514277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9c818b-feff-4d8c-984a-c8ffedb3feb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:11.514724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9c818b-feff-4d8c-984a-c8ffedb3feb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:11.515410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9c818b-feff-4d8c-984a-c8ffedb3feb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:11.515854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9c818b-feff-4d8c-984a-c8ffedb3feb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:11.516269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9c818b-feff-4d8c-984a-c8ffedb3feb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:11.519431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:11.580805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dd9c818b-feff-4d8c-984a-c8ffedb3feb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:11.593454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-92568467-f75d-49f4-8bce-569d484945ca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:11.594102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-92568467-f75d-49f4-8bce-569d484945ca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:11.594280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dd9c818b-feff-4d8c-984a-c8ffedb3feb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092171 Aug 24 05:23:11.594755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1150/2191] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:11.601844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92568467-f75d-49f4-8bce-569d484945ca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:11.602494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92568467-f75d-49f4-8bce-569d484945ca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:11.602964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92568467-f75d-49f4-8bce-569d484945ca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:11.603665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92568467-f75d-49f4-8bce-569d484945ca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:11.604121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92568467-f75d-49f4-8bce-569d484945ca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:11.604543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92568467-f75d-49f4-8bce-569d484945ca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:11.672556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-92568467-f75d-49f4-8bce-569d484945ca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:11.681414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-92568467-f75d-49f4-8bce-569d484945ca tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091748 Aug 24 05:23:11.681996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1042/2192] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:12.133905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a7e36e8d-1a4d-46b8-b25c-648f39a4ebd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:12.134520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a7e36e8d-1a4d-46b8-b25c-648f39a4ebd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:12.140806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7e36e8d-1a4d-46b8-b25c-648f39a4ebd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:12.141291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7e36e8d-1a4d-46b8-b25c-648f39a4ebd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:12.141726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7e36e8d-1a4d-46b8-b25c-648f39a4ebd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:12.142419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7e36e8d-1a4d-46b8-b25c-648f39a4ebd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:12.142905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7e36e8d-1a4d-46b8-b25c-648f39a4ebd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:12.143333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7e36e8d-1a4d-46b8-b25c-648f39a4ebd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:12.211187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a7e36e8d-1a4d-46b8-b25c-648f39a4ebd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:12.219514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a7e36e8d-1a4d-46b8-b25c-648f39a4ebd5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089442 Aug 24 05:23:12.220093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1151/2193] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:12.616245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-12f4b93e-eed8-4ff7-a4a1-c2f1980a26b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:12.616850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-12f4b93e-eed8-4ff7-a4a1-c2f1980a26b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:12.623369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12f4b93e-eed8-4ff7-a4a1-c2f1980a26b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:12.623839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12f4b93e-eed8-4ff7-a4a1-c2f1980a26b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:12.624263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12f4b93e-eed8-4ff7-a4a1-c2f1980a26b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:12.624945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12f4b93e-eed8-4ff7-a4a1-c2f1980a26b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:12.625391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12f4b93e-eed8-4ff7-a4a1-c2f1980a26b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:12.625811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-12f4b93e-eed8-4ff7-a4a1-c2f1980a26b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:12.690434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-12f4b93e-eed8-4ff7-a4a1-c2f1980a26b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:12.700045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-12f4b93e-eed8-4ff7-a4a1-c2f1980a26b4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087983 Aug 24 05:23:12.700613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1043/2194] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:12.703100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-68e3d8c4-ddd3-4b83-860f-42c29f6357c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:12.703704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-68e3d8c4-ddd3-4b83-860f-42c29f6357c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:12.711306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68e3d8c4-ddd3-4b83-860f-42c29f6357c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:12.711788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68e3d8c4-ddd3-4b83-860f-42c29f6357c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:12.712241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68e3d8c4-ddd3-4b83-860f-42c29f6357c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:12.712949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68e3d8c4-ddd3-4b83-860f-42c29f6357c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:12.713396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68e3d8c4-ddd3-4b83-860f-42c29f6357c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:12.713813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68e3d8c4-ddd3-4b83-860f-42c29f6357c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:12.777018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-68e3d8c4-ddd3-4b83-860f-42c29f6357c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:12.786408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-68e3d8c4-ddd3-4b83-860f-42c29f6357c0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087088 Aug 24 05:23:12.787020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1152/2195] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:13.241358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a9e41880-bfc2-4a64-a8a9-5fbf935ee08c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:13.241951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a9e41880-bfc2-4a64-a8a9-5fbf935ee08c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:13.248194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9e41880-bfc2-4a64-a8a9-5fbf935ee08c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:13.248675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9e41880-bfc2-4a64-a8a9-5fbf935ee08c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:13.249106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9e41880-bfc2-4a64-a8a9-5fbf935ee08c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:13.249786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9e41880-bfc2-4a64-a8a9-5fbf935ee08c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:13.250230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9e41880-bfc2-4a64-a8a9-5fbf935ee08c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:13.250649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9e41880-bfc2-4a64-a8a9-5fbf935ee08c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:13.313813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a9e41880-bfc2-4a64-a8a9-5fbf935ee08c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:13.322428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a9e41880-bfc2-4a64-a8a9-5fbf935ee08c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085584 Aug 24 05:23:13.323044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1044/2196] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:13.722874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-633864e8-5c30-424d-97ee-0dd6911efc5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:13.723555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-633864e8-5c30-424d-97ee-0dd6911efc5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:13.731490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-633864e8-5c30-424d-97ee-0dd6911efc5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:13.731976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-633864e8-5c30-424d-97ee-0dd6911efc5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:13.732416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-633864e8-5c30-424d-97ee-0dd6911efc5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:13.733117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-633864e8-5c30-424d-97ee-0dd6911efc5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:13.733570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-633864e8-5c30-424d-97ee-0dd6911efc5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:13.733993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-633864e8-5c30-424d-97ee-0dd6911efc5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:13.801377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-633864e8-5c30-424d-97ee-0dd6911efc5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:13.807152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-90e91171-eae4-4876-bf5a-2039d29163f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:13.807838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-90e91171-eae4-4876-bf5a-2039d29163f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:13.810584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-633864e8-5c30-424d-97ee-0dd6911efc5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092174 Aug 24 05:23:13.811221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1153/2197] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:13.814456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90e91171-eae4-4876-bf5a-2039d29163f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:13.814982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90e91171-eae4-4876-bf5a-2039d29163f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:13.815427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90e91171-eae4-4876-bf5a-2039d29163f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:13.816253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90e91171-eae4-4876-bf5a-2039d29163f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:13.816826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90e91171-eae4-4876-bf5a-2039d29163f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:13.817256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90e91171-eae4-4876-bf5a-2039d29163f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:13.881871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-90e91171-eae4-4876-bf5a-2039d29163f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:13.890211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-90e91171-eae4-4876-bf5a-2039d29163f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087233 Aug 24 05:23:13.890871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1045/2198] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:14.343344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-13238b3b-8c63-4265-b55b-8b38e4badeb2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:14.343941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-13238b3b-8c63-4265-b55b-8b38e4badeb2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:14.350018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13238b3b-8c63-4265-b55b-8b38e4badeb2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:14.350494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13238b3b-8c63-4265-b55b-8b38e4badeb2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:14.350954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13238b3b-8c63-4265-b55b-8b38e4badeb2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:14.351623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13238b3b-8c63-4265-b55b-8b38e4badeb2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:14.352067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13238b3b-8c63-4265-b55b-8b38e4badeb2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:14.352482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13238b3b-8c63-4265-b55b-8b38e4badeb2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:14.417964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-13238b3b-8c63-4265-b55b-8b38e4badeb2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:14.430988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-13238b3b-8c63-4265-b55b-8b38e4badeb2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091227 Aug 24 05:23:14.431670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1154/2199] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:14.832012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a6714ede-cbb1-4e38-a10a-2e843844950b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:14.832647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a6714ede-cbb1-4e38-a10a-2e843844950b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:14.835170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=84 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:14.841814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6714ede-cbb1-4e38-a10a-2e843844950b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:14.842385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6714ede-cbb1-4e38-a10a-2e843844950b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:14.842881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6714ede-cbb1-4e38-a10a-2e843844950b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:14.843580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6714ede-cbb1-4e38-a10a-2e843844950b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:14.844027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6714ede-cbb1-4e38-a10a-2e843844950b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:14.844451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6714ede-cbb1-4e38-a10a-2e843844950b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:14.912435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ff9c0a33-67c6-418b-a6df-669131fc2ece tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:14.913293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ff9c0a33-67c6-418b-a6df-669131fc2ece tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:14.918879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a6714ede-cbb1-4e38-a10a-2e843844950b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:14.919647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9c0a33-67c6-418b-a6df-669131fc2ece tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:14.920156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9c0a33-67c6-418b-a6df-669131fc2ece tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:14.920589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9c0a33-67c6-418b-a6df-669131fc2ece tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:14.921277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9c0a33-67c6-418b-a6df-669131fc2ece tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:14.921747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9c0a33-67c6-418b-a6df-669131fc2ece tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:14.922169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff9c0a33-67c6-418b-a6df-669131fc2ece tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:14.932813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a6714ede-cbb1-4e38-a10a-2e843844950b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.105191 Aug 24 05:23:14.933404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1046/2200] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:14.986819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ff9c0a33-67c6-418b-a6df-669131fc2ece tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:14.995445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ff9c0a33-67c6-418b-a6df-669131fc2ece tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087562 Aug 24 05:23:14.996025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1155/2201] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:14 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:15.460877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-77b6feff-60c0-4838-b846-ee8332a82522 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:15.461482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-77b6feff-60c0-4838-b846-ee8332a82522 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:15.467575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77b6feff-60c0-4838-b846-ee8332a82522 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:15.468146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77b6feff-60c0-4838-b846-ee8332a82522 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:15.468539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77b6feff-60c0-4838-b846-ee8332a82522 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:15.469218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77b6feff-60c0-4838-b846-ee8332a82522 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:15.469764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77b6feff-60c0-4838-b846-ee8332a82522 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:15.470184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77b6feff-60c0-4838-b846-ee8332a82522 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:15.534067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-77b6feff-60c0-4838-b846-ee8332a82522 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:15.543331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-77b6feff-60c0-4838-b846-ee8332a82522 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086543 Aug 24 05:23:15.543906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1047/2202] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:15.954823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-15ff5e98-d553-4d92-a8dd-5af03b00b5e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:15.955435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-15ff5e98-d553-4d92-a8dd-5af03b00b5e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:15.962208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15ff5e98-d553-4d92-a8dd-5af03b00b5e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:15.962705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15ff5e98-d553-4d92-a8dd-5af03b00b5e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:15.963190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15ff5e98-d553-4d92-a8dd-5af03b00b5e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:15.963872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15ff5e98-d553-4d92-a8dd-5af03b00b5e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:15.964325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15ff5e98-d553-4d92-a8dd-5af03b00b5e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:15.964746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15ff5e98-d553-4d92-a8dd-5af03b00b5e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:16.016981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-321225d4-6f00-497d-869f-019e221b0572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:16.017546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-321225d4-6f00-497d-869f-019e221b0572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:16.024663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321225d4-6f00-497d-869f-019e221b0572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:16.025149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321225d4-6f00-497d-869f-019e221b0572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:16.025583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321225d4-6f00-497d-869f-019e221b0572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:16.026434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321225d4-6f00-497d-869f-019e221b0572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:16.026921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321225d4-6f00-497d-869f-019e221b0572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:16.027346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321225d4-6f00-497d-869f-019e221b0572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:16.030120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-15ff5e98-d553-4d92-a8dd-5af03b00b5e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:16.041255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-15ff5e98-d553-4d92-a8dd-5af03b00b5e5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090220 Aug 24 05:23:16.042133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1156/2203] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:16.051043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:16.098988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-321225d4-6f00-497d-869f-019e221b0572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:16.107544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-321225d4-6f00-497d-869f-019e221b0572 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094772 Aug 24 05:23:16.108121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1048/2204] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:16.565033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7b3a9228-f468-4e4b-b11b-19778ae8a38c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:16.565747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7b3a9228-f468-4e4b-b11b-19778ae8a38c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:16.572105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b3a9228-f468-4e4b-b11b-19778ae8a38c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:16.572585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b3a9228-f468-4e4b-b11b-19778ae8a38c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:16.573014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b3a9228-f468-4e4b-b11b-19778ae8a38c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:16.573728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b3a9228-f468-4e4b-b11b-19778ae8a38c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:16.574170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b3a9228-f468-4e4b-b11b-19778ae8a38c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:16.574581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b3a9228-f468-4e4b-b11b-19778ae8a38c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:16.640835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7b3a9228-f468-4e4b-b11b-19778ae8a38c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:16.652860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7b3a9228-f468-4e4b-b11b-19778ae8a38c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091553 Aug 24 05:23:16.653443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1157/2205] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:16 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:17.064803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a1a176c1-3aa0-4e08-8f6b-54ede1e18cc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:17.065956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a1a176c1-3aa0-4e08-8f6b-54ede1e18cc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:17.072914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1a176c1-3aa0-4e08-8f6b-54ede1e18cc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:17.073401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1a176c1-3aa0-4e08-8f6b-54ede1e18cc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:17.073839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1a176c1-3aa0-4e08-8f6b-54ede1e18cc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:17.074534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1a176c1-3aa0-4e08-8f6b-54ede1e18cc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:17.075019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1a176c1-3aa0-4e08-8f6b-54ede1e18cc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:17.075442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a1a176c1-3aa0-4e08-8f6b-54ede1e18cc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:17.129471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-11c2dbfb-9427-4ab0-b67e-27784f036764 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:17.130362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-11c2dbfb-9427-4ab0-b67e-27784f036764 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:17.136735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11c2dbfb-9427-4ab0-b67e-27784f036764 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:17.137215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11c2dbfb-9427-4ab0-b67e-27784f036764 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:17.137641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11c2dbfb-9427-4ab0-b67e-27784f036764 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:17.138320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11c2dbfb-9427-4ab0-b67e-27784f036764 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:17.138794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11c2dbfb-9427-4ab0-b67e-27784f036764 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:17.139417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-11c2dbfb-9427-4ab0-b67e-27784f036764 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:17.145224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a1a176c1-3aa0-4e08-8f6b-54ede1e18cc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:17.153746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a1a176c1-3aa0-4e08-8f6b-54ede1e18cc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092749 Aug 24 05:23:17.154331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1049/2206] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:17.204879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-11c2dbfb-9427-4ab0-b67e-27784f036764 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:17.213312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-11c2dbfb-9427-4ab0-b67e-27784f036764 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088286 Aug 24 05:23:17.213878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1158/2207] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:17 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:17.673848 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d45e091d-c023-4340-877a-943975b51f0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:17.674397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d45e091d-c023-4340-877a-943975b51f0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:17.680855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d45e091d-c023-4340-877a-943975b51f0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:17.681331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d45e091d-c023-4340-877a-943975b51f0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:17.681757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d45e091d-c023-4340-877a-943975b51f0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:17.682444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d45e091d-c023-4340-877a-943975b51f0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:17.682978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d45e091d-c023-4340-877a-943975b51f0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:17.684942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d45e091d-c023-4340-877a-943975b51f0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:17.750431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d45e091d-c023-4340-877a-943975b51f0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:17.759903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d45e091d-c023-4340-877a-943975b51f0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089903 Aug 24 05:23:17.760482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1050/2208] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:18.176090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-47782f9f-f81c-495d-91c8-2d0ea9b28d11 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:18.176690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-47782f9f-f81c-495d-91c8-2d0ea9b28d11 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:18.183592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47782f9f-f81c-495d-91c8-2d0ea9b28d11 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:18.184067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47782f9f-f81c-495d-91c8-2d0ea9b28d11 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:18.184497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47782f9f-f81c-495d-91c8-2d0ea9b28d11 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:18.185179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47782f9f-f81c-495d-91c8-2d0ea9b28d11 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:18.185623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47782f9f-f81c-495d-91c8-2d0ea9b28d11 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:18.186037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47782f9f-f81c-495d-91c8-2d0ea9b28d11 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:18.234616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-06ff34b8-ba45-49a0-916b-bbc87b395ff7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:18.235366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-06ff34b8-ba45-49a0-916b-bbc87b395ff7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:18.242979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06ff34b8-ba45-49a0-916b-bbc87b395ff7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:18.243469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06ff34b8-ba45-49a0-916b-bbc87b395ff7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:18.243910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06ff34b8-ba45-49a0-916b-bbc87b395ff7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:18.244606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06ff34b8-ba45-49a0-916b-bbc87b395ff7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:18.245056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06ff34b8-ba45-49a0-916b-bbc87b395ff7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:18.245477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06ff34b8-ba45-49a0-916b-bbc87b395ff7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:18.251835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-47782f9f-f81c-495d-91c8-2d0ea9b28d11 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:18.260613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-47782f9f-f81c-495d-91c8-2d0ea9b28d11 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089139 Aug 24 05:23:18.261190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1159/2209] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:18.318120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-06ff34b8-ba45-49a0-916b-bbc87b395ff7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:18.326522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-06ff34b8-ba45-49a0-916b-bbc87b395ff7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.095882 Aug 24 05:23:18.327119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1051/2210] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:18.781419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-45bd9c60-4097-4f6a-aa77-42a8ead40b94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:18.782017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-45bd9c60-4097-4f6a-aa77-42a8ead40b94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:18.788731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45bd9c60-4097-4f6a-aa77-42a8ead40b94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:18.789206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45bd9c60-4097-4f6a-aa77-42a8ead40b94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:18.792911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45bd9c60-4097-4f6a-aa77-42a8ead40b94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:18.792911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45bd9c60-4097-4f6a-aa77-42a8ead40b94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:18.792911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45bd9c60-4097-4f6a-aa77-42a8ead40b94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:18.792911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45bd9c60-4097-4f6a-aa77-42a8ead40b94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:18.855156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-45bd9c60-4097-4f6a-aa77-42a8ead40b94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:18.863781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-45bd9c60-4097-4f6a-aa77-42a8ead40b94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086153 Aug 24 05:23:18.864358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1160/2211] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:19.281138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4c9a7332-ec54-46b0-93b0-f1330881b7e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:19.281766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4c9a7332-ec54-46b0-93b0-f1330881b7e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:19.291809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c9a7332-ec54-46b0-93b0-f1330881b7e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:19.292291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c9a7332-ec54-46b0-93b0-f1330881b7e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:19.292723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c9a7332-ec54-46b0-93b0-f1330881b7e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:19.293411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c9a7332-ec54-46b0-93b0-f1330881b7e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:19.293863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c9a7332-ec54-46b0-93b0-f1330881b7e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:19.294280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4c9a7332-ec54-46b0-93b0-f1330881b7e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:19.347586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3c9e86d7-b0e7-4f50-9c99-b24671f7651e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:19.348446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3c9e86d7-b0e7-4f50-9c99-b24671f7651e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:19.355009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9e86d7-b0e7-4f50-9c99-b24671f7651e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:19.355489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9e86d7-b0e7-4f50-9c99-b24671f7651e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:19.355917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9e86d7-b0e7-4f50-9c99-b24671f7651e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:19.356600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9e86d7-b0e7-4f50-9c99-b24671f7651e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:19.357043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9e86d7-b0e7-4f50-9c99-b24671f7651e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:19.357462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c9e86d7-b0e7-4f50-9c99-b24671f7651e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:19.363889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4c9a7332-ec54-46b0-93b0-f1330881b7e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:19.372234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4c9a7332-ec54-46b0-93b0-f1330881b7e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.094932 Aug 24 05:23:19.372808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1052/2212] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:19.426176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3c9e86d7-b0e7-4f50-9c99-b24671f7651e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:19.434912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3c9e86d7-b0e7-4f50-9c99-b24671f7651e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091534 Aug 24 05:23:19.435688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1161/2213] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:19.886411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-73c1c10b-297b-417f-bc35-3792616bde42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:19.887085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-73c1c10b-297b-417f-bc35-3792616bde42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:19.893130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73c1c10b-297b-417f-bc35-3792616bde42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:19.893708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73c1c10b-297b-417f-bc35-3792616bde42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:19.894477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73c1c10b-297b-417f-bc35-3792616bde42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:19.895077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73c1c10b-297b-417f-bc35-3792616bde42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:19.895535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73c1c10b-297b-417f-bc35-3792616bde42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:19.895958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-73c1c10b-297b-417f-bc35-3792616bde42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:19.960271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-73c1c10b-297b-417f-bc35-3792616bde42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:19.968674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-73c1c10b-297b-417f-bc35-3792616bde42 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086102 Aug 24 05:23:19.969249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1053/2214] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:20.394036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ec44fd4b-bd88-4d63-b9a5-8c12bb92e4a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:20.394665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ec44fd4b-bd88-4d63-b9a5-8c12bb92e4a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:20.397127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=82 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:20.402625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec44fd4b-bd88-4d63-b9a5-8c12bb92e4a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:20.403147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec44fd4b-bd88-4d63-b9a5-8c12bb92e4a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:20.403581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec44fd4b-bd88-4d63-b9a5-8c12bb92e4a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:20.404276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec44fd4b-bd88-4d63-b9a5-8c12bb92e4a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:20.404731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec44fd4b-bd88-4d63-b9a5-8c12bb92e4a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:20.405157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ec44fd4b-bd88-4d63-b9a5-8c12bb92e4a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:20.455285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bd769184-ba92-49b4-bdcb-0060c619dcd3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:20.456414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bd769184-ba92-49b4-bdcb-0060c619dcd3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:20.463266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd769184-ba92-49b4-bdcb-0060c619dcd3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:20.463761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd769184-ba92-49b4-bdcb-0060c619dcd3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:20.464199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd769184-ba92-49b4-bdcb-0060c619dcd3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:20.464898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd769184-ba92-49b4-bdcb-0060c619dcd3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:20.465351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd769184-ba92-49b4-bdcb-0060c619dcd3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:20.465784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd769184-ba92-49b4-bdcb-0060c619dcd3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:20.469379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ec44fd4b-bd88-4d63-b9a5-8c12bb92e4a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:20.478408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ec44fd4b-bd88-4d63-b9a5-8c12bb92e4a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088746 Aug 24 05:23:20.479021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1162/2215] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:20.534999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bd769184-ba92-49b4-bdcb-0060c619dcd3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:20.543613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bd769184-ba92-49b4-bdcb-0060c619dcd3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092178 Aug 24 05:23:20.544190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1054/2216] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:20.990125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-22b498cd-9bb9-41bb-8a98-e4603e330035 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:20.990805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-22b498cd-9bb9-41bb-8a98-e4603e330035 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:20.996781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22b498cd-9bb9-41bb-8a98-e4603e330035 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:20.997256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22b498cd-9bb9-41bb-8a98-e4603e330035 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:20.997685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22b498cd-9bb9-41bb-8a98-e4603e330035 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:20.998366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22b498cd-9bb9-41bb-8a98-e4603e330035 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:20.998835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22b498cd-9bb9-41bb-8a98-e4603e330035 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:20.999254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22b498cd-9bb9-41bb-8a98-e4603e330035 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:21.062373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-22b498cd-9bb9-41bb-8a98-e4603e330035 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:21.070884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-22b498cd-9bb9-41bb-8a98-e4603e330035 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085260 Aug 24 05:23:21.071446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1163/2217] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:21.499198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-22b93b00-6829-450c-8a49-3cf68283139b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:21.499792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-22b93b00-6829-450c-8a49-3cf68283139b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:21.506521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22b93b00-6829-450c-8a49-3cf68283139b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:21.507107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22b93b00-6829-450c-8a49-3cf68283139b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:21.507541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22b93b00-6829-450c-8a49-3cf68283139b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:21.508361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22b93b00-6829-450c-8a49-3cf68283139b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:21.508884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22b93b00-6829-450c-8a49-3cf68283139b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:21.509303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22b93b00-6829-450c-8a49-3cf68283139b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:21.564923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-77c6627e-04b8-4ce3-896f-2c1fb44df096 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:21.566165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-77c6627e-04b8-4ce3-896f-2c1fb44df096 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:21.572961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c6627e-04b8-4ce3-896f-2c1fb44df096 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:21.573370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-22b93b00-6829-450c-8a49-3cf68283139b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:21.573506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c6627e-04b8-4ce3-896f-2c1fb44df096 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:21.573863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c6627e-04b8-4ce3-896f-2c1fb44df096 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:21.574555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c6627e-04b8-4ce3-896f-2c1fb44df096 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:21.575024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c6627e-04b8-4ce3-896f-2c1fb44df096 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:21.575443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-77c6627e-04b8-4ce3-896f-2c1fb44df096 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:21.582674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-22b93b00-6829-450c-8a49-3cf68283139b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087164 Aug 24 05:23:21.583275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1055/2218] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:21.639226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-77c6627e-04b8-4ce3-896f-2c1fb44df096 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:21.648258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-77c6627e-04b8-4ce3-896f-2c1fb44df096 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087291 Aug 24 05:23:21.648845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1164/2219] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:22.092625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-76b5bea8-b9a8-45c6-87f5-cd885922fb04 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:22.093208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-76b5bea8-b9a8-45c6-87f5-cd885922fb04 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:22.100219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76b5bea8-b9a8-45c6-87f5-cd885922fb04 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:22.100709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76b5bea8-b9a8-45c6-87f5-cd885922fb04 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:22.101147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76b5bea8-b9a8-45c6-87f5-cd885922fb04 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:22.101848 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76b5bea8-b9a8-45c6-87f5-cd885922fb04 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:22.102303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76b5bea8-b9a8-45c6-87f5-cd885922fb04 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:22.102758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76b5bea8-b9a8-45c6-87f5-cd885922fb04 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:22.166352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-76b5bea8-b9a8-45c6-87f5-cd885922fb04 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:22.175448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-76b5bea8-b9a8-45c6-87f5-cd885922fb04 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086119 Aug 24 05:23:22.175931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1056/2220] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:22.603947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0df8e958-703d-4f60-81f4-2eb480f7aa33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:22.604637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0df8e958-703d-4f60-81f4-2eb480f7aa33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:22.611236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0df8e958-703d-4f60-81f4-2eb480f7aa33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:22.611723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0df8e958-703d-4f60-81f4-2eb480f7aa33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:22.612181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0df8e958-703d-4f60-81f4-2eb480f7aa33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:22.612987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0df8e958-703d-4f60-81f4-2eb480f7aa33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:22.613442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0df8e958-703d-4f60-81f4-2eb480f7aa33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:22.613866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0df8e958-703d-4f60-81f4-2eb480f7aa33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:22.669042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-154c23dc-7284-431f-b410-a3ab4cbc3dc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:22.669650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-154c23dc-7284-431f-b410-a3ab4cbc3dc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:22.676484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-154c23dc-7284-431f-b410-a3ab4cbc3dc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:22.676972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-154c23dc-7284-431f-b410-a3ab4cbc3dc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:22.678204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-154c23dc-7284-431f-b410-a3ab4cbc3dc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:22.678204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-154c23dc-7284-431f-b410-a3ab4cbc3dc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:22.678572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-154c23dc-7284-431f-b410-a3ab4cbc3dc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:22.679094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-154c23dc-7284-431f-b410-a3ab4cbc3dc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:22.681254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0df8e958-703d-4f60-81f4-2eb480f7aa33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:22.689850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0df8e958-703d-4f60-81f4-2eb480f7aa33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089764 Aug 24 05:23:22.690566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1165/2221] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:22.745717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-154c23dc-7284-431f-b410-a3ab4cbc3dc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:22.754357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-154c23dc-7284-431f-b410-a3ab4cbc3dc5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089156 Aug 24 05:23:22.754984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1057/2222] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:22 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:23.197084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c4a4d0cc-d239-4f17-981b-294abd608aee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:23.197700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c4a4d0cc-d239-4f17-981b-294abd608aee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:23.203799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4a4d0cc-d239-4f17-981b-294abd608aee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:23.204281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4a4d0cc-d239-4f17-981b-294abd608aee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:23.204713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4a4d0cc-d239-4f17-981b-294abd608aee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:23.205417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4a4d0cc-d239-4f17-981b-294abd608aee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:23.205849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4a4d0cc-d239-4f17-981b-294abd608aee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:23.206274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c4a4d0cc-d239-4f17-981b-294abd608aee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:23.272493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c4a4d0cc-d239-4f17-981b-294abd608aee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:23.274659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:23.281773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c4a4d0cc-d239-4f17-981b-294abd608aee tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088603 Aug 24 05:23:23.282343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1166/2223] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:23.710714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5693d383-660d-4233-8823-d725ec6cf473 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:23.711346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5693d383-660d-4233-8823-d725ec6cf473 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:23.717950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5693d383-660d-4233-8823-d725ec6cf473 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:23.718433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5693d383-660d-4233-8823-d725ec6cf473 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:23.718897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5693d383-660d-4233-8823-d725ec6cf473 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:23.719584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5693d383-660d-4233-8823-d725ec6cf473 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:23.720214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5693d383-660d-4233-8823-d725ec6cf473 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:23.721348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5693d383-660d-4233-8823-d725ec6cf473 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:23.775531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cd6ac60b-0c08-42cb-9028-0b05b59b5f56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:23.776248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cd6ac60b-0c08-42cb-9028-0b05b59b5f56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:23.783445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6ac60b-0c08-42cb-9028-0b05b59b5f56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:23.784605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6ac60b-0c08-42cb-9028-0b05b59b5f56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:23.785519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6ac60b-0c08-42cb-9028-0b05b59b5f56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:23.785964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6ac60b-0c08-42cb-9028-0b05b59b5f56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:23.786422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6ac60b-0c08-42cb-9028-0b05b59b5f56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:23.786878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6ac60b-0c08-42cb-9028-0b05b59b5f56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:23.788159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5693d383-660d-4233-8823-d725ec6cf473 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:23.796706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5693d383-660d-4233-8823-d725ec6cf473 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090461 Aug 24 05:23:23.797295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1058/2224] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:23.851835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cd6ac60b-0c08-42cb-9028-0b05b59b5f56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:23.860258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cd6ac60b-0c08-42cb-9028-0b05b59b5f56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088518 Aug 24 05:23:23.860836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1167/2225] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:24.303837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-718a97f8-5842-493f-9753-12a39ff34ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:24.304459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-718a97f8-5842-493f-9753-12a39ff34ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:24.311031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-718a97f8-5842-493f-9753-12a39ff34ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:24.311519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-718a97f8-5842-493f-9753-12a39ff34ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:24.311958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-718a97f8-5842-493f-9753-12a39ff34ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:24.312656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-718a97f8-5842-493f-9753-12a39ff34ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:24.313116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-718a97f8-5842-493f-9753-12a39ff34ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:24.313541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-718a97f8-5842-493f-9753-12a39ff34ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:24.386539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-718a97f8-5842-493f-9753-12a39ff34ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:24.395542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-718a97f8-5842-493f-9753-12a39ff34ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.096368 Aug 24 05:23:24.396035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1059/2226] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:24.819889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-224fa716-197e-487a-82a4-bb7a02929617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:24.820523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-224fa716-197e-487a-82a4-bb7a02929617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:24.827015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-224fa716-197e-487a-82a4-bb7a02929617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:24.827488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-224fa716-197e-487a-82a4-bb7a02929617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:24.827916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-224fa716-197e-487a-82a4-bb7a02929617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:24.829005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-224fa716-197e-487a-82a4-bb7a02929617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:24.829113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-224fa716-197e-487a-82a4-bb7a02929617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:24.829431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-224fa716-197e-487a-82a4-bb7a02929617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:24.882221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-041d3f15-93b5-4472-8ecf-77b38a4144e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:24.882857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-041d3f15-93b5-4472-8ecf-77b38a4144e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:24.889561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-041d3f15-93b5-4472-8ecf-77b38a4144e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:24.890040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-041d3f15-93b5-4472-8ecf-77b38a4144e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:24.890471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-041d3f15-93b5-4472-8ecf-77b38a4144e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:24.891531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-041d3f15-93b5-4472-8ecf-77b38a4144e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:24.891664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-041d3f15-93b5-4472-8ecf-77b38a4144e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:24.892025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-041d3f15-93b5-4472-8ecf-77b38a4144e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:24.893606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-224fa716-197e-487a-82a4-bb7a02929617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:24.904134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-224fa716-197e-487a-82a4-bb7a02929617 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088723 Aug 24 05:23:24.904717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1168/2227] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:24.967693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-041d3f15-93b5-4472-8ecf-77b38a4144e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:24.976022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-041d3f15-93b5-4472-8ecf-77b38a4144e7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.098493 Aug 24 05:23:24.976592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1060/2228] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:24 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:25.416667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5ba531f9-868c-4913-aeda-b3a17a126d0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:25.417269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5ba531f9-868c-4913-aeda-b3a17a126d0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:25.423334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ba531f9-868c-4913-aeda-b3a17a126d0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:25.423818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ba531f9-868c-4913-aeda-b3a17a126d0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:25.424257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ba531f9-868c-4913-aeda-b3a17a126d0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:25.425561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ba531f9-868c-4913-aeda-b3a17a126d0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:25.426101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ba531f9-868c-4913-aeda-b3a17a126d0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:25.426524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ba531f9-868c-4913-aeda-b3a17a126d0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:25.492446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ba531f9-868c-4913-aeda-b3a17a126d0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:25.500873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5ba531f9-868c-4913-aeda-b3a17a126d0d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088152 Aug 24 05:23:25.501447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1169/2229] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:25.924215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-992afe4a-d037-4398-8b93-73ad698b7e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:25.925557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-992afe4a-d037-4398-8b93-73ad698b7e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:25.932787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-992afe4a-d037-4398-8b93-73ad698b7e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:25.933273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-992afe4a-d037-4398-8b93-73ad698b7e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:25.933713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-992afe4a-d037-4398-8b93-73ad698b7e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:25.934416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-992afe4a-d037-4398-8b93-73ad698b7e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:25.934915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-992afe4a-d037-4398-8b93-73ad698b7e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:25.935339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-992afe4a-d037-4398-8b93-73ad698b7e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:25.997416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7badd789-da9c-4194-84c5-e8ece2aa3c3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:25.997994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7badd789-da9c-4194-84c5-e8ece2aa3c3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:26.003817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-992afe4a-d037-4398-8b93-73ad698b7e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:26.005375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7badd789-da9c-4194-84c5-e8ece2aa3c3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:26.005674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7badd789-da9c-4194-84c5-e8ece2aa3c3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:26.006409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7badd789-da9c-4194-84c5-e8ece2aa3c3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:26.008581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7badd789-da9c-4194-84c5-e8ece2aa3c3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:26.008998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7badd789-da9c-4194-84c5-e8ece2aa3c3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:26.009521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7badd789-da9c-4194-84c5-e8ece2aa3c3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:26.013426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-992afe4a-d037-4398-8b93-73ad698b7e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093027 Aug 24 05:23:26.014234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1061/2230] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:26.087470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7badd789-da9c-4194-84c5-e8ece2aa3c3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:26.096137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7badd789-da9c-4194-84c5-e8ece2aa3c3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.102744 Aug 24 05:23:26.097458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1170/2231] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:26.523309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9a28c501-6a63-473f-9b68-a881203a4f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:26.523920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9a28c501-6a63-473f-9b68-a881203a4f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:26.530034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9a28c501-6a63-473f-9b68-a881203a4f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:26.530503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9a28c501-6a63-473f-9b68-a881203a4f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:26.530992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9a28c501-6a63-473f-9b68-a881203a4f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:26.531685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9a28c501-6a63-473f-9b68-a881203a4f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:26.532140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9a28c501-6a63-473f-9b68-a881203a4f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:26.532565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9a28c501-6a63-473f-9b68-a881203a4f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:26.599661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9a28c501-6a63-473f-9b68-a881203a4f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:26.609052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9a28c501-6a63-473f-9b68-a881203a4f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090455 Aug 24 05:23:26.609621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1062/2232] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:26 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:27.038066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8486d019-1344-4cb2-aab9-2e2b8d75b9fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:27.038740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8486d019-1344-4cb2-aab9-2e2b8d75b9fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:27.045117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8486d019-1344-4cb2-aab9-2e2b8d75b9fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:27.045596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8486d019-1344-4cb2-aab9-2e2b8d75b9fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:27.046027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8486d019-1344-4cb2-aab9-2e2b8d75b9fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:27.046725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8486d019-1344-4cb2-aab9-2e2b8d75b9fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:27.047173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8486d019-1344-4cb2-aab9-2e2b8d75b9fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:27.047586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8486d019-1344-4cb2-aab9-2e2b8d75b9fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:27.113135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8486d019-1344-4cb2-aab9-2e2b8d75b9fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:27.118076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-06994aa0-09c9-4f4b-84fe-c97eb4f537e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:27.118844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-06994aa0-09c9-4f4b-84fe-c97eb4f537e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:27.122409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8486d019-1344-4cb2-aab9-2e2b8d75b9fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088638 Aug 24 05:23:27.123037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1171/2233] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:27 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:27.125487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06994aa0-09c9-4f4b-84fe-c97eb4f537e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:27.125974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06994aa0-09c9-4f4b-84fe-c97eb4f537e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:27.126407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06994aa0-09c9-4f4b-84fe-c97eb4f537e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:27.127120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06994aa0-09c9-4f4b-84fe-c97eb4f537e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:27.127573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06994aa0-09c9-4f4b-84fe-c97eb4f537e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:27.128699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06994aa0-09c9-4f4b-84fe-c97eb4f537e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:27.194216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-06994aa0-09c9-4f4b-84fe-c97eb4f537e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:27.202609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-06994aa0-09c9-4f4b-84fe-c97eb4f537e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088732 Aug 24 05:23:27.203213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1063/2234] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:27 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:27.629780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2c86c36d-8a12-46ef-b206-5036cb20a91f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:27.630304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2c86c36d-8a12-46ef-b206-5036cb20a91f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:27.636595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c86c36d-8a12-46ef-b206-5036cb20a91f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:27.637077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c86c36d-8a12-46ef-b206-5036cb20a91f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:27.637510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c86c36d-8a12-46ef-b206-5036cb20a91f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:27.638205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c86c36d-8a12-46ef-b206-5036cb20a91f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:27.638653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c86c36d-8a12-46ef-b206-5036cb20a91f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:27.639098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c86c36d-8a12-46ef-b206-5036cb20a91f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:27.701752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2c86c36d-8a12-46ef-b206-5036cb20a91f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:27.710137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2c86c36d-8a12-46ef-b206-5036cb20a91f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084488 Aug 24 05:23:27.710733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1172/2235] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:28.144296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d79bc9ac-f264-4d42-bb69-7a477353cddf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:28.144909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d79bc9ac-f264-4d42-bb69-7a477353cddf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:28.152000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79bc9ac-f264-4d42-bb69-7a477353cddf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:28.152484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79bc9ac-f264-4d42-bb69-7a477353cddf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:28.152922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79bc9ac-f264-4d42-bb69-7a477353cddf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:28.153609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79bc9ac-f264-4d42-bb69-7a477353cddf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:28.154058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79bc9ac-f264-4d42-bb69-7a477353cddf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:28.154510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79bc9ac-f264-4d42-bb69-7a477353cddf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:28.218035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d79bc9ac-f264-4d42-bb69-7a477353cddf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:28.223895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e4960039-c67d-40ad-a738-4bc5bdab12ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:28.224713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e4960039-c67d-40ad-a738-4bc5bdab12ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:28.227399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d79bc9ac-f264-4d42-bb69-7a477353cddf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086938 Aug 24 05:23:28.227987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1064/2236] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:28.231540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4960039-c67d-40ad-a738-4bc5bdab12ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:28.232029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4960039-c67d-40ad-a738-4bc5bdab12ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:28.232463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4960039-c67d-40ad-a738-4bc5bdab12ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:28.233160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4960039-c67d-40ad-a738-4bc5bdab12ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:28.233602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4960039-c67d-40ad-a738-4bc5bdab12ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:28.234022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4960039-c67d-40ad-a738-4bc5bdab12ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:28.304629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e4960039-c67d-40ad-a738-4bc5bdab12ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:28.313199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e4960039-c67d-40ad-a738-4bc5bdab12ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093782 Aug 24 05:23:28.313769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1173/2237] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:28.730951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dd29247a-45c5-4dc9-bce1-eee9a0cbc419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:28.731568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dd29247a-45c5-4dc9-bce1-eee9a0cbc419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:28.737800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd29247a-45c5-4dc9-bce1-eee9a0cbc419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:28.738282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd29247a-45c5-4dc9-bce1-eee9a0cbc419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:28.738738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd29247a-45c5-4dc9-bce1-eee9a0cbc419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:28.739435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd29247a-45c5-4dc9-bce1-eee9a0cbc419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:28.739888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd29247a-45c5-4dc9-bce1-eee9a0cbc419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:28.740308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd29247a-45c5-4dc9-bce1-eee9a0cbc419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:28.743158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:28.805602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dd29247a-45c5-4dc9-bce1-eee9a0cbc419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:28.814031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dd29247a-45c5-4dc9-bce1-eee9a0cbc419 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086967 Aug 24 05:23:28.814608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1065/2238] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:29.248555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a8964cae-ca0d-4c13-987d-0b1b84c1228a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:29.249193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a8964cae-ca0d-4c13-987d-0b1b84c1228a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:29.256618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8964cae-ca0d-4c13-987d-0b1b84c1228a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:29.257374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8964cae-ca0d-4c13-987d-0b1b84c1228a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:29.258129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8964cae-ca0d-4c13-987d-0b1b84c1228a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:29.259245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8964cae-ca0d-4c13-987d-0b1b84c1228a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:29.260024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8964cae-ca0d-4c13-987d-0b1b84c1228a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:29.260763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8964cae-ca0d-4c13-987d-0b1b84c1228a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:29.334560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9ad9c559-c653-4e38-bd95-672299e4aa93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:29.335355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a8964cae-ca0d-4c13-987d-0b1b84c1228a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:29.337406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9ad9c559-c653-4e38-bd95-672299e4aa93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:29.342288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ad9c559-c653-4e38-bd95-672299e4aa93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:29.342792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ad9c559-c653-4e38-bd95-672299e4aa93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:29.343223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ad9c559-c653-4e38-bd95-672299e4aa93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:29.343360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a8964cae-ca0d-4c13-987d-0b1b84c1228a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.098648 Aug 24 05:23:29.343915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ad9c559-c653-4e38-bd95-672299e4aa93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:29.344046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1174/2239] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:29.344359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ad9c559-c653-4e38-bd95-672299e4aa93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:29.344883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9ad9c559-c653-4e38-bd95-672299e4aa93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:29.412835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9ad9c559-c653-4e38-bd95-672299e4aa93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:29.421182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9ad9c559-c653-4e38-bd95-672299e4aa93 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090807 Aug 24 05:23:29.421770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1066/2240] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:29.835611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-53effd68-7064-42d8-9b40-a14a103ae159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:29.836223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-53effd68-7064-42d8-9b40-a14a103ae159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:29.842269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53effd68-7064-42d8-9b40-a14a103ae159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:29.842789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53effd68-7064-42d8-9b40-a14a103ae159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:29.843239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53effd68-7064-42d8-9b40-a14a103ae159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:29.843935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53effd68-7064-42d8-9b40-a14a103ae159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:29.844389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53effd68-7064-42d8-9b40-a14a103ae159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:29.844813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53effd68-7064-42d8-9b40-a14a103ae159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:29.908068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-53effd68-7064-42d8-9b40-a14a103ae159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:29.917249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-53effd68-7064-42d8-9b40-a14a103ae159 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086225 Aug 24 05:23:29.917835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1175/2241] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:30.363631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a199b01b-ad59-4554-920a-60cf8ee92123 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:30.364261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a199b01b-ad59-4554-920a-60cf8ee92123 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:30.371092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a199b01b-ad59-4554-920a-60cf8ee92123 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:30.371569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a199b01b-ad59-4554-920a-60cf8ee92123 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:30.371996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a199b01b-ad59-4554-920a-60cf8ee92123 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:30.372680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a199b01b-ad59-4554-920a-60cf8ee92123 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:30.373124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a199b01b-ad59-4554-920a-60cf8ee92123 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:30.373546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a199b01b-ad59-4554-920a-60cf8ee92123 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:30.437915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a199b01b-ad59-4554-920a-60cf8ee92123 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:30.444335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-785698f2-5550-4526-b4e4-be21611dbb4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:30.445531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-785698f2-5550-4526-b4e4-be21611dbb4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:30.448404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a199b01b-ad59-4554-920a-60cf8ee92123 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088627 Aug 24 05:23:30.448994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1067/2242] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:30.455280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-785698f2-5550-4526-b4e4-be21611dbb4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:30.456148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-785698f2-5550-4526-b4e4-be21611dbb4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:30.456972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-785698f2-5550-4526-b4e4-be21611dbb4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:30.458847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-785698f2-5550-4526-b4e4-be21611dbb4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:30.459677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-785698f2-5550-4526-b4e4-be21611dbb4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:30.460459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-785698f2-5550-4526-b4e4-be21611dbb4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:30.536073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-785698f2-5550-4526-b4e4-be21611dbb4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:30.544715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-785698f2-5550-4526-b4e4-be21611dbb4c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.105747 Aug 24 05:23:30.545285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1176/2243] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:30.939428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-18a160d6-9c83-4e94-9e51-042a2175fb14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:30.940031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-18a160d6-9c83-4e94-9e51-042a2175fb14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:30.947350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18a160d6-9c83-4e94-9e51-042a2175fb14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:30.947835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18a160d6-9c83-4e94-9e51-042a2175fb14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:30.948265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18a160d6-9c83-4e94-9e51-042a2175fb14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:30.948957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18a160d6-9c83-4e94-9e51-042a2175fb14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:30.949399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18a160d6-9c83-4e94-9e51-042a2175fb14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:30.949811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18a160d6-9c83-4e94-9e51-042a2175fb14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:31.016145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-18a160d6-9c83-4e94-9e51-042a2175fb14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:31.025656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-18a160d6-9c83-4e94-9e51-042a2175fb14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090024 Aug 24 05:23:31.026244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1068/2244] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:31.482583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-101894d4-b330-499a-9494-5645ee51d885 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:31.483260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-101894d4-b330-499a-9494-5645ee51d885 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:31.490835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-101894d4-b330-499a-9494-5645ee51d885 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:31.492463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-101894d4-b330-499a-9494-5645ee51d885 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:31.492900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-101894d4-b330-499a-9494-5645ee51d885 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:31.493604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-101894d4-b330-499a-9494-5645ee51d885 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:31.494052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-101894d4-b330-499a-9494-5645ee51d885 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:31.494510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-101894d4-b330-499a-9494-5645ee51d885 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:31.566897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4ca3e5cc-823a-41ad-847b-1e9fad8f6085 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:31.567659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4ca3e5cc-823a-41ad-847b-1e9fad8f6085 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:31.573923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-101894d4-b330-499a-9494-5645ee51d885 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:31.577552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ca3e5cc-823a-41ad-847b-1e9fad8f6085 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:31.577994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ca3e5cc-823a-41ad-847b-1e9fad8f6085 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:31.578732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ca3e5cc-823a-41ad-847b-1e9fad8f6085 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:31.579454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ca3e5cc-823a-41ad-847b-1e9fad8f6085 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:31.579917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ca3e5cc-823a-41ad-847b-1e9fad8f6085 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:31.580344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4ca3e5cc-823a-41ad-847b-1e9fad8f6085 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:31.585144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-101894d4-b330-499a-9494-5645ee51d885 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.106004 Aug 24 05:23:31.586165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1177/2245] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:31.653450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4ca3e5cc-823a-41ad-847b-1e9fad8f6085 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:31.662952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4ca3e5cc-823a-41ad-847b-1e9fad8f6085 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.101153 Aug 24 05:23:31.663529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1069/2246] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:32.048254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fe323b05-22cc-4a79-a4c4-7440564d7d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:32.048865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fe323b05-22cc-4a79-a4c4-7440564d7d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:32.059861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe323b05-22cc-4a79-a4c4-7440564d7d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:32.060434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe323b05-22cc-4a79-a4c4-7440564d7d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:32.061114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe323b05-22cc-4a79-a4c4-7440564d7d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:32.061983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe323b05-22cc-4a79-a4c4-7440564d7d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:32.062490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe323b05-22cc-4a79-a4c4-7440564d7d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:32.063005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe323b05-22cc-4a79-a4c4-7440564d7d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:32.134665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fe323b05-22cc-4a79-a4c4-7440564d7d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:32.143059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fe323b05-22cc-4a79-a4c4-7440564d7d2c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.098752 Aug 24 05:23:32.143640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1178/2247] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:32.608023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c1d5cfd9-fe76-4667-a9ea-65202db98dcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:32.608654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c1d5cfd9-fe76-4667-a9ea-65202db98dcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:32.615313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1d5cfd9-fe76-4667-a9ea-65202db98dcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:32.615795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1d5cfd9-fe76-4667-a9ea-65202db98dcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:32.616222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1d5cfd9-fe76-4667-a9ea-65202db98dcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:32.616905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1d5cfd9-fe76-4667-a9ea-65202db98dcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:32.617350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1d5cfd9-fe76-4667-a9ea-65202db98dcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:32.617765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c1d5cfd9-fe76-4667-a9ea-65202db98dcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:32.683834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c1d5cfd9-fe76-4667-a9ea-65202db98dcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:32.688936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-704546d9-e518-4c20-87f3-c9788ba69c24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:32.689548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-704546d9-e518-4c20-87f3-c9788ba69c24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:32.692985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c1d5cfd9-fe76-4667-a9ea-65202db98dcc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088776 Aug 24 05:23:32.693569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1070/2248] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:32.696936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-704546d9-e518-4c20-87f3-c9788ba69c24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:32.697418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-704546d9-e518-4c20-87f3-c9788ba69c24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:32.697887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-704546d9-e518-4c20-87f3-c9788ba69c24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:32.698539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-704546d9-e518-4c20-87f3-c9788ba69c24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:32.699013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-704546d9-e518-4c20-87f3-c9788ba69c24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:32.699430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-704546d9-e518-4c20-87f3-c9788ba69c24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:32.763249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-704546d9-e518-4c20-87f3-c9788ba69c24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:32.772554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-704546d9-e518-4c20-87f3-c9788ba69c24 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087355 Aug 24 05:23:32.773161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1179/2249] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:33.164773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-180b5811-9a74-4f5b-bef9-2a1f7ad6f353 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:33.165297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-180b5811-9a74-4f5b-bef9-2a1f7ad6f353 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:33.171416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-180b5811-9a74-4f5b-bef9-2a1f7ad6f353 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:33.171894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-180b5811-9a74-4f5b-bef9-2a1f7ad6f353 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:33.172332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-180b5811-9a74-4f5b-bef9-2a1f7ad6f353 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:33.173012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-180b5811-9a74-4f5b-bef9-2a1f7ad6f353 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:33.173471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-180b5811-9a74-4f5b-bef9-2a1f7ad6f353 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:33.173888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-180b5811-9a74-4f5b-bef9-2a1f7ad6f353 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:33.239355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-180b5811-9a74-4f5b-bef9-2a1f7ad6f353 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:33.247974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-180b5811-9a74-4f5b-bef9-2a1f7ad6f353 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087146 Aug 24 05:23:33.248555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1071/2250] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:33.713655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cb1e54d8-1158-4295-81db-2a379800a640 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:33.714266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cb1e54d8-1158-4295-81db-2a379800a640 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:33.720857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1e54d8-1158-4295-81db-2a379800a640 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:33.721342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1e54d8-1158-4295-81db-2a379800a640 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:33.721780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1e54d8-1158-4295-81db-2a379800a640 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:33.722476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1e54d8-1158-4295-81db-2a379800a640 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:33.723551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1e54d8-1158-4295-81db-2a379800a640 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:33.724038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb1e54d8-1158-4295-81db-2a379800a640 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:33.788829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cb1e54d8-1158-4295-81db-2a379800a640 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:33.793069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0aa2503b-3ed8-44d4-8b9b-f44b108c144f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:33.793730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0aa2503b-3ed8-44d4-8b9b-f44b108c144f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:33.797386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cb1e54d8-1158-4295-81db-2a379800a640 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087745 Aug 24 05:23:33.797976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1180/2251] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:33.800455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0aa2503b-3ed8-44d4-8b9b-f44b108c144f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:33.800935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0aa2503b-3ed8-44d4-8b9b-f44b108c144f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:33.801919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0aa2503b-3ed8-44d4-8b9b-f44b108c144f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:33.802624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0aa2503b-3ed8-44d4-8b9b-f44b108c144f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:33.803109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0aa2503b-3ed8-44d4-8b9b-f44b108c144f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:33.803531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0aa2503b-3ed8-44d4-8b9b-f44b108c144f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:33.868017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0aa2503b-3ed8-44d4-8b9b-f44b108c144f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:33.876361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0aa2503b-3ed8-44d4-8b9b-f44b108c144f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087067 Aug 24 05:23:33.876931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1072/2252] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:33 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:34.270106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b0cd4c1f-29c1-4dc7-9024-5c814becdb4f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:34.270768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b0cd4c1f-29c1-4dc7-9024-5c814becdb4f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:34.276767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0cd4c1f-29c1-4dc7-9024-5c814becdb4f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:34.277246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0cd4c1f-29c1-4dc7-9024-5c814becdb4f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:34.277674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0cd4c1f-29c1-4dc7-9024-5c814becdb4f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:34.278363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0cd4c1f-29c1-4dc7-9024-5c814becdb4f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:34.278840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0cd4c1f-29c1-4dc7-9024-5c814becdb4f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:34.279260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0cd4c1f-29c1-4dc7-9024-5c814becdb4f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:34.348514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b0cd4c1f-29c1-4dc7-9024-5c814becdb4f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:34.356959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b0cd4c1f-29c1-4dc7-9024-5c814becdb4f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090845 Aug 24 05:23:34.357534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1181/2253] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:34.820423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f6fe0b9b-1b74-4b06-bd2b-0ca8a8a86f0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:34.821013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f6fe0b9b-1b74-4b06-bd2b-0ca8a8a86f0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:34.827408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6fe0b9b-1b74-4b06-bd2b-0ca8a8a86f0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:34.827883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6fe0b9b-1b74-4b06-bd2b-0ca8a8a86f0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:34.828313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6fe0b9b-1b74-4b06-bd2b-0ca8a8a86f0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:34.828990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6fe0b9b-1b74-4b06-bd2b-0ca8a8a86f0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:34.829433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6fe0b9b-1b74-4b06-bd2b-0ca8a8a86f0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:34.829844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6fe0b9b-1b74-4b06-bd2b-0ca8a8a86f0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:34.894569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f6fe0b9b-1b74-4b06-bd2b-0ca8a8a86f0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:34.897950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b2cc746d-a7c9-4d1e-af53-306213174be9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:34.899160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b2cc746d-a7c9-4d1e-af53-306213174be9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:34.905200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2cc746d-a7c9-4d1e-af53-306213174be9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:34.905786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f6fe0b9b-1b74-4b06-bd2b-0ca8a8a86f0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089993 Aug 24 05:23:34.908564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2cc746d-a7c9-4d1e-af53-306213174be9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:34.910065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1073/2254] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:34 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:34.910253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2cc746d-a7c9-4d1e-af53-306213174be9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:34.910253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2cc746d-a7c9-4d1e-af53-306213174be9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:34.910253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2cc746d-a7c9-4d1e-af53-306213174be9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:34.910253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2cc746d-a7c9-4d1e-af53-306213174be9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:34.973700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b2cc746d-a7c9-4d1e-af53-306213174be9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:34.982937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b2cc746d-a7c9-4d1e-af53-306213174be9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089347 Aug 24 05:23:34.983521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1182/2255] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:35.378295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-44532d0c-e7bc-4234-862a-516bb0d5c37b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:35.378935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-44532d0c-e7bc-4234-862a-516bb0d5c37b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:35.385332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44532d0c-e7bc-4234-862a-516bb0d5c37b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:35.385812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44532d0c-e7bc-4234-862a-516bb0d5c37b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:35.386244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44532d0c-e7bc-4234-862a-516bb0d5c37b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:35.386958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44532d0c-e7bc-4234-862a-516bb0d5c37b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:35.387411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44532d0c-e7bc-4234-862a-516bb0d5c37b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:35.387831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44532d0c-e7bc-4234-862a-516bb0d5c37b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:35.454073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-44532d0c-e7bc-4234-862a-516bb0d5c37b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:35.463122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-44532d0c-e7bc-4234-862a-516bb0d5c37b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088700 Aug 24 05:23:35.463682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1074/2256] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:35.928182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5ff6b0b3-1849-4a8d-b067-43b79f6c20f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:35.928723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5ff6b0b3-1849-4a8d-b067-43b79f6c20f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:35.935612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff6b0b3-1849-4a8d-b067-43b79f6c20f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:35.936095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff6b0b3-1849-4a8d-b067-43b79f6c20f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:35.936534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff6b0b3-1849-4a8d-b067-43b79f6c20f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:35.937229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff6b0b3-1849-4a8d-b067-43b79f6c20f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:35.937683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff6b0b3-1849-4a8d-b067-43b79f6c20f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:35.938105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff6b0b3-1849-4a8d-b067-43b79f6c20f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:35.954969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:36.003584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ff6b0b3-1849-4a8d-b067-43b79f6c20f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:36.005632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c84896b5-1518-48c5-8ddb-79ab8c023021 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:36.006291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c84896b5-1518-48c5-8ddb-79ab8c023021 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:36.013937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5ff6b0b3-1849-4a8d-b067-43b79f6c20f9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089760 Aug 24 05:23:36.014174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c84896b5-1518-48c5-8ddb-79ab8c023021 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:36.014502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c84896b5-1518-48c5-8ddb-79ab8c023021 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:36.014621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1183/2257] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:36.014973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c84896b5-1518-48c5-8ddb-79ab8c023021 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:36.015676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c84896b5-1518-48c5-8ddb-79ab8c023021 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:36.016130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c84896b5-1518-48c5-8ddb-79ab8c023021 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:36.016553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c84896b5-1518-48c5-8ddb-79ab8c023021 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:36.083920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c84896b5-1518-48c5-8ddb-79ab8c023021 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:36.092308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c84896b5-1518-48c5-8ddb-79ab8c023021 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091712 Aug 24 05:23:36.092878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1075/2258] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:35 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:36.489534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4579090f-726a-427b-b1a0-5a87df1ea085 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:36.490148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4579090f-726a-427b-b1a0-5a87df1ea085 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:36.496176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4579090f-726a-427b-b1a0-5a87df1ea085 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:36.496655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4579090f-726a-427b-b1a0-5a87df1ea085 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:36.497090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4579090f-726a-427b-b1a0-5a87df1ea085 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:36.497777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4579090f-726a-427b-b1a0-5a87df1ea085 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:36.498224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4579090f-726a-427b-b1a0-5a87df1ea085 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:36.498649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4579090f-726a-427b-b1a0-5a87df1ea085 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:36.561258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4579090f-726a-427b-b1a0-5a87df1ea085 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:36.570576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4579090f-726a-427b-b1a0-5a87df1ea085 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085647 Aug 24 05:23:36.571188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1184/2259] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:37.042862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-085f8d55-2c82-4940-b6e3-83fffa40a65b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:37.043472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-085f8d55-2c82-4940-b6e3-83fffa40a65b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:37.049489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-085f8d55-2c82-4940-b6e3-83fffa40a65b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:37.049970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-085f8d55-2c82-4940-b6e3-83fffa40a65b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:37.050403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-085f8d55-2c82-4940-b6e3-83fffa40a65b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:37.051121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-085f8d55-2c82-4940-b6e3-83fffa40a65b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:37.051661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-085f8d55-2c82-4940-b6e3-83fffa40a65b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:37.052087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-085f8d55-2c82-4940-b6e3-83fffa40a65b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:37.113434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3d7f7952-cf14-40ce-9ce5-8f5214111bf2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:37.114037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3d7f7952-cf14-40ce-9ce5-8f5214111bf2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:37.117654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-085f8d55-2c82-4940-b6e3-83fffa40a65b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:37.126331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d7f7952-cf14-40ce-9ce5-8f5214111bf2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:37.127011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d7f7952-cf14-40ce-9ce5-8f5214111bf2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:37.127447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d7f7952-cf14-40ce-9ce5-8f5214111bf2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:37.128143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d7f7952-cf14-40ce-9ce5-8f5214111bf2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:37.128942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-085f8d55-2c82-4940-b6e3-83fffa40a65b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089993 Aug 24 05:23:37.129779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1076/2260] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:37.130086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d7f7952-cf14-40ce-9ce5-8f5214111bf2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:37.130544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3d7f7952-cf14-40ce-9ce5-8f5214111bf2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:37.200305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3d7f7952-cf14-40ce-9ce5-8f5214111bf2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:37.209851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3d7f7952-cf14-40ce-9ce5-8f5214111bf2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.100227 Aug 24 05:23:37.210423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1185/2261] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:37.592255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-258bac89-bbc9-42b9-8f84-1f1775687ecf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:37.592788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-258bac89-bbc9-42b9-8f84-1f1775687ecf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:37.599184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-258bac89-bbc9-42b9-8f84-1f1775687ecf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:37.599671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-258bac89-bbc9-42b9-8f84-1f1775687ecf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:37.600105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-258bac89-bbc9-42b9-8f84-1f1775687ecf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:37.600807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-258bac89-bbc9-42b9-8f84-1f1775687ecf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:37.601256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-258bac89-bbc9-42b9-8f84-1f1775687ecf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:37.601680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-258bac89-bbc9-42b9-8f84-1f1775687ecf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:37.664824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-258bac89-bbc9-42b9-8f84-1f1775687ecf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:37.673159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-258bac89-bbc9-42b9-8f84-1f1775687ecf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084855 Aug 24 05:23:37.673733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1077/2262] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:38.150261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a13af035-593a-4f0f-8e26-750c608c9330 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:38.150885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a13af035-593a-4f0f-8e26-750c608c9330 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:38.157298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a13af035-593a-4f0f-8e26-750c608c9330 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:38.157770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a13af035-593a-4f0f-8e26-750c608c9330 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:38.158195 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a13af035-593a-4f0f-8e26-750c608c9330 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:38.158900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a13af035-593a-4f0f-8e26-750c608c9330 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:38.159343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a13af035-593a-4f0f-8e26-750c608c9330 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:38.159792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a13af035-593a-4f0f-8e26-750c608c9330 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:38.223538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a13af035-593a-4f0f-8e26-750c608c9330 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:38.232410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a13af035-593a-4f0f-8e26-750c608c9330 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085879 Aug 24 05:23:38.232992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1186/2263] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:38.237535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a74033d9-a656-47a6-8329-b0e007bd3e13 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:38.238142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a74033d9-a656-47a6-8329-b0e007bd3e13 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:38.245074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a74033d9-a656-47a6-8329-b0e007bd3e13 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:38.245561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a74033d9-a656-47a6-8329-b0e007bd3e13 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:38.246023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a74033d9-a656-47a6-8329-b0e007bd3e13 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:38.246743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a74033d9-a656-47a6-8329-b0e007bd3e13 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:38.247200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a74033d9-a656-47a6-8329-b0e007bd3e13 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:38.247620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a74033d9-a656-47a6-8329-b0e007bd3e13 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:38.323587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a74033d9-a656-47a6-8329-b0e007bd3e13 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:38.331869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a74033d9-a656-47a6-8329-b0e007bd3e13 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.098360 Aug 24 05:23:38.332484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1078/2264] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:38.695687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-72e072b6-2cb6-4be4-bbb0-014b72569d7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:38.696309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-72e072b6-2cb6-4be4-bbb0-014b72569d7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:38.702441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72e072b6-2cb6-4be4-bbb0-014b72569d7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:38.702970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72e072b6-2cb6-4be4-bbb0-014b72569d7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:38.703416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72e072b6-2cb6-4be4-bbb0-014b72569d7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:38.704109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72e072b6-2cb6-4be4-bbb0-014b72569d7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:38.704577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72e072b6-2cb6-4be4-bbb0-014b72569d7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:38.705095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72e072b6-2cb6-4be4-bbb0-014b72569d7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:38.768616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-72e072b6-2cb6-4be4-bbb0-014b72569d7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:38.778232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-72e072b6-2cb6-4be4-bbb0-014b72569d7e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087364 Aug 24 05:23:38.778836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1187/2265] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:39.256854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c0dedcfc-65d1-4924-9033-25b0073c5c87 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:39.257464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c0dedcfc-65d1-4924-9033-25b0073c5c87 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:39.264114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0dedcfc-65d1-4924-9033-25b0073c5c87 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:39.264598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0dedcfc-65d1-4924-9033-25b0073c5c87 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:39.265033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0dedcfc-65d1-4924-9033-25b0073c5c87 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:39.265730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0dedcfc-65d1-4924-9033-25b0073c5c87 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:39.266180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0dedcfc-65d1-4924-9033-25b0073c5c87 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:39.266601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c0dedcfc-65d1-4924-9033-25b0073c5c87 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:39.333409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c0dedcfc-65d1-4924-9033-25b0073c5c87 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:39.341797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c0dedcfc-65d1-4924-9033-25b0073c5c87 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090960 Aug 24 05:23:39.342369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1079/2266] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:39.353094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9f3e04f0-a3ef-44a8-8020-962ceb3c53c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:39.353889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9f3e04f0-a3ef-44a8-8020-962ceb3c53c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:39.360467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f3e04f0-a3ef-44a8-8020-962ceb3c53c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:39.360946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f3e04f0-a3ef-44a8-8020-962ceb3c53c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:39.361387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f3e04f0-a3ef-44a8-8020-962ceb3c53c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:39.362105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f3e04f0-a3ef-44a8-8020-962ceb3c53c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:39.362553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f3e04f0-a3ef-44a8-8020-962ceb3c53c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:39.363005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9f3e04f0-a3ef-44a8-8020-962ceb3c53c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:39.427595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9f3e04f0-a3ef-44a8-8020-962ceb3c53c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:39.436966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9f3e04f0-a3ef-44a8-8020-962ceb3c53c5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087955 Aug 24 05:23:39.437545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1188/2267] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:39.798663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0cf898a1-c8c6-4269-8252-aacb397bea8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:39.799302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0cf898a1-c8c6-4269-8252-aacb397bea8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:39.805812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf898a1-c8c6-4269-8252-aacb397bea8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:39.806292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf898a1-c8c6-4269-8252-aacb397bea8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:39.806753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf898a1-c8c6-4269-8252-aacb397bea8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:39.807453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf898a1-c8c6-4269-8252-aacb397bea8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:39.807904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf898a1-c8c6-4269-8252-aacb397bea8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:39.808321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0cf898a1-c8c6-4269-8252-aacb397bea8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:39.874528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0cf898a1-c8c6-4269-8252-aacb397bea8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:39.882914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0cf898a1-c8c6-4269-8252-aacb397bea8f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088105 Aug 24 05:23:39.883489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1080/2268] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:40.363055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a8a0e24e-58c2-4b1e-9f03-a7e50115dec3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:40.363865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a8a0e24e-58c2-4b1e-9f03-a7e50115dec3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:40.370573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8a0e24e-58c2-4b1e-9f03-a7e50115dec3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:40.371088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8a0e24e-58c2-4b1e-9f03-a7e50115dec3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:40.371525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8a0e24e-58c2-4b1e-9f03-a7e50115dec3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:40.372217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8a0e24e-58c2-4b1e-9f03-a7e50115dec3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:40.372669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8a0e24e-58c2-4b1e-9f03-a7e50115dec3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:40.373092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8a0e24e-58c2-4b1e-9f03-a7e50115dec3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:40.442872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a8a0e24e-58c2-4b1e-9f03-a7e50115dec3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:40.451409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a8a0e24e-58c2-4b1e-9f03-a7e50115dec3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092263 Aug 24 05:23:40.451990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1189/2269] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:40.462122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f53ce332-b9f6-409a-9600-9c4c485c9e6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:40.463312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f53ce332-b9f6-409a-9600-9c4c485c9e6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:40.475640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f53ce332-b9f6-409a-9600-9c4c485c9e6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:40.476497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f53ce332-b9f6-409a-9600-9c4c485c9e6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:40.477294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f53ce332-b9f6-409a-9600-9c4c485c9e6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:40.478575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f53ce332-b9f6-409a-9600-9c4c485c9e6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:40.479414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f53ce332-b9f6-409a-9600-9c4c485c9e6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:40.479898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f53ce332-b9f6-409a-9600-9c4c485c9e6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:40.548232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f53ce332-b9f6-409a-9600-9c4c485c9e6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:40.550421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:40.558525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f53ce332-b9f6-409a-9600-9c4c485c9e6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.104475 Aug 24 05:23:40.559161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1081/2270] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:40.904272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-219d501c-87a3-4f6f-8695-5ef963814c1d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:40.904886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-219d501c-87a3-4f6f-8695-5ef963814c1d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:40.911792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-219d501c-87a3-4f6f-8695-5ef963814c1d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:40.912279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-219d501c-87a3-4f6f-8695-5ef963814c1d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:40.912719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-219d501c-87a3-4f6f-8695-5ef963814c1d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:40.913411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-219d501c-87a3-4f6f-8695-5ef963814c1d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:40.913863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-219d501c-87a3-4f6f-8695-5ef963814c1d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:40.914285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-219d501c-87a3-4f6f-8695-5ef963814c1d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:40.977399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-219d501c-87a3-4f6f-8695-5ef963814c1d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:40.985954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-219d501c-87a3-4f6f-8695-5ef963814c1d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085424 Aug 24 05:23:40.986468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1190/2271] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:41.487161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8f2d2bf8-99bd-4eb6-b2f0-35854e6f4fac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:41.487777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8f2d2bf8-99bd-4eb6-b2f0-35854e6f4fac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:41.494977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f2d2bf8-99bd-4eb6-b2f0-35854e6f4fac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:41.495460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f2d2bf8-99bd-4eb6-b2f0-35854e6f4fac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:41.495894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f2d2bf8-99bd-4eb6-b2f0-35854e6f4fac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:41.496583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f2d2bf8-99bd-4eb6-b2f0-35854e6f4fac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:41.497033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f2d2bf8-99bd-4eb6-b2f0-35854e6f4fac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:41.497453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f2d2bf8-99bd-4eb6-b2f0-35854e6f4fac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:41.564135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8f2d2bf8-99bd-4eb6-b2f0-35854e6f4fac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:41.572741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8f2d2bf8-99bd-4eb6-b2f0-35854e6f4fac tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089331 Aug 24 05:23:41.573261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1082/2272] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:41 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:41.579366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9decd733-73a7-4097-8324-8af67b976904 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:41.580010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9decd733-73a7-4097-8324-8af67b976904 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:41.587352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9decd733-73a7-4097-8324-8af67b976904 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:41.587834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9decd733-73a7-4097-8324-8af67b976904 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:41.588271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9decd733-73a7-4097-8324-8af67b976904 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:41.588959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9decd733-73a7-4097-8324-8af67b976904 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:41.589407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9decd733-73a7-4097-8324-8af67b976904 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:41.589830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9decd733-73a7-4097-8324-8af67b976904 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:41.655727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9decd733-73a7-4097-8324-8af67b976904 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:41.664927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9decd733-73a7-4097-8324-8af67b976904 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089349 Aug 24 05:23:41.665511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1191/2273] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:42.006516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-80f31658-4fc9-4198-98e2-34e64e317753 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:42.007156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-80f31658-4fc9-4198-98e2-34e64e317753 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:42.014644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f31658-4fc9-4198-98e2-34e64e317753 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:42.015138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f31658-4fc9-4198-98e2-34e64e317753 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:42.016276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f31658-4fc9-4198-98e2-34e64e317753 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:42.016981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f31658-4fc9-4198-98e2-34e64e317753 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:42.017436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f31658-4fc9-4198-98e2-34e64e317753 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:42.017859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80f31658-4fc9-4198-98e2-34e64e317753 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:42.085356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-80f31658-4fc9-4198-98e2-34e64e317753 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:42.093669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-80f31658-4fc9-4198-98e2-34e64e317753 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091078 Aug 24 05:23:42.094231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1083/2274] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:42.593521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e160b3ba-39bf-4382-a8cd-89ec8b37a878 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:42.594156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e160b3ba-39bf-4382-a8cd-89ec8b37a878 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:42.601410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e160b3ba-39bf-4382-a8cd-89ec8b37a878 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:42.601890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e160b3ba-39bf-4382-a8cd-89ec8b37a878 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:42.602322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e160b3ba-39bf-4382-a8cd-89ec8b37a878 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:42.603036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e160b3ba-39bf-4382-a8cd-89ec8b37a878 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:42.603487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e160b3ba-39bf-4382-a8cd-89ec8b37a878 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:42.603911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e160b3ba-39bf-4382-a8cd-89ec8b37a878 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:42.667883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e160b3ba-39bf-4382-a8cd-89ec8b37a878 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:42.676631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e160b3ba-39bf-4382-a8cd-89ec8b37a878 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086454 Aug 24 05:23:42.677547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1192/2275] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:42.686221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a4a5fb88-404d-4f71-8500-347c9546891a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:42.686857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a4a5fb88-404d-4f71-8500-347c9546891a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:42.694211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a5fb88-404d-4f71-8500-347c9546891a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:42.694712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a5fb88-404d-4f71-8500-347c9546891a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:42.695162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a5fb88-404d-4f71-8500-347c9546891a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:42.695887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a5fb88-404d-4f71-8500-347c9546891a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:42.696341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a5fb88-404d-4f71-8500-347c9546891a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:42.696762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a4a5fb88-404d-4f71-8500-347c9546891a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:42.761239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a4a5fb88-404d-4f71-8500-347c9546891a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:42.770295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a4a5fb88-404d-4f71-8500-347c9546891a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087341 Aug 24 05:23:42.770927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1084/2276] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:43.114301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-59e3f353-64fb-4643-b030-2218a948eb9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:43.114970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-59e3f353-64fb-4643-b030-2218a948eb9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:43.121085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59e3f353-64fb-4643-b030-2218a948eb9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:43.121569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59e3f353-64fb-4643-b030-2218a948eb9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:43.122014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59e3f353-64fb-4643-b030-2218a948eb9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:43.122717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59e3f353-64fb-4643-b030-2218a948eb9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:43.123203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59e3f353-64fb-4643-b030-2218a948eb9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:43.123603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59e3f353-64fb-4643-b030-2218a948eb9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:43.191285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-59e3f353-64fb-4643-b030-2218a948eb9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:43.199904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-59e3f353-64fb-4643-b030-2218a948eb9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090212 Aug 24 05:23:43.200479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1193/2277] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:43.698776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d29ba5cf-13c9-48b3-8523-1f0e1dd0aaa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:43.699386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d29ba5cf-13c9-48b3-8523-1f0e1dd0aaa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:43.706077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d29ba5cf-13c9-48b3-8523-1f0e1dd0aaa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:43.706568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d29ba5cf-13c9-48b3-8523-1f0e1dd0aaa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:43.707831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d29ba5cf-13c9-48b3-8523-1f0e1dd0aaa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:43.708714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d29ba5cf-13c9-48b3-8523-1f0e1dd0aaa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:43.709183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d29ba5cf-13c9-48b3-8523-1f0e1dd0aaa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:43.709610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d29ba5cf-13c9-48b3-8523-1f0e1dd0aaa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:43.778259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d29ba5cf-13c9-48b3-8523-1f0e1dd0aaa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:43.787728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d29ba5cf-13c9-48b3-8523-1f0e1dd0aaa8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092885 Aug 24 05:23:43.788307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1085/2278] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:43.791616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e4752238-1899-4aff-aa64-81675df50593 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:43.792224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e4752238-1899-4aff-aa64-81675df50593 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:43.798892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4752238-1899-4aff-aa64-81675df50593 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:43.799367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4752238-1899-4aff-aa64-81675df50593 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:43.799794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4752238-1899-4aff-aa64-81675df50593 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:43.800479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4752238-1899-4aff-aa64-81675df50593 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:43.801698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4752238-1899-4aff-aa64-81675df50593 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:43.802624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e4752238-1899-4aff-aa64-81675df50593 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:43.868686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e4752238-1899-4aff-aa64-81675df50593 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:43.877121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e4752238-1899-4aff-aa64-81675df50593 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089389 Aug 24 05:23:43.877701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1194/2279] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:43 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:44.221016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-438e9440-e645-4325-aa28-c913a67d6bd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:44.222161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-438e9440-e645-4325-aa28-c913a67d6bd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:44.228616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438e9440-e645-4325-aa28-c913a67d6bd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:44.229097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438e9440-e645-4325-aa28-c913a67d6bd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:44.229532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438e9440-e645-4325-aa28-c913a67d6bd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:44.230225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438e9440-e645-4325-aa28-c913a67d6bd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:44.230676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438e9440-e645-4325-aa28-c913a67d6bd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:44.231119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438e9440-e645-4325-aa28-c913a67d6bd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:44.296350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-438e9440-e645-4325-aa28-c913a67d6bd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:44.306009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-438e9440-e645-4325-aa28-c913a67d6bd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088812 Aug 24 05:23:44.306588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1086/2280] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:44.807920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3f727012-eb08-45ef-a493-bfddc7e1ab2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:44.808533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3f727012-eb08-45ef-a493-bfddc7e1ab2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:44.815085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f727012-eb08-45ef-a493-bfddc7e1ab2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:44.815562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f727012-eb08-45ef-a493-bfddc7e1ab2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:44.815992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f727012-eb08-45ef-a493-bfddc7e1ab2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:44.816688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f727012-eb08-45ef-a493-bfddc7e1ab2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:44.817137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f727012-eb08-45ef-a493-bfddc7e1ab2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:44.817553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f727012-eb08-45ef-a493-bfddc7e1ab2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:44.880868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3f727012-eb08-45ef-a493-bfddc7e1ab2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:44.890248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3f727012-eb08-45ef-a493-bfddc7e1ab2c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085730 Aug 24 05:23:44.890248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1195/2281] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:44.898123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3845ab45-2dea-45c1-9120-0438ec7cb9bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:44.898771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3845ab45-2dea-45c1-9120-0438ec7cb9bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:44.901129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=82 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:44.906855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3845ab45-2dea-45c1-9120-0438ec7cb9bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:44.907265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3845ab45-2dea-45c1-9120-0438ec7cb9bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:44.907698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3845ab45-2dea-45c1-9120-0438ec7cb9bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:44.908423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3845ab45-2dea-45c1-9120-0438ec7cb9bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:44.908880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3845ab45-2dea-45c1-9120-0438ec7cb9bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:44.909303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3845ab45-2dea-45c1-9120-0438ec7cb9bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:44.975836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3845ab45-2dea-45c1-9120-0438ec7cb9bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:44.984285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3845ab45-2dea-45c1-9120-0438ec7cb9bd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090678 Aug 24 05:23:44.984854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1087/2282] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:45.328730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5dacf97b-41af-4443-8d9e-fc0d8042fc76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:45.329333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5dacf97b-41af-4443-8d9e-fc0d8042fc76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:45.336072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacf97b-41af-4443-8d9e-fc0d8042fc76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:45.336552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacf97b-41af-4443-8d9e-fc0d8042fc76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:45.336985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacf97b-41af-4443-8d9e-fc0d8042fc76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:45.337699 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacf97b-41af-4443-8d9e-fc0d8042fc76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:45.338149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacf97b-41af-4443-8d9e-fc0d8042fc76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:45.338567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacf97b-41af-4443-8d9e-fc0d8042fc76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:45.407870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5dacf97b-41af-4443-8d9e-fc0d8042fc76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:45.416709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5dacf97b-41af-4443-8d9e-fc0d8042fc76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.092034 Aug 24 05:23:45.417301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1196/2283] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:45.912137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-31f73e5c-2e7b-4e31-b591-595397570c3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:45.912736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-31f73e5c-2e7b-4e31-b591-595397570c3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:45.919439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f73e5c-2e7b-4e31-b591-595397570c3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:45.919921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f73e5c-2e7b-4e31-b591-595397570c3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:45.920360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f73e5c-2e7b-4e31-b591-595397570c3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:45.921056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f73e5c-2e7b-4e31-b591-595397570c3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:45.921507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f73e5c-2e7b-4e31-b591-595397570c3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:45.921928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-31f73e5c-2e7b-4e31-b591-595397570c3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:45.986498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-31f73e5c-2e7b-4e31-b591-595397570c3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:45.996356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-31f73e5c-2e7b-4e31-b591-595397570c3d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087483 Aug 24 05:23:45.996356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1088/2284] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:46.007017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5ee96dbb-f609-42fb-a062-777ffadb0f87 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:46.007664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5ee96dbb-f609-42fb-a062-777ffadb0f87 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:46.013726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee96dbb-f609-42fb-a062-777ffadb0f87 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:46.014215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee96dbb-f609-42fb-a062-777ffadb0f87 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:46.014654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee96dbb-f609-42fb-a062-777ffadb0f87 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:46.015367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee96dbb-f609-42fb-a062-777ffadb0f87 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:46.015817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee96dbb-f609-42fb-a062-777ffadb0f87 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:46.016239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee96dbb-f609-42fb-a062-777ffadb0f87 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:46.081472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ee96dbb-f609-42fb-a062-777ffadb0f87 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:46.090593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5ee96dbb-f609-42fb-a062-777ffadb0f87 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088770 Aug 24 05:23:46.091199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1197/2285] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:46.439365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7fbae4f7-aff6-4ab8-8f8d-70bc1f2308b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:46.439889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7fbae4f7-aff6-4ab8-8f8d-70bc1f2308b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:46.447009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fbae4f7-aff6-4ab8-8f8d-70bc1f2308b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:46.447490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fbae4f7-aff6-4ab8-8f8d-70bc1f2308b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:46.447917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fbae4f7-aff6-4ab8-8f8d-70bc1f2308b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:46.448603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fbae4f7-aff6-4ab8-8f8d-70bc1f2308b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:46.449047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fbae4f7-aff6-4ab8-8f8d-70bc1f2308b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:46.449460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7fbae4f7-aff6-4ab8-8f8d-70bc1f2308b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:46.513060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7fbae4f7-aff6-4ab8-8f8d-70bc1f2308b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:46.522365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7fbae4f7-aff6-4ab8-8f8d-70bc1f2308b4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086863 Aug 24 05:23:46.522987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1089/2286] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:47.017577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b634b813-a000-4145-9d23-d29aee726763 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:47.018147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b634b813-a000-4145-9d23-d29aee726763 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:47.025478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b634b813-a000-4145-9d23-d29aee726763 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:47.025959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b634b813-a000-4145-9d23-d29aee726763 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:47.026395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b634b813-a000-4145-9d23-d29aee726763 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:47.027117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b634b813-a000-4145-9d23-d29aee726763 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:47.027565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b634b813-a000-4145-9d23-d29aee726763 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:47.027986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b634b813-a000-4145-9d23-d29aee726763 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:47.091870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b634b813-a000-4145-9d23-d29aee726763 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:47.101096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b634b813-a000-4145-9d23-d29aee726763 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087432 Aug 24 05:23:47.101794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1198/2287] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:47.113920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3dd1213a-7bef-47ce-9689-6fe0a091f0fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:47.114789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3dd1213a-7bef-47ce-9689-6fe0a091f0fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:47.121291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3dd1213a-7bef-47ce-9689-6fe0a091f0fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:47.121770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3dd1213a-7bef-47ce-9689-6fe0a091f0fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:47.122205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3dd1213a-7bef-47ce-9689-6fe0a091f0fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:47.122936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3dd1213a-7bef-47ce-9689-6fe0a091f0fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:47.123396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3dd1213a-7bef-47ce-9689-6fe0a091f0fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:47.123814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3dd1213a-7bef-47ce-9689-6fe0a091f0fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:47.192782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3dd1213a-7bef-47ce-9689-6fe0a091f0fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:47.201375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3dd1213a-7bef-47ce-9689-6fe0a091f0fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091905 Aug 24 05:23:47.201957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1090/2288] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:47.543884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-65574096-6c32-47ed-abce-04e9b87aea20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:47.544492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-65574096-6c32-47ed-abce-04e9b87aea20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:47.550565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65574096-6c32-47ed-abce-04e9b87aea20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:47.551725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65574096-6c32-47ed-abce-04e9b87aea20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:47.552270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65574096-6c32-47ed-abce-04e9b87aea20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:47.552964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65574096-6c32-47ed-abce-04e9b87aea20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:47.553419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65574096-6c32-47ed-abce-04e9b87aea20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:47.553841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-65574096-6c32-47ed-abce-04e9b87aea20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:47.616473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-65574096-6c32-47ed-abce-04e9b87aea20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:47.624826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-65574096-6c32-47ed-abce-04e9b87aea20 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084762 Aug 24 05:23:47.625401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1199/2289] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:48.122447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-efcc7830-68cd-4456-a48f-495a10a804b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:48.123076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-efcc7830-68cd-4456-a48f-495a10a804b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:48.130595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efcc7830-68cd-4456-a48f-495a10a804b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:48.131099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efcc7830-68cd-4456-a48f-495a10a804b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:48.131531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efcc7830-68cd-4456-a48f-495a10a804b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:48.132221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efcc7830-68cd-4456-a48f-495a10a804b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:48.132667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efcc7830-68cd-4456-a48f-495a10a804b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:48.133087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-efcc7830-68cd-4456-a48f-495a10a804b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:48.196910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-efcc7830-68cd-4456-a48f-495a10a804b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:48.205179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-efcc7830-68cd-4456-a48f-495a10a804b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086675 Aug 24 05:23:48.205754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1091/2290] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:48.221479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2fb35ccc-84a9-410f-b8e7-8e69f38729f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:48.222129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2fb35ccc-84a9-410f-b8e7-8e69f38729f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:48.228734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fb35ccc-84a9-410f-b8e7-8e69f38729f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:48.229208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fb35ccc-84a9-410f-b8e7-8e69f38729f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:48.229636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fb35ccc-84a9-410f-b8e7-8e69f38729f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:48.230319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fb35ccc-84a9-410f-b8e7-8e69f38729f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:48.230787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fb35ccc-84a9-410f-b8e7-8e69f38729f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:48.231204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fb35ccc-84a9-410f-b8e7-8e69f38729f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:48.233914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:48.297076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2fb35ccc-84a9-410f-b8e7-8e69f38729f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:48.305942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2fb35ccc-84a9-410f-b8e7-8e69f38729f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088402 Aug 24 05:23:48.306517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1200/2291] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:48.647172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ad92e5bb-bb09-4825-b08c-20f4635a936d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:48.647773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ad92e5bb-bb09-4825-b08c-20f4635a936d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:48.653828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad92e5bb-bb09-4825-b08c-20f4635a936d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:48.654304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad92e5bb-bb09-4825-b08c-20f4635a936d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:48.654756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad92e5bb-bb09-4825-b08c-20f4635a936d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:48.655437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad92e5bb-bb09-4825-b08c-20f4635a936d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:48.655881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad92e5bb-bb09-4825-b08c-20f4635a936d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:48.656301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ad92e5bb-bb09-4825-b08c-20f4635a936d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:48.720797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ad92e5bb-bb09-4825-b08c-20f4635a936d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:48.730751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ad92e5bb-bb09-4825-b08c-20f4635a936d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088202 Aug 24 05:23:48.731353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1092/2292] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:49.227013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f51dc17-4160-4e82-aac2-8a905165c0ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:49.227653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1f51dc17-4160-4e82-aac2-8a905165c0ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:49.234119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f51dc17-4160-4e82-aac2-8a905165c0ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:49.234594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f51dc17-4160-4e82-aac2-8a905165c0ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:49.235049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f51dc17-4160-4e82-aac2-8a905165c0ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:49.235729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f51dc17-4160-4e82-aac2-8a905165c0ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:49.236170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f51dc17-4160-4e82-aac2-8a905165c0ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:49.236585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f51dc17-4160-4e82-aac2-8a905165c0ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:49.303232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1f51dc17-4160-4e82-aac2-8a905165c0ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:49.312072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1f51dc17-4160-4e82-aac2-8a905165c0ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089437 Aug 24 05:23:49.312647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1201/2293] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:49.327963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e746789e-69b9-4855-8c0e-47c0900dee68 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:49.328616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e746789e-69b9-4855-8c0e-47c0900dee68 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:49.335168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e746789e-69b9-4855-8c0e-47c0900dee68 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:49.335647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e746789e-69b9-4855-8c0e-47c0900dee68 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:49.336082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e746789e-69b9-4855-8c0e-47c0900dee68 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:49.336758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e746789e-69b9-4855-8c0e-47c0900dee68 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:49.337209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e746789e-69b9-4855-8c0e-47c0900dee68 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:49.337624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e746789e-69b9-4855-8c0e-47c0900dee68 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:49.404763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e746789e-69b9-4855-8c0e-47c0900dee68 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:49.413936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e746789e-69b9-4855-8c0e-47c0900dee68 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089913 Aug 24 05:23:49.414843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1093/2294] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:49.751175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-93ecb717-903f-406c-bc1d-e1fbc11b9ff9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:49.751794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-93ecb717-903f-406c-bc1d-e1fbc11b9ff9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:49.761731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93ecb717-903f-406c-bc1d-e1fbc11b9ff9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:49.762203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93ecb717-903f-406c-bc1d-e1fbc11b9ff9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:49.762638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93ecb717-903f-406c-bc1d-e1fbc11b9ff9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:49.763362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93ecb717-903f-406c-bc1d-e1fbc11b9ff9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:49.763841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93ecb717-903f-406c-bc1d-e1fbc11b9ff9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:49.764269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-93ecb717-903f-406c-bc1d-e1fbc11b9ff9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:49.827909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-93ecb717-903f-406c-bc1d-e1fbc11b9ff9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:49.837054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-93ecb717-903f-406c-bc1d-e1fbc11b9ff9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089793 Aug 24 05:23:49.837645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1202/2295] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:50.333790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6a3e5c45-0e65-4349-9262-8ba182f4b815 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:50.334655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6a3e5c45-0e65-4349-9262-8ba182f4b815 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:50.341270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a3e5c45-0e65-4349-9262-8ba182f4b815 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:50.341756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a3e5c45-0e65-4349-9262-8ba182f4b815 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:50.342191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a3e5c45-0e65-4349-9262-8ba182f4b815 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:50.342949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a3e5c45-0e65-4349-9262-8ba182f4b815 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:50.345014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a3e5c45-0e65-4349-9262-8ba182f4b815 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:50.345014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a3e5c45-0e65-4349-9262-8ba182f4b815 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:50.414374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6a3e5c45-0e65-4349-9262-8ba182f4b815 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:50.423054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6a3e5c45-0e65-4349-9262-8ba182f4b815 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093836 Aug 24 05:23:50.423629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1094/2296] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:50.437280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7b23c8ee-9cfb-402e-806e-b4e869f2ef75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:50.437913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7b23c8ee-9cfb-402e-806e-b4e869f2ef75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:50.440299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=82 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:50.446439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b23c8ee-9cfb-402e-806e-b4e869f2ef75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:50.446942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b23c8ee-9cfb-402e-806e-b4e869f2ef75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:50.447372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b23c8ee-9cfb-402e-806e-b4e869f2ef75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:50.448056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b23c8ee-9cfb-402e-806e-b4e869f2ef75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:50.448497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b23c8ee-9cfb-402e-806e-b4e869f2ef75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:50.448910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b23c8ee-9cfb-402e-806e-b4e869f2ef75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:50.514802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7b23c8ee-9cfb-402e-806e-b4e869f2ef75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:50.524463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7b23c8ee-9cfb-402e-806e-b4e869f2ef75 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090980 Aug 24 05:23:50.525046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1203/2297] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:50.857753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6ea3e73d-9147-454e-bacb-8a8e288aabb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:50.858409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6ea3e73d-9147-454e-bacb-8a8e288aabb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:50.865106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea3e73d-9147-454e-bacb-8a8e288aabb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:50.865584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea3e73d-9147-454e-bacb-8a8e288aabb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:50.866013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea3e73d-9147-454e-bacb-8a8e288aabb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:50.866718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea3e73d-9147-454e-bacb-8a8e288aabb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:50.867173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea3e73d-9147-454e-bacb-8a8e288aabb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:50.867589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea3e73d-9147-454e-bacb-8a8e288aabb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:50.932340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6ea3e73d-9147-454e-bacb-8a8e288aabb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:50.940733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6ea3e73d-9147-454e-bacb-8a8e288aabb0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086802 Aug 24 05:23:50.941929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1095/2298] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:51.446153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fe1bb466-8459-448f-ae2c-3473eecf1b3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:51.446908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fe1bb466-8459-448f-ae2c-3473eecf1b3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:51.454392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe1bb466-8459-448f-ae2c-3473eecf1b3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:51.454929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe1bb466-8459-448f-ae2c-3473eecf1b3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:51.455370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe1bb466-8459-448f-ae2c-3473eecf1b3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:51.456065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe1bb466-8459-448f-ae2c-3473eecf1b3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:51.456515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe1bb466-8459-448f-ae2c-3473eecf1b3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:51.457524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe1bb466-8459-448f-ae2c-3473eecf1b3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:51.522931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fe1bb466-8459-448f-ae2c-3473eecf1b3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:51.531385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fe1bb466-8459-448f-ae2c-3473eecf1b3a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090904 Aug 24 05:23:51.531959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1204/2299] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:51.545158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fc68fba8-0d31-4350-a350-22bd34c65422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:51.545771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fc68fba8-0d31-4350-a350-22bd34c65422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:51.552383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc68fba8-0d31-4350-a350-22bd34c65422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:51.552863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc68fba8-0d31-4350-a350-22bd34c65422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:51.553300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc68fba8-0d31-4350-a350-22bd34c65422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:51.553993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc68fba8-0d31-4350-a350-22bd34c65422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:51.554446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc68fba8-0d31-4350-a350-22bd34c65422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:51.554901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc68fba8-0d31-4350-a350-22bd34c65422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:51.619455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fc68fba8-0d31-4350-a350-22bd34c65422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:51.627821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fc68fba8-0d31-4350-a350-22bd34c65422 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086464 Aug 24 05:23:51.628396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1096/2300] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:51.962958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3f5a22fd-9932-449e-834c-fd040183545c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:51.963565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3f5a22fd-9932-449e-834c-fd040183545c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:51.970403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f5a22fd-9932-449e-834c-fd040183545c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:51.970966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f5a22fd-9932-449e-834c-fd040183545c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:51.971399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f5a22fd-9932-449e-834c-fd040183545c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:51.972095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f5a22fd-9932-449e-834c-fd040183545c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:51.973159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f5a22fd-9932-449e-834c-fd040183545c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:51.973650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f5a22fd-9932-449e-834c-fd040183545c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:52.039968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3f5a22fd-9932-449e-834c-fd040183545c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:52.049180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3f5a22fd-9932-449e-834c-fd040183545c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090614 Aug 24 05:23:52.049984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1205/2301] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:52.553214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b6fce01b-ed5d-4ff2-a354-b99a42701e35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:52.553819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b6fce01b-ed5d-4ff2-a354-b99a42701e35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:52.561676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6fce01b-ed5d-4ff2-a354-b99a42701e35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:52.562180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6fce01b-ed5d-4ff2-a354-b99a42701e35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:52.562588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6fce01b-ed5d-4ff2-a354-b99a42701e35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:52.563437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6fce01b-ed5d-4ff2-a354-b99a42701e35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:52.563883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6fce01b-ed5d-4ff2-a354-b99a42701e35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:52.564460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b6fce01b-ed5d-4ff2-a354-b99a42701e35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:52.629404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b6fce01b-ed5d-4ff2-a354-b99a42701e35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:52.638007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b6fce01b-ed5d-4ff2-a354-b99a42701e35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088890 Aug 24 05:23:52.638586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1097/2302] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:52.649583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a2307a35-8ba7-4a0c-9e1b-ba89510abb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:52.650353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a2307a35-8ba7-4a0c-9e1b-ba89510abb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:52.656903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2307a35-8ba7-4a0c-9e1b-ba89510abb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:52.657388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2307a35-8ba7-4a0c-9e1b-ba89510abb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:52.657816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2307a35-8ba7-4a0c-9e1b-ba89510abb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:52.658500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2307a35-8ba7-4a0c-9e1b-ba89510abb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:52.658971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2307a35-8ba7-4a0c-9e1b-ba89510abb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:52.659390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a2307a35-8ba7-4a0c-9e1b-ba89510abb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:52.722736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a2307a35-8ba7-4a0c-9e1b-ba89510abb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:52.731252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a2307a35-8ba7-4a0c-9e1b-ba89510abb70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086462 Aug 24 05:23:52.731852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1206/2303] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:53.072675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2e193ad5-cc12-47ab-8771-2a4502498e14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:53.073287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2e193ad5-cc12-47ab-8771-2a4502498e14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:53.079516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e193ad5-cc12-47ab-8771-2a4502498e14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:53.080003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e193ad5-cc12-47ab-8771-2a4502498e14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:53.080442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e193ad5-cc12-47ab-8771-2a4502498e14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:53.081153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e193ad5-cc12-47ab-8771-2a4502498e14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:53.081617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e193ad5-cc12-47ab-8771-2a4502498e14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:53.082138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e193ad5-cc12-47ab-8771-2a4502498e14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:53.098209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:23:53.152709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2e193ad5-cc12-47ab-8771-2a4502498e14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:53.164778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2e193ad5-cc12-47ab-8771-2a4502498e14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.095405 Aug 24 05:23:53.167079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1098/2304] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:53.659231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8eb971af-fddc-4165-b16c-520fd214c7aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:53.659802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8eb971af-fddc-4165-b16c-520fd214c7aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:53.666847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eb971af-fddc-4165-b16c-520fd214c7aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:53.667690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eb971af-fddc-4165-b16c-520fd214c7aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:53.668461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eb971af-fddc-4165-b16c-520fd214c7aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:53.669535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eb971af-fddc-4165-b16c-520fd214c7aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:53.670228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eb971af-fddc-4165-b16c-520fd214c7aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:53.670906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eb971af-fddc-4165-b16c-520fd214c7aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:53.739237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8eb971af-fddc-4165-b16c-520fd214c7aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:53.747763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8eb971af-fddc-4165-b16c-520fd214c7aa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092375 Aug 24 05:23:53.749644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1207/2305] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:53.755516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6d6a03f0-470c-447b-b661-0b3b0ac2ab22 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:53.756140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6d6a03f0-470c-447b-b661-0b3b0ac2ab22 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:53.762879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d6a03f0-470c-447b-b661-0b3b0ac2ab22 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:53.763365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d6a03f0-470c-447b-b661-0b3b0ac2ab22 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:53.763802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d6a03f0-470c-447b-b661-0b3b0ac2ab22 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:53.764489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d6a03f0-470c-447b-b661-0b3b0ac2ab22 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:53.764940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d6a03f0-470c-447b-b661-0b3b0ac2ab22 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:53.765359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d6a03f0-470c-447b-b661-0b3b0ac2ab22 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:53.828687 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6d6a03f0-470c-447b-b661-0b3b0ac2ab22 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:53.837840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6d6a03f0-470c-447b-b661-0b3b0ac2ab22 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089067 Aug 24 05:23:53.838421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1099/2306] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:54.188280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f97dabbe-7d9d-46d9-be80-02a85507f49a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:54.188883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f97dabbe-7d9d-46d9-be80-02a85507f49a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:54.195399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f97dabbe-7d9d-46d9-be80-02a85507f49a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:54.195873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f97dabbe-7d9d-46d9-be80-02a85507f49a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:54.196300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f97dabbe-7d9d-46d9-be80-02a85507f49a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:54.196979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f97dabbe-7d9d-46d9-be80-02a85507f49a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:54.197420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f97dabbe-7d9d-46d9-be80-02a85507f49a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:54.197831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f97dabbe-7d9d-46d9-be80-02a85507f49a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:54.261115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f97dabbe-7d9d-46d9-be80-02a85507f49a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:54.269676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f97dabbe-7d9d-46d9-be80-02a85507f49a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084920 Aug 24 05:23:54.270255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1208/2307] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:54.771174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d78072b5-6670-4ecc-86fa-4a954f637853 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:54.771985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d78072b5-6670-4ecc-86fa-4a954f637853 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:54.778706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d78072b5-6670-4ecc-86fa-4a954f637853 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:54.779214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d78072b5-6670-4ecc-86fa-4a954f637853 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:54.779649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d78072b5-6670-4ecc-86fa-4a954f637853 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:54.780345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d78072b5-6670-4ecc-86fa-4a954f637853 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:54.780797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d78072b5-6670-4ecc-86fa-4a954f637853 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:54.781218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d78072b5-6670-4ecc-86fa-4a954f637853 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:54.844855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d78072b5-6670-4ecc-86fa-4a954f637853 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:54.854231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d78072b5-6670-4ecc-86fa-4a954f637853 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087422 Aug 24 05:23:54.854923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1100/2308] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:54.859978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c0edf0c9-3886-44cc-a4a4-4bfa6f0baa9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:54.860593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c0edf0c9-3886-44cc-a4a4-4bfa6f0baa9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:54.867716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0edf0c9-3886-44cc-a4a4-4bfa6f0baa9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:54.867965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0edf0c9-3886-44cc-a4a4-4bfa6f0baa9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:54.868200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0edf0c9-3886-44cc-a4a4-4bfa6f0baa9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:54.868895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0edf0c9-3886-44cc-a4a4-4bfa6f0baa9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:54.869345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0edf0c9-3886-44cc-a4a4-4bfa6f0baa9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:54.869764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c0edf0c9-3886-44cc-a4a4-4bfa6f0baa9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:54.936458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c0edf0c9-3886-44cc-a4a4-4bfa6f0baa9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:54.945677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c0edf0c9-3886-44cc-a4a4-4bfa6f0baa9c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089816 Aug 24 05:23:54.946256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1209/2309] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:55.290497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4525d3b8-6bb2-40fd-becc-64dfb909348a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:55.291134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4525d3b8-6bb2-40fd-becc-64dfb909348a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:55.297183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4525d3b8-6bb2-40fd-becc-64dfb909348a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:55.297661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4525d3b8-6bb2-40fd-becc-64dfb909348a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:55.298090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4525d3b8-6bb2-40fd-becc-64dfb909348a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:55.298867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4525d3b8-6bb2-40fd-becc-64dfb909348a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:55.299318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4525d3b8-6bb2-40fd-becc-64dfb909348a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:55.299735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4525d3b8-6bb2-40fd-becc-64dfb909348a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:55.363511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4525d3b8-6bb2-40fd-becc-64dfb909348a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:55.372625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4525d3b8-6bb2-40fd-becc-64dfb909348a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086169 Aug 24 05:23:55.373201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1101/2310] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:55.876145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fbdbb325-2774-4ac1-9b53-59022ea6b14c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:55.876775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fbdbb325-2774-4ac1-9b53-59022ea6b14c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:55.883360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbdbb325-2774-4ac1-9b53-59022ea6b14c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:55.883841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbdbb325-2774-4ac1-9b53-59022ea6b14c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:55.884278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbdbb325-2774-4ac1-9b53-59022ea6b14c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:55.884967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbdbb325-2774-4ac1-9b53-59022ea6b14c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:55.885415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbdbb325-2774-4ac1-9b53-59022ea6b14c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:55.885834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbdbb325-2774-4ac1-9b53-59022ea6b14c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:55.948767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fbdbb325-2774-4ac1-9b53-59022ea6b14c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:55.957846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fbdbb325-2774-4ac1-9b53-59022ea6b14c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085288 Aug 24 05:23:55.958571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1210/2311] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:55.967246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2b86864c-80ee-443b-92ac-6f3a32e71fb9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:55.967879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2b86864c-80ee-443b-92ac-6f3a32e71fb9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:55.974499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b86864c-80ee-443b-92ac-6f3a32e71fb9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:55.975013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b86864c-80ee-443b-92ac-6f3a32e71fb9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:55.975447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b86864c-80ee-443b-92ac-6f3a32e71fb9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:55.976133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b86864c-80ee-443b-92ac-6f3a32e71fb9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:55.976583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b86864c-80ee-443b-92ac-6f3a32e71fb9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:55.977003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b86864c-80ee-443b-92ac-6f3a32e71fb9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:56.044538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2b86864c-80ee-443b-92ac-6f3a32e71fb9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:56.053225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2b86864c-80ee-443b-92ac-6f3a32e71fb9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089850 Aug 24 05:23:56.053793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1102/2312] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:55 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:56.395806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-64e0fd0e-be85-499d-b367-12194091e20b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:56.396330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-64e0fd0e-be85-499d-b367-12194091e20b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:56.402409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64e0fd0e-be85-499d-b367-12194091e20b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:56.402920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64e0fd0e-be85-499d-b367-12194091e20b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:56.403360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64e0fd0e-be85-499d-b367-12194091e20b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:56.404042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64e0fd0e-be85-499d-b367-12194091e20b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:56.404483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64e0fd0e-be85-499d-b367-12194091e20b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:56.404893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-64e0fd0e-be85-499d-b367-12194091e20b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:56.472274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-64e0fd0e-be85-499d-b367-12194091e20b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:56.480677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-64e0fd0e-be85-499d-b367-12194091e20b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089694 Aug 24 05:23:56.481251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1211/2313] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:56.980211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-961fcc40-2831-4e09-bdc2-7c70a1c4bcb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:56.980836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-961fcc40-2831-4e09-bdc2-7c70a1c4bcb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:56.991963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-961fcc40-2831-4e09-bdc2-7c70a1c4bcb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:56.991963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-961fcc40-2831-4e09-bdc2-7c70a1c4bcb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:56.991963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-961fcc40-2831-4e09-bdc2-7c70a1c4bcb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:56.991963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-961fcc40-2831-4e09-bdc2-7c70a1c4bcb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:56.992445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-961fcc40-2831-4e09-bdc2-7c70a1c4bcb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:56.992445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-961fcc40-2831-4e09-bdc2-7c70a1c4bcb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:57.054670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-961fcc40-2831-4e09-bdc2-7c70a1c4bcb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:57.063505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-961fcc40-2831-4e09-bdc2-7c70a1c4bcb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087276 Aug 24 05:23:57.064081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1103/2314] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:57.073802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6db3d00a-430c-462a-ba18-a28049711415 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:57.074470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6db3d00a-430c-462a-ba18-a28049711415 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:57.083444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db3d00a-430c-462a-ba18-a28049711415 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:57.084236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db3d00a-430c-462a-ba18-a28049711415 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:57.084922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db3d00a-430c-462a-ba18-a28049711415 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:57.086034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db3d00a-430c-462a-ba18-a28049711415 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:57.086823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db3d00a-430c-462a-ba18-a28049711415 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:57.087505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6db3d00a-430c-462a-ba18-a28049711415 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:57.152903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6db3d00a-430c-462a-ba18-a28049711415 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:57.163320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6db3d00a-430c-462a-ba18-a28049711415 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093318 Aug 24 05:23:57.163894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1212/2315] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:57.501368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-163f4e0f-3bc5-4313-9e90-f320d316aa43 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:57.501969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-163f4e0f-3bc5-4313-9e90-f320d316aa43 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:57.510430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-163f4e0f-3bc5-4313-9e90-f320d316aa43 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:57.510964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-163f4e0f-3bc5-4313-9e90-f320d316aa43 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:57.511402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-163f4e0f-3bc5-4313-9e90-f320d316aa43 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:57.512247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-163f4e0f-3bc5-4313-9e90-f320d316aa43 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:57.513078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-163f4e0f-3bc5-4313-9e90-f320d316aa43 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:57.513523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-163f4e0f-3bc5-4313-9e90-f320d316aa43 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:57.577615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-163f4e0f-3bc5-4313-9e90-f320d316aa43 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:57.586890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-163f4e0f-3bc5-4313-9e90-f320d316aa43 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089310 Aug 24 05:23:57.587460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1104/2316] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:58.086199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-87f85eb2-f275-4933-8668-771840611688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:58.086853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-87f85eb2-f275-4933-8668-771840611688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:58.093301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87f85eb2-f275-4933-8668-771840611688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:58.093774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87f85eb2-f275-4933-8668-771840611688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:58.094228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87f85eb2-f275-4933-8668-771840611688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:58.094932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87f85eb2-f275-4933-8668-771840611688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:58.095380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87f85eb2-f275-4933-8668-771840611688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:58.095793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-87f85eb2-f275-4933-8668-771840611688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:58.162281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-87f85eb2-f275-4933-8668-771840611688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:58.170662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-87f85eb2-f275-4933-8668-771840611688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088862 Aug 24 05:23:58.171250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1213/2317] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:58.184800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2f49a569-95ce-40b1-ba58-80fdfdeb6e25 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:58.185411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2f49a569-95ce-40b1-ba58-80fdfdeb6e25 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:58.192644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f49a569-95ce-40b1-ba58-80fdfdeb6e25 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:58.193127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f49a569-95ce-40b1-ba58-80fdfdeb6e25 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:58.193559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f49a569-95ce-40b1-ba58-80fdfdeb6e25 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:58.194254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f49a569-95ce-40b1-ba58-80fdfdeb6e25 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:58.194728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f49a569-95ce-40b1-ba58-80fdfdeb6e25 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:58.195153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f49a569-95ce-40b1-ba58-80fdfdeb6e25 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:58.260406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2f49a569-95ce-40b1-ba58-80fdfdeb6e25 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:58.268834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2f49a569-95ce-40b1-ba58-80fdfdeb6e25 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087889 Aug 24 05:23:58.269505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1105/2318] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:58.608645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-54e96195-548d-46a5-8339-8f3e31f1951c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:58.609255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-54e96195-548d-46a5-8339-8f3e31f1951c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:58.616157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54e96195-548d-46a5-8339-8f3e31f1951c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:58.616636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54e96195-548d-46a5-8339-8f3e31f1951c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:58.617069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54e96195-548d-46a5-8339-8f3e31f1951c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:58.617782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54e96195-548d-46a5-8339-8f3e31f1951c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:58.618226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54e96195-548d-46a5-8339-8f3e31f1951c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:58.618644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-54e96195-548d-46a5-8339-8f3e31f1951c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:58.683366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-54e96195-548d-46a5-8339-8f3e31f1951c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:58.691842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-54e96195-548d-46a5-8339-8f3e31f1951c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086997 Aug 24 05:23:58.692518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1214/2319] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:23:59.191058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-25ded6e9-67d0-4eda-bac5-b791075bc194 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:59.192237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-25ded6e9-67d0-4eda-bac5-b791075bc194 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:59.198773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25ded6e9-67d0-4eda-bac5-b791075bc194 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:59.199259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25ded6e9-67d0-4eda-bac5-b791075bc194 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:59.199693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25ded6e9-67d0-4eda-bac5-b791075bc194 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:59.200389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25ded6e9-67d0-4eda-bac5-b791075bc194 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:59.200838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25ded6e9-67d0-4eda-bac5-b791075bc194 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:59.201255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25ded6e9-67d0-4eda-bac5-b791075bc194 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:59.268757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-25ded6e9-67d0-4eda-bac5-b791075bc194 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:59.277037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-25ded6e9-67d0-4eda-bac5-b791075bc194 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089957 Aug 24 05:23:59.277598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1106/2320] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:59.289851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f041d76b-2609-4647-b7a6-df1735ca4aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:59.290459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f041d76b-2609-4647-b7a6-df1735ca4aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:59.297015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f041d76b-2609-4647-b7a6-df1735ca4aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:59.297489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f041d76b-2609-4647-b7a6-df1735ca4aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:59.297914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f041d76b-2609-4647-b7a6-df1735ca4aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:59.298592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f041d76b-2609-4647-b7a6-df1735ca4aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:59.299185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f041d76b-2609-4647-b7a6-df1735ca4aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:59.299602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f041d76b-2609-4647-b7a6-df1735ca4aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:59.373459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f041d76b-2609-4647-b7a6-df1735ca4aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:59.383803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f041d76b-2609-4647-b7a6-df1735ca4aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.097715 Aug 24 05:23:59.384393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1215/2321] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:59 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:23:59.713285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8c95df16-fe53-4ff2-b6e8-1ba86a1c168d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:23:59.713900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8c95df16-fe53-4ff2-b6e8-1ba86a1c168d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:23:59.720072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c95df16-fe53-4ff2-b6e8-1ba86a1c168d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:59.720562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c95df16-fe53-4ff2-b6e8-1ba86a1c168d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:59.721000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c95df16-fe53-4ff2-b6e8-1ba86a1c168d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:59.721691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c95df16-fe53-4ff2-b6e8-1ba86a1c168d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:23:59.722145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c95df16-fe53-4ff2-b6e8-1ba86a1c168d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:23:59.722752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8c95df16-fe53-4ff2-b6e8-1ba86a1c168d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:23:59.787004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8c95df16-fe53-4ff2-b6e8-1ba86a1c168d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:23:59.795442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8c95df16-fe53-4ff2-b6e8-1ba86a1c168d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086081 Aug 24 05:23:59.796021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1107/2322] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:23:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:00.298282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-866ba50e-35f3-403c-aa03-44c92ac5c229 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:00.298915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-866ba50e-35f3-403c-aa03-44c92ac5c229 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:00.306610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-866ba50e-35f3-403c-aa03-44c92ac5c229 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:00.307114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-866ba50e-35f3-403c-aa03-44c92ac5c229 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:00.307543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-866ba50e-35f3-403c-aa03-44c92ac5c229 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:00.308233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-866ba50e-35f3-403c-aa03-44c92ac5c229 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:00.308676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-866ba50e-35f3-403c-aa03-44c92ac5c229 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:00.309090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-866ba50e-35f3-403c-aa03-44c92ac5c229 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:00.372137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-866ba50e-35f3-403c-aa03-44c92ac5c229 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:00.374315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:00.382660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-866ba50e-35f3-403c-aa03-44c92ac5c229 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088292 Aug 24 05:24:00.383274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1216/2323] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:00.406105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-82cca339-0861-4371-b261-a9c33709d25d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:00.406742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-82cca339-0861-4371-b261-a9c33709d25d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:00.413944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82cca339-0861-4371-b261-a9c33709d25d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:00.414434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82cca339-0861-4371-b261-a9c33709d25d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:00.414916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82cca339-0861-4371-b261-a9c33709d25d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:00.415618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82cca339-0861-4371-b261-a9c33709d25d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:00.416071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82cca339-0861-4371-b261-a9c33709d25d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:00.416496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-82cca339-0861-4371-b261-a9c33709d25d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:00.480312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-82cca339-0861-4371-b261-a9c33709d25d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:00.489597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-82cca339-0861-4371-b261-a9c33709d25d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087721 Aug 24 05:24:00.490187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1108/2324] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:00.819716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1ec97092-1b0e-4836-8065-f5340441b222 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:00.820419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1ec97092-1b0e-4836-8065-f5340441b222 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:00.827991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ec97092-1b0e-4836-8065-f5340441b222 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:00.828632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ec97092-1b0e-4836-8065-f5340441b222 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:00.829220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ec97092-1b0e-4836-8065-f5340441b222 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:00.830438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ec97092-1b0e-4836-8065-f5340441b222 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:00.830870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ec97092-1b0e-4836-8065-f5340441b222 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:00.831293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ec97092-1b0e-4836-8065-f5340441b222 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:00.905457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1ec97092-1b0e-4836-8065-f5340441b222 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:00.914838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1ec97092-1b0e-4836-8065-f5340441b222 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.100915 Aug 24 05:24:00.915422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1217/2325] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:01.404515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-22196709-879c-4185-9372-3e9677443ab9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:01.405146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-22196709-879c-4185-9372-3e9677443ab9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:01.413224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22196709-879c-4185-9372-3e9677443ab9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:01.413919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22196709-879c-4185-9372-3e9677443ab9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:01.414250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22196709-879c-4185-9372-3e9677443ab9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:01.415227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22196709-879c-4185-9372-3e9677443ab9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:01.415723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22196709-879c-4185-9372-3e9677443ab9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:01.416257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22196709-879c-4185-9372-3e9677443ab9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:01.479676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-22196709-879c-4185-9372-3e9677443ab9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:01.488087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-22196709-879c-4185-9372-3e9677443ab9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087345 Aug 24 05:24:01.488665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1109/2326] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:01.512974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d27ea41c-1a15-43ff-a130-f8ac872cfb97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:01.513576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d27ea41c-1a15-43ff-a130-f8ac872cfb97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:01.520660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d27ea41c-1a15-43ff-a130-f8ac872cfb97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:01.521133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d27ea41c-1a15-43ff-a130-f8ac872cfb97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:01.521560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d27ea41c-1a15-43ff-a130-f8ac872cfb97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:01.522305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d27ea41c-1a15-43ff-a130-f8ac872cfb97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:01.522788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d27ea41c-1a15-43ff-a130-f8ac872cfb97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:01.523204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d27ea41c-1a15-43ff-a130-f8ac872cfb97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:01.831385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d27ea41c-1a15-43ff-a130-f8ac872cfb97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:01.839869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d27ea41c-1a15-43ff-a130-f8ac872cfb97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.330728 Aug 24 05:24:01.840445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1218/2327] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:01.939194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bec27c03-9446-440c-95a0-0277bdf17a54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:01.939906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bec27c03-9446-440c-95a0-0277bdf17a54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:01.946324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bec27c03-9446-440c-95a0-0277bdf17a54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:01.946855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bec27c03-9446-440c-95a0-0277bdf17a54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:01.947297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bec27c03-9446-440c-95a0-0277bdf17a54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:01.947988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bec27c03-9446-440c-95a0-0277bdf17a54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:01.948442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bec27c03-9446-440c-95a0-0277bdf17a54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:01.948861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bec27c03-9446-440c-95a0-0277bdf17a54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:02.014296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bec27c03-9446-440c-95a0-0277bdf17a54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:02.023549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bec27c03-9446-440c-95a0-0277bdf17a54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088238 Aug 24 05:24:02.025649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1110/2328] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:02.509528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fda27143-0f15-46f7-bb75-45f8582323bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:02.510133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fda27143-0f15-46f7-bb75-45f8582323bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:02.516168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fda27143-0f15-46f7-bb75-45f8582323bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:02.516754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fda27143-0f15-46f7-bb75-45f8582323bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:02.517059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fda27143-0f15-46f7-bb75-45f8582323bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:02.517737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fda27143-0f15-46f7-bb75-45f8582323bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:02.518179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fda27143-0f15-46f7-bb75-45f8582323bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:02.518593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fda27143-0f15-46f7-bb75-45f8582323bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:02.583819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fda27143-0f15-46f7-bb75-45f8582323bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:02.592094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fda27143-0f15-46f7-bb75-45f8582323bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086474 Aug 24 05:24:02.592672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1219/2329] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:02.861057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dfec2624-64ed-4171-b68e-fe2b7dde39e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:02.861696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dfec2624-64ed-4171-b68e-fe2b7dde39e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:02.869553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfec2624-64ed-4171-b68e-fe2b7dde39e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:02.870145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfec2624-64ed-4171-b68e-fe2b7dde39e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:02.870747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfec2624-64ed-4171-b68e-fe2b7dde39e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:02.871580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfec2624-64ed-4171-b68e-fe2b7dde39e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:02.872040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfec2624-64ed-4171-b68e-fe2b7dde39e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:02.872802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfec2624-64ed-4171-b68e-fe2b7dde39e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:03.045565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b52b4223-aaf5-442a-bb3c-06ba58de4c94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:03.046063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b52b4223-aaf5-442a-bb3c-06ba58de4c94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:03.053098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b52b4223-aaf5-442a-bb3c-06ba58de4c94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:03.053588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b52b4223-aaf5-442a-bb3c-06ba58de4c94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:03.054027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b52b4223-aaf5-442a-bb3c-06ba58de4c94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:03.054761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b52b4223-aaf5-442a-bb3c-06ba58de4c94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:03.055515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b52b4223-aaf5-442a-bb3c-06ba58de4c94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:03.055939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b52b4223-aaf5-442a-bb3c-06ba58de4c94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:03.124052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b52b4223-aaf5-442a-bb3c-06ba58de4c94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:03.132902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b52b4223-aaf5-442a-bb3c-06ba58de4c94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091383 Aug 24 05:24:03.133492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1220/2330] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:03 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:03.193336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dfec2624-64ed-4171-b68e-fe2b7dde39e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:03.201775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dfec2624-64ed-4171-b68e-fe2b7dde39e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.344581 Aug 24 05:24:03.202452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1111/2331] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:03.615292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-315ed8aa-3713-46a2-aea6-516e5abd96ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:03.615864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-315ed8aa-3713-46a2-aea6-516e5abd96ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:03.622451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-315ed8aa-3713-46a2-aea6-516e5abd96ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:03.622966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-315ed8aa-3713-46a2-aea6-516e5abd96ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:03.623402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-315ed8aa-3713-46a2-aea6-516e5abd96ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:03.624085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-315ed8aa-3713-46a2-aea6-516e5abd96ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:03.624532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-315ed8aa-3713-46a2-aea6-516e5abd96ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:03.624950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-315ed8aa-3713-46a2-aea6-516e5abd96ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:03.689427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-315ed8aa-3713-46a2-aea6-516e5abd96ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:03.697995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-315ed8aa-3713-46a2-aea6-516e5abd96ea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088429 Aug 24 05:24:03.698580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1221/2332] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:04.154235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d0adafe7-3fa8-4a9a-81f3-57274b4a79df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:04.154934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d0adafe7-3fa8-4a9a-81f3-57274b4a79df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:04.161614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0adafe7-3fa8-4a9a-81f3-57274b4a79df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:04.162132 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0adafe7-3fa8-4a9a-81f3-57274b4a79df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:04.162573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0adafe7-3fa8-4a9a-81f3-57274b4a79df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:04.163319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0adafe7-3fa8-4a9a-81f3-57274b4a79df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:04.163770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0adafe7-3fa8-4a9a-81f3-57274b4a79df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:04.164190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0adafe7-3fa8-4a9a-81f3-57274b4a79df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:04.222812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7f621b5b-0eb8-41dd-8fd8-9069eb9df67e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:04.223640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7f621b5b-0eb8-41dd-8fd8-9069eb9df67e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:04.229112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d0adafe7-3fa8-4a9a-81f3-57274b4a79df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:04.229736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f621b5b-0eb8-41dd-8fd8-9069eb9df67e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:04.230309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f621b5b-0eb8-41dd-8fd8-9069eb9df67e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:04.230853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f621b5b-0eb8-41dd-8fd8-9069eb9df67e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:04.231554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f621b5b-0eb8-41dd-8fd8-9069eb9df67e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:04.232006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f621b5b-0eb8-41dd-8fd8-9069eb9df67e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:04.232433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f621b5b-0eb8-41dd-8fd8-9069eb9df67e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:04.237503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d0adafe7-3fa8-4a9a-81f3-57274b4a79df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087136 Aug 24 05:24:04.238642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1112/2333] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:04.304186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7f621b5b-0eb8-41dd-8fd8-9069eb9df67e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:04.313144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7f621b5b-0eb8-41dd-8fd8-9069eb9df67e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094225 Aug 24 05:24:04.313716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1222/2334] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:04.720656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b3207e89-b0f4-47e8-8b94-f24893905f6e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:04.721265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b3207e89-b0f4-47e8-8b94-f24893905f6e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:04.727586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3207e89-b0f4-47e8-8b94-f24893905f6e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:04.728076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3207e89-b0f4-47e8-8b94-f24893905f6e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:04.728514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3207e89-b0f4-47e8-8b94-f24893905f6e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:04.729214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3207e89-b0f4-47e8-8b94-f24893905f6e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:04.729671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3207e89-b0f4-47e8-8b94-f24893905f6e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:04.730098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3207e89-b0f4-47e8-8b94-f24893905f6e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:04.796403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b3207e89-b0f4-47e8-8b94-f24893905f6e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:04.805529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b3207e89-b0f4-47e8-8b94-f24893905f6e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088480 Aug 24 05:24:04.806098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1113/2335] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:05.259968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e31e4a3f-0d96-4b5b-808a-fa18dcc2f29e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:05.260551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e31e4a3f-0d96-4b5b-808a-fa18dcc2f29e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:05.266953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31e4a3f-0d96-4b5b-808a-fa18dcc2f29e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:05.267420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31e4a3f-0d96-4b5b-808a-fa18dcc2f29e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:05.267845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31e4a3f-0d96-4b5b-808a-fa18dcc2f29e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:05.268510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31e4a3f-0d96-4b5b-808a-fa18dcc2f29e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:05.268950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31e4a3f-0d96-4b5b-808a-fa18dcc2f29e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:05.269371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e31e4a3f-0d96-4b5b-808a-fa18dcc2f29e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:05.330369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e31e4a3f-0d96-4b5b-808a-fa18dcc2f29e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:05.335724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2cd9ea02-e4f1-4f91-827f-4c8fe843d44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:05.335724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2cd9ea02-e4f1-4f91-827f-4c8fe843d44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:05.339378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e31e4a3f-0d96-4b5b-808a-fa18dcc2f29e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.083215 Aug 24 05:24:05.339949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1223/2336] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:05.341873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cd9ea02-e4f1-4f91-827f-4c8fe843d44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:05.342417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cd9ea02-e4f1-4f91-827f-4c8fe843d44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:05.342921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cd9ea02-e4f1-4f91-827f-4c8fe843d44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:05.343619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cd9ea02-e4f1-4f91-827f-4c8fe843d44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:05.344072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cd9ea02-e4f1-4f91-827f-4c8fe843d44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:05.344495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cd9ea02-e4f1-4f91-827f-4c8fe843d44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:05.409133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2cd9ea02-e4f1-4f91-827f-4c8fe843d44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:05.417976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2cd9ea02-e4f1-4f91-827f-4c8fe843d44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087351 Aug 24 05:24:05.418548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1114/2337] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:05.826498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e157c404-bf22-4f8e-b349-102b84567a0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:05.827251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e157c404-bf22-4f8e-b349-102b84567a0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:05.833430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e157c404-bf22-4f8e-b349-102b84567a0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:05.833909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e157c404-bf22-4f8e-b349-102b84567a0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:05.834342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e157c404-bf22-4f8e-b349-102b84567a0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:05.835082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e157c404-bf22-4f8e-b349-102b84567a0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:05.835539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e157c404-bf22-4f8e-b349-102b84567a0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:05.835957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e157c404-bf22-4f8e-b349-102b84567a0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:05.905052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e157c404-bf22-4f8e-b349-102b84567a0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:05.913482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e157c404-bf22-4f8e-b349-102b84567a0b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090835 Aug 24 05:24:05.914055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1224/2338] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:06.360194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2c49480c-0106-4a71-8663-67fe0b05c4cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:06.360838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2c49480c-0106-4a71-8663-67fe0b05c4cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:06.367943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c49480c-0106-4a71-8663-67fe0b05c4cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:06.368425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c49480c-0106-4a71-8663-67fe0b05c4cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:06.368859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c49480c-0106-4a71-8663-67fe0b05c4cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:06.369537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c49480c-0106-4a71-8663-67fe0b05c4cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:06.369982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c49480c-0106-4a71-8663-67fe0b05c4cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:06.370401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2c49480c-0106-4a71-8663-67fe0b05c4cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:06.373076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:06.437491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2c49480c-0106-4a71-8663-67fe0b05c4cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:06.440249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5c5a0680-1278-49fb-8bd4-d63f45ec0aef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:06.440249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5c5a0680-1278-49fb-8bd4-d63f45ec0aef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:06.446757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2c49480c-0106-4a71-8663-67fe0b05c4cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090352 Aug 24 05:24:06.447336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1115/2339] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:06.449693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5a0680-1278-49fb-8bd4-d63f45ec0aef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:06.450184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5a0680-1278-49fb-8bd4-d63f45ec0aef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:06.450598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5a0680-1278-49fb-8bd4-d63f45ec0aef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:06.451323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5a0680-1278-49fb-8bd4-d63f45ec0aef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:06.451766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5a0680-1278-49fb-8bd4-d63f45ec0aef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:06.452203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5a0680-1278-49fb-8bd4-d63f45ec0aef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:06.517283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5c5a0680-1278-49fb-8bd4-d63f45ec0aef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:06.526608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5c5a0680-1278-49fb-8bd4-d63f45ec0aef tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090178 Aug 24 05:24:06.527223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1225/2340] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:06.751616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:24:06.751944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:24:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:24:06.936169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-afe2a0c8-faa2-443f-99c6-d7d42a225544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:06.936861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-afe2a0c8-faa2-443f-99c6-d7d42a225544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:06.943540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe2a0c8-faa2-443f-99c6-d7d42a225544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:06.944029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe2a0c8-faa2-443f-99c6-d7d42a225544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:06.944467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe2a0c8-faa2-443f-99c6-d7d42a225544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:06.945172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe2a0c8-faa2-443f-99c6-d7d42a225544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:06.945617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe2a0c8-faa2-443f-99c6-d7d42a225544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:06.946100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-afe2a0c8-faa2-443f-99c6-d7d42a225544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:07.010166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-afe2a0c8-faa2-443f-99c6-d7d42a225544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:07.018676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-afe2a0c8-faa2-443f-99c6-d7d42a225544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087215 Aug 24 05:24:07.019305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1116/2341] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:07.471759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-784349ec-b8f8-4cc3-b19b-1d817523f250 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:07.472559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-784349ec-b8f8-4cc3-b19b-1d817523f250 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:07.479275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784349ec-b8f8-4cc3-b19b-1d817523f250 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:07.479761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784349ec-b8f8-4cc3-b19b-1d817523f250 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:07.480198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784349ec-b8f8-4cc3-b19b-1d817523f250 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:07.480892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784349ec-b8f8-4cc3-b19b-1d817523f250 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:07.481345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784349ec-b8f8-4cc3-b19b-1d817523f250 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:07.481769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-784349ec-b8f8-4cc3-b19b-1d817523f250 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:07.548611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1ba6a9ae-4b73-427f-a89e-df4faaec0c2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:07.549229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1ba6a9ae-4b73-427f-a89e-df4faaec0c2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:07.549353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-784349ec-b8f8-4cc3-b19b-1d817523f250 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:07.556331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba6a9ae-4b73-427f-a89e-df4faaec0c2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:07.556823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba6a9ae-4b73-427f-a89e-df4faaec0c2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:07.557263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba6a9ae-4b73-427f-a89e-df4faaec0c2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:07.557957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba6a9ae-4b73-427f-a89e-df4faaec0c2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:07.558412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba6a9ae-4b73-427f-a89e-df4faaec0c2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:07.558537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-784349ec-b8f8-4cc3-b19b-1d817523f250 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093706 Aug 24 05:24:07.558868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1ba6a9ae-4b73-427f-a89e-df4faaec0c2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:07.559310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1226/2342] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:07.622485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1ba6a9ae-4b73-427f-a89e-df4faaec0c2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:07.631635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1ba6a9ae-4b73-427f-a89e-df4faaec0c2f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086892 Aug 24 05:24:07.632206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1117/2343] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:08.040608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ff74a0af-001c-494c-a63d-d9274fc37a99 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:08.041231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ff74a0af-001c-494c-a63d-d9274fc37a99 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:08.047432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff74a0af-001c-494c-a63d-d9274fc37a99 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:08.047918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff74a0af-001c-494c-a63d-d9274fc37a99 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:08.048353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff74a0af-001c-494c-a63d-d9274fc37a99 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:08.049045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff74a0af-001c-494c-a63d-d9274fc37a99 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:08.049497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff74a0af-001c-494c-a63d-d9274fc37a99 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:08.049921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff74a0af-001c-494c-a63d-d9274fc37a99 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:08.115565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ff74a0af-001c-494c-a63d-d9274fc37a99 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:08.125125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ff74a0af-001c-494c-a63d-d9274fc37a99 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088676 Aug 24 05:24:08.125711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1227/2344] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:08.579514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-97f5f5b8-e2d9-4ee6-9e43-6ad7d6cb6a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:08.580127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-97f5f5b8-e2d9-4ee6-9e43-6ad7d6cb6a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:08.587464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f5f5b8-e2d9-4ee6-9e43-6ad7d6cb6a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:08.587950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f5f5b8-e2d9-4ee6-9e43-6ad7d6cb6a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:08.588384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f5f5b8-e2d9-4ee6-9e43-6ad7d6cb6a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:08.589077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f5f5b8-e2d9-4ee6-9e43-6ad7d6cb6a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:08.589526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f5f5b8-e2d9-4ee6-9e43-6ad7d6cb6a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:08.589943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97f5f5b8-e2d9-4ee6-9e43-6ad7d6cb6a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:08.653466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-97f5f5b8-e2d9-4ee6-9e43-6ad7d6cb6a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:08.653869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2c6670da-1cca-486f-8b02-4cdb4026015d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:08.654799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2c6670da-1cca-486f-8b02-4cdb4026015d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:08.661446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c6670da-1cca-486f-8b02-4cdb4026015d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:08.661903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-97f5f5b8-e2d9-4ee6-9e43-6ad7d6cb6a8c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086211 Aug 24 05:24:08.662044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c6670da-1cca-486f-8b02-4cdb4026015d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:08.662421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c6670da-1cca-486f-8b02-4cdb4026015d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:08.663550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1118/2345] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:08.663666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c6670da-1cca-486f-8b02-4cdb4026015d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:08.663666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c6670da-1cca-486f-8b02-4cdb4026015d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:08.664040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c6670da-1cca-486f-8b02-4cdb4026015d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:08.736269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2c6670da-1cca-486f-8b02-4cdb4026015d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:08.745439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2c6670da-1cca-486f-8b02-4cdb4026015d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.096243 Aug 24 05:24:08.745937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1228/2346] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:09.149076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4abb2f14-311e-457a-986f-7f454d047b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:09.149605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4abb2f14-311e-457a-986f-7f454d047b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:09.155758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4abb2f14-311e-457a-986f-7f454d047b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:09.156231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4abb2f14-311e-457a-986f-7f454d047b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:09.156660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4abb2f14-311e-457a-986f-7f454d047b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:09.157339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4abb2f14-311e-457a-986f-7f454d047b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:09.157781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4abb2f14-311e-457a-986f-7f454d047b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:09.158193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4abb2f14-311e-457a-986f-7f454d047b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:09.225529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4abb2f14-311e-457a-986f-7f454d047b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:09.233866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4abb2f14-311e-457a-986f-7f454d047b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089798 Aug 24 05:24:09.234435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1119/2347] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:09.685359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d16a95bf-4377-452a-bc0a-a2ad00e1b12a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:09.685925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d16a95bf-4377-452a-bc0a-a2ad00e1b12a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:09.692710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d16a95bf-4377-452a-bc0a-a2ad00e1b12a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:09.693233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d16a95bf-4377-452a-bc0a-a2ad00e1b12a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:09.693669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d16a95bf-4377-452a-bc0a-a2ad00e1b12a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:09.694365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d16a95bf-4377-452a-bc0a-a2ad00e1b12a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:09.694856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d16a95bf-4377-452a-bc0a-a2ad00e1b12a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:09.695283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d16a95bf-4377-452a-bc0a-a2ad00e1b12a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:09.761680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d16a95bf-4377-452a-bc0a-a2ad00e1b12a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:09.766969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-caf5ee1d-2207-4e7f-9686-0b95fc859c58 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:09.767731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-caf5ee1d-2207-4e7f-9686-0b95fc859c58 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:09.771453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d16a95bf-4377-452a-bc0a-a2ad00e1b12a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091717 Aug 24 05:24:09.772224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1229/2348] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:09.775222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-caf5ee1d-2207-4e7f-9686-0b95fc859c58 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:09.775717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-caf5ee1d-2207-4e7f-9686-0b95fc859c58 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:09.776157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-caf5ee1d-2207-4e7f-9686-0b95fc859c58 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:09.776855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-caf5ee1d-2207-4e7f-9686-0b95fc859c58 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:09.777339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-caf5ee1d-2207-4e7f-9686-0b95fc859c58 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:09.777789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-caf5ee1d-2207-4e7f-9686-0b95fc859c58 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:09.842896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-caf5ee1d-2207-4e7f-9686-0b95fc859c58 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:09.852014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-caf5ee1d-2207-4e7f-9686-0b95fc859c58 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088899 Aug 24 05:24:09.856196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1120/2349] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:10.255768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2e224426-f448-4d20-8d72-122036e39cb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:10.256337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2e224426-f448-4d20-8d72-122036e39cb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:10.262643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e224426-f448-4d20-8d72-122036e39cb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:10.263151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e224426-f448-4d20-8d72-122036e39cb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:10.263582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e224426-f448-4d20-8d72-122036e39cb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:10.264270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e224426-f448-4d20-8d72-122036e39cb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:10.264714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e224426-f448-4d20-8d72-122036e39cb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:10.265137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e224426-f448-4d20-8d72-122036e39cb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:10.330769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2e224426-f448-4d20-8d72-122036e39cb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:10.339356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2e224426-f448-4d20-8d72-122036e39cb9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088428 Aug 24 05:24:10.339935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1230/2350] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:10.793310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2418cc89-6eee-4656-a610-af98f9df48bf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:10.793901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2418cc89-6eee-4656-a610-af98f9df48bf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:10.800525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2418cc89-6eee-4656-a610-af98f9df48bf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:10.801057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2418cc89-6eee-4656-a610-af98f9df48bf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:10.801487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2418cc89-6eee-4656-a610-af98f9df48bf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:10.802170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2418cc89-6eee-4656-a610-af98f9df48bf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:10.802644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2418cc89-6eee-4656-a610-af98f9df48bf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:10.803089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2418cc89-6eee-4656-a610-af98f9df48bf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:10.867554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2418cc89-6eee-4656-a610-af98f9df48bf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:10.871858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0fe1a10b-e086-45c3-8f89-7206bbadfd82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:10.872476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0fe1a10b-e086-45c3-8f89-7206bbadfd82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:10.875886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2418cc89-6eee-4656-a610-af98f9df48bf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086424 Aug 24 05:24:10.876553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1121/2351] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:10.879976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe1a10b-e086-45c3-8f89-7206bbadfd82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:10.880543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe1a10b-e086-45c3-8f89-7206bbadfd82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:10.880983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe1a10b-e086-45c3-8f89-7206bbadfd82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:10.881684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe1a10b-e086-45c3-8f89-7206bbadfd82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:10.882134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe1a10b-e086-45c3-8f89-7206bbadfd82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:10.882557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fe1a10b-e086-45c3-8f89-7206bbadfd82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:10.947164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0fe1a10b-e086-45c3-8f89-7206bbadfd82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:10.955575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0fe1a10b-e086-45c3-8f89-7206bbadfd82 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087471 Aug 24 05:24:10.956146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1231/2352] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:11.360086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9282daad-e549-4c01-a8a3-55492d4decb3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:11.360688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9282daad-e549-4c01-a8a3-55492d4decb3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:11.366925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9282daad-e549-4c01-a8a3-55492d4decb3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:11.367403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9282daad-e549-4c01-a8a3-55492d4decb3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:11.367831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9282daad-e549-4c01-a8a3-55492d4decb3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:11.368514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9282daad-e549-4c01-a8a3-55492d4decb3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:11.368955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9282daad-e549-4c01-a8a3-55492d4decb3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:11.369371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9282daad-e549-4c01-a8a3-55492d4decb3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:11.432191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9282daad-e549-4c01-a8a3-55492d4decb3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:11.442295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9282daad-e549-4c01-a8a3-55492d4decb3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085840 Aug 24 05:24:11.442939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1122/2353] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:11.897183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9a64c83b-e229-48d7-a5c8-fb06d34a8867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:11.897774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9a64c83b-e229-48d7-a5c8-fb06d34a8867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:11.904453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a64c83b-e229-48d7-a5c8-fb06d34a8867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:11.904935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a64c83b-e229-48d7-a5c8-fb06d34a8867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:11.905369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a64c83b-e229-48d7-a5c8-fb06d34a8867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:11.906059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a64c83b-e229-48d7-a5c8-fb06d34a8867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:11.906505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a64c83b-e229-48d7-a5c8-fb06d34a8867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:11.906948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a64c83b-e229-48d7-a5c8-fb06d34a8867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:11.971833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9a64c83b-e229-48d7-a5c8-fb06d34a8867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:11.977455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-885b29c0-1053-4095-946d-b766f2adbe94 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:11.978075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-885b29c0-1053-4095-946d-b766f2adbe94 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:11.981165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9a64c83b-e229-48d7-a5c8-fb06d34a8867 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088076 Aug 24 05:24:11.981759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1232/2354] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:11.984887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-885b29c0-1053-4095-946d-b766f2adbe94 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:11.985426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-885b29c0-1053-4095-946d-b766f2adbe94 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:11.985811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-885b29c0-1053-4095-946d-b766f2adbe94 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:11.986509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-885b29c0-1053-4095-946d-b766f2adbe94 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:11.986996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-885b29c0-1053-4095-946d-b766f2adbe94 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:11.987442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-885b29c0-1053-4095-946d-b766f2adbe94 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:12.055779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-885b29c0-1053-4095-946d-b766f2adbe94 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:12.064148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-885b29c0-1053-4095-946d-b766f2adbe94 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090534 Aug 24 05:24:12.064716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1123/2355] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:12.463284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8771b17d-f27c-4481-bb8a-f032227560db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:12.463903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8771b17d-f27c-4481-bb8a-f032227560db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:12.469962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8771b17d-f27c-4481-bb8a-f032227560db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:12.470439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8771b17d-f27c-4481-bb8a-f032227560db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:12.470891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8771b17d-f27c-4481-bb8a-f032227560db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:12.471571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8771b17d-f27c-4481-bb8a-f032227560db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:12.472589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8771b17d-f27c-4481-bb8a-f032227560db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:12.473044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8771b17d-f27c-4481-bb8a-f032227560db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:12.489091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:12.538261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8771b17d-f27c-4481-bb8a-f032227560db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:12.546778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8771b17d-f27c-4481-bb8a-f032227560db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087252 Aug 24 05:24:12.547359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1233/2356] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:13.002521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9b2945e8-f8be-4f51-91cb-bec42c43ef31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:13.003634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9b2945e8-f8be-4f51-91cb-bec42c43ef31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:13.012102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b2945e8-f8be-4f51-91cb-bec42c43ef31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:13.012595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b2945e8-f8be-4f51-91cb-bec42c43ef31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:13.013040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b2945e8-f8be-4f51-91cb-bec42c43ef31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:13.013737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b2945e8-f8be-4f51-91cb-bec42c43ef31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:13.014194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b2945e8-f8be-4f51-91cb-bec42c43ef31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:13.014829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9b2945e8-f8be-4f51-91cb-bec42c43ef31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:13.079011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9b2945e8-f8be-4f51-91cb-bec42c43ef31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:13.085590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aab095ee-fe4d-4483-bea1-c804385a0c52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:13.086205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aab095ee-fe4d-4483-bea1-c804385a0c52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:13.090532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9b2945e8-f8be-4f51-91cb-bec42c43ef31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091892 Aug 24 05:24:13.091158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1124/2357] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:13.092881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aab095ee-fe4d-4483-bea1-c804385a0c52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:13.093367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aab095ee-fe4d-4483-bea1-c804385a0c52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:13.093801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aab095ee-fe4d-4483-bea1-c804385a0c52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:13.094487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aab095ee-fe4d-4483-bea1-c804385a0c52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:13.094962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aab095ee-fe4d-4483-bea1-c804385a0c52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:13.095379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aab095ee-fe4d-4483-bea1-c804385a0c52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:13.163362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aab095ee-fe4d-4483-bea1-c804385a0c52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:13.171883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aab095ee-fe4d-4483-bea1-c804385a0c52 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090835 Aug 24 05:24:13.172463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1234/2358] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:13.568089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-93da6695-4d0d-4884-8f83-4a742698d256 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:13.568734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-93da6695-4d0d-4884-8f83-4a742698d256 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:13.574901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93da6695-4d0d-4884-8f83-4a742698d256 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:13.575379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93da6695-4d0d-4884-8f83-4a742698d256 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:13.575810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93da6695-4d0d-4884-8f83-4a742698d256 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:13.576499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93da6695-4d0d-4884-8f83-4a742698d256 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:13.576948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93da6695-4d0d-4884-8f83-4a742698d256 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:13.577369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93da6695-4d0d-4884-8f83-4a742698d256 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:13.641161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-93da6695-4d0d-4884-8f83-4a742698d256 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:13.655085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-93da6695-4d0d-4884-8f83-4a742698d256 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090842 Aug 24 05:24:13.655704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1125/2359] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:14.111852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f921c5c6-0754-4252-bb33-e358c42086b3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:14.112459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f921c5c6-0754-4252-bb33-e358c42086b3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:14.119734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f921c5c6-0754-4252-bb33-e358c42086b3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:14.120218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f921c5c6-0754-4252-bb33-e358c42086b3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:14.120652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f921c5c6-0754-4252-bb33-e358c42086b3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:14.121344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f921c5c6-0754-4252-bb33-e358c42086b3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:14.121791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f921c5c6-0754-4252-bb33-e358c42086b3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:14.122213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f921c5c6-0754-4252-bb33-e358c42086b3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:14.189783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f921c5c6-0754-4252-bb33-e358c42086b3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:14.193973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0f463faf-d837-4df3-959c-bb4e1fc9526b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:14.194586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0f463faf-d837-4df3-959c-bb4e1fc9526b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:14.198901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f921c5c6-0754-4252-bb33-e358c42086b3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090886 Aug 24 05:24:14.199479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1235/2360] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:14.205541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f463faf-d837-4df3-959c-bb4e1fc9526b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:14.205541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f463faf-d837-4df3-959c-bb4e1fc9526b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:14.205541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f463faf-d837-4df3-959c-bb4e1fc9526b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:14.205541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f463faf-d837-4df3-959c-bb4e1fc9526b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:14.206017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f463faf-d837-4df3-959c-bb4e1fc9526b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:14.206017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f463faf-d837-4df3-959c-bb4e1fc9526b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:14.271819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0f463faf-d837-4df3-959c-bb4e1fc9526b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:14.280310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0f463faf-d837-4df3-959c-bb4e1fc9526b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090821 Aug 24 05:24:14.280882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1126/2361] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:14 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:14.676743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f2d4953a-32f9-498e-ba0d-a9b9dc283e6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:14.677346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f2d4953a-32f9-498e-ba0d-a9b9dc283e6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:14.683708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2d4953a-32f9-498e-ba0d-a9b9dc283e6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:14.684185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2d4953a-32f9-498e-ba0d-a9b9dc283e6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:14.684612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2d4953a-32f9-498e-ba0d-a9b9dc283e6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:14.685286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2d4953a-32f9-498e-ba0d-a9b9dc283e6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:14.685726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2d4953a-32f9-498e-ba0d-a9b9dc283e6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:14.686136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f2d4953a-32f9-498e-ba0d-a9b9dc283e6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:14.749375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f2d4953a-32f9-498e-ba0d-a9b9dc283e6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:14.758800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f2d4953a-32f9-498e-ba0d-a9b9dc283e6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086089 Aug 24 05:24:14.759387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1236/2362] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:15.219966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d669ba88-b23c-4648-bd2b-4868c84d23e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:15.220572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d669ba88-b23c-4648-bd2b-4868c84d23e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:15.223201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=80 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:15.228638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d669ba88-b23c-4648-bd2b-4868c84d23e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:15.229125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d669ba88-b23c-4648-bd2b-4868c84d23e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:15.229563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d669ba88-b23c-4648-bd2b-4868c84d23e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:15.230263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d669ba88-b23c-4648-bd2b-4868c84d23e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:15.230741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d669ba88-b23c-4648-bd2b-4868c84d23e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:15.231169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d669ba88-b23c-4648-bd2b-4868c84d23e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:15.298207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d669ba88-b23c-4648-bd2b-4868c84d23e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:15.301405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7e09f8e6-74c1-4edd-b428-d50f52dd03bf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:15.302017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7e09f8e6-74c1-4edd-b428-d50f52dd03bf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:15.307635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d669ba88-b23c-4648-bd2b-4868c84d23e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091399 Aug 24 05:24:15.308346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1127/2363] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:15.309179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e09f8e6-74c1-4edd-b428-d50f52dd03bf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:15.309767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e09f8e6-74c1-4edd-b428-d50f52dd03bf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:15.310301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e09f8e6-74c1-4edd-b428-d50f52dd03bf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:15.311108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e09f8e6-74c1-4edd-b428-d50f52dd03bf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:15.311639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e09f8e6-74c1-4edd-b428-d50f52dd03bf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:15.312060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7e09f8e6-74c1-4edd-b428-d50f52dd03bf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:15.375857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7e09f8e6-74c1-4edd-b428-d50f52dd03bf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:15.384925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7e09f8e6-74c1-4edd-b428-d50f52dd03bf tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087446 Aug 24 05:24:15.385505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1237/2364] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:15.780441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c229f9ad-3c41-4c37-850b-8c6b79dec852 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:15.781085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c229f9ad-3c41-4c37-850b-8c6b79dec852 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:15.787959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c229f9ad-3c41-4c37-850b-8c6b79dec852 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:15.788451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c229f9ad-3c41-4c37-850b-8c6b79dec852 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:15.788889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c229f9ad-3c41-4c37-850b-8c6b79dec852 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:15.789582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c229f9ad-3c41-4c37-850b-8c6b79dec852 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:15.790038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c229f9ad-3c41-4c37-850b-8c6b79dec852 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:15.790458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c229f9ad-3c41-4c37-850b-8c6b79dec852 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:15.856677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c229f9ad-3c41-4c37-850b-8c6b79dec852 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:15.865421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c229f9ad-3c41-4c37-850b-8c6b79dec852 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088822 Aug 24 05:24:15.865997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1128/2365] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:16.329322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3dd9a3ca-3f36-493a-ac31-f30db43840e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:16.329953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3dd9a3ca-3f36-493a-ac31-f30db43840e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:16.337518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dd9a3ca-3f36-493a-ac31-f30db43840e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:16.337989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dd9a3ca-3f36-493a-ac31-f30db43840e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:16.338712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dd9a3ca-3f36-493a-ac31-f30db43840e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:16.339749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dd9a3ca-3f36-493a-ac31-f30db43840e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:16.340197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dd9a3ca-3f36-493a-ac31-f30db43840e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:16.340773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dd9a3ca-3f36-493a-ac31-f30db43840e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:16.406842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-49a66a33-dc9a-4e6f-9a37-bf3ad575371d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:16.407463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-49a66a33-dc9a-4e6f-9a37-bf3ad575371d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:16.414934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49a66a33-dc9a-4e6f-9a37-bf3ad575371d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:16.415104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3dd9a3ca-3f36-493a-ac31-f30db43840e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:16.415426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49a66a33-dc9a-4e6f-9a37-bf3ad575371d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:16.415863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49a66a33-dc9a-4e6f-9a37-bf3ad575371d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:16.416585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49a66a33-dc9a-4e6f-9a37-bf3ad575371d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:16.417241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49a66a33-dc9a-4e6f-9a37-bf3ad575371d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:16.417675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49a66a33-dc9a-4e6f-9a37-bf3ad575371d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:16.423423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3dd9a3ca-3f36-493a-ac31-f30db43840e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.097896 Aug 24 05:24:16.423997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1238/2366] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:16 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:16.482347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-49a66a33-dc9a-4e6f-9a37-bf3ad575371d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:16.491149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-49a66a33-dc9a-4e6f-9a37-bf3ad575371d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088192 Aug 24 05:24:16.491731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1129/2367] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:16.887115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-667770f5-cd27-4a6e-9d90-8281192ce7f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:16.887716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-667770f5-cd27-4a6e-9d90-8281192ce7f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:16.893674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-667770f5-cd27-4a6e-9d90-8281192ce7f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:16.894700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-667770f5-cd27-4a6e-9d90-8281192ce7f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:16.895224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-667770f5-cd27-4a6e-9d90-8281192ce7f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:16.895898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-667770f5-cd27-4a6e-9d90-8281192ce7f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:16.896340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-667770f5-cd27-4a6e-9d90-8281192ce7f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:16.896763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-667770f5-cd27-4a6e-9d90-8281192ce7f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:16.958939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-667770f5-cd27-4a6e-9d90-8281192ce7f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:16.967288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-667770f5-cd27-4a6e-9d90-8281192ce7f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.083985 Aug 24 05:24:16.967861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1239/2368] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:16 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:17.444427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2774cf33-9f78-4509-af92-8578e7b25773 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:17.445060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2774cf33-9f78-4509-af92-8578e7b25773 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:17.451734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2774cf33-9f78-4509-af92-8578e7b25773 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:17.452219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2774cf33-9f78-4509-af92-8578e7b25773 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:17.452654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2774cf33-9f78-4509-af92-8578e7b25773 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:17.453349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2774cf33-9f78-4509-af92-8578e7b25773 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:17.453799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2774cf33-9f78-4509-af92-8578e7b25773 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:17.454221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2774cf33-9f78-4509-af92-8578e7b25773 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:17.511869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82e287aa-1260-4ce0-865f-fbcde62b8c51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:17.512481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-82e287aa-1260-4ce0-865f-fbcde62b8c51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:17.518088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2774cf33-9f78-4509-af92-8578e7b25773 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:17.519910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82e287aa-1260-4ce0-865f-fbcde62b8c51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:17.520386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82e287aa-1260-4ce0-865f-fbcde62b8c51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:17.520818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82e287aa-1260-4ce0-865f-fbcde62b8c51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:17.521506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82e287aa-1260-4ce0-865f-fbcde62b8c51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:17.521951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82e287aa-1260-4ce0-865f-fbcde62b8c51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:17.522371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82e287aa-1260-4ce0-865f-fbcde62b8c51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:17.527679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2774cf33-9f78-4509-af92-8578e7b25773 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087887 Aug 24 05:24:17.528257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1130/2369] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:17.587445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-82e287aa-1260-4ce0-865f-fbcde62b8c51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:17.595840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-82e287aa-1260-4ce0-865f-fbcde62b8c51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087694 Aug 24 05:24:17.596349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1240/2370] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:17 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:17.991545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d32f2b87-5f4c-46a1-9100-cff6532e8ff6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:17.992159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d32f2b87-5f4c-46a1-9100-cff6532e8ff6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:17.998288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d32f2b87-5f4c-46a1-9100-cff6532e8ff6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:17.998810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d32f2b87-5f4c-46a1-9100-cff6532e8ff6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:17.999250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d32f2b87-5f4c-46a1-9100-cff6532e8ff6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:17.999944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d32f2b87-5f4c-46a1-9100-cff6532e8ff6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:18.000395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d32f2b87-5f4c-46a1-9100-cff6532e8ff6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:18.000818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d32f2b87-5f4c-46a1-9100-cff6532e8ff6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:18.069188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d32f2b87-5f4c-46a1-9100-cff6532e8ff6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:18.071433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:18.078958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d32f2b87-5f4c-46a1-9100-cff6532e8ff6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093572 Aug 24 05:24:18.079527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1131/2371] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:18.550032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5a828cb0-2602-4d4a-bac0-437bf19a7b02 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:18.550642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5a828cb0-2602-4d4a-bac0-437bf19a7b02 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:18.557899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a828cb0-2602-4d4a-bac0-437bf19a7b02 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:18.558385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a828cb0-2602-4d4a-bac0-437bf19a7b02 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:18.558854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a828cb0-2602-4d4a-bac0-437bf19a7b02 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:18.559551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a828cb0-2602-4d4a-bac0-437bf19a7b02 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:18.560003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a828cb0-2602-4d4a-bac0-437bf19a7b02 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:18.560425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5a828cb0-2602-4d4a-bac0-437bf19a7b02 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:18.616925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e67e48ff-9be3-49a8-a53e-2a92544368c1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:18.617539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e67e48ff-9be3-49a8-a53e-2a92544368c1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:18.624016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5a828cb0-2602-4d4a-bac0-437bf19a7b02 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:18.624613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e67e48ff-9be3-49a8-a53e-2a92544368c1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:18.625172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e67e48ff-9be3-49a8-a53e-2a92544368c1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:18.625673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e67e48ff-9be3-49a8-a53e-2a92544368c1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:18.626465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e67e48ff-9be3-49a8-a53e-2a92544368c1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:18.627015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e67e48ff-9be3-49a8-a53e-2a92544368c1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:18.627439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e67e48ff-9be3-49a8-a53e-2a92544368c1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:18.632835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5a828cb0-2602-4d4a-bac0-437bf19a7b02 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086605 Aug 24 05:24:18.633427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1241/2372] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:18.697117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e67e48ff-9be3-49a8-a53e-2a92544368c1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:18.705505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e67e48ff-9be3-49a8-a53e-2a92544368c1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092634 Aug 24 05:24:18.706636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1132/2373] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:19.100380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cb13a6d8-ce67-413d-9dd6-4fb0648297dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:19.100991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cb13a6d8-ce67-413d-9dd6-4fb0648297dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:19.107198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb13a6d8-ce67-413d-9dd6-4fb0648297dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:19.107678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb13a6d8-ce67-413d-9dd6-4fb0648297dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:19.108108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb13a6d8-ce67-413d-9dd6-4fb0648297dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:19.108796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb13a6d8-ce67-413d-9dd6-4fb0648297dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:19.109244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb13a6d8-ce67-413d-9dd6-4fb0648297dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:19.109660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cb13a6d8-ce67-413d-9dd6-4fb0648297dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:19.181414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cb13a6d8-ce67-413d-9dd6-4fb0648297dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:19.189840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cb13a6d8-ce67-413d-9dd6-4fb0648297dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093822 Aug 24 05:24:19.190413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1242/2374] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:19.655202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-66319aef-7282-49d4-828f-e486fd5d7ad4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:19.655845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-66319aef-7282-49d4-828f-e486fd5d7ad4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:19.663031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66319aef-7282-49d4-828f-e486fd5d7ad4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:19.663524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66319aef-7282-49d4-828f-e486fd5d7ad4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:19.663959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66319aef-7282-49d4-828f-e486fd5d7ad4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:19.664682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66319aef-7282-49d4-828f-e486fd5d7ad4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:19.665140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66319aef-7282-49d4-828f-e486fd5d7ad4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:19.665763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66319aef-7282-49d4-828f-e486fd5d7ad4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:19.726656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3069afad-57cc-442a-9894-a670b0dea663 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:19.727285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3069afad-57cc-442a-9894-a670b0dea663 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:19.730858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-66319aef-7282-49d4-828f-e486fd5d7ad4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:19.735562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3069afad-57cc-442a-9894-a670b0dea663 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:19.735706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3069afad-57cc-442a-9894-a670b0dea663 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:19.736045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3069afad-57cc-442a-9894-a670b0dea663 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:19.736735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3069afad-57cc-442a-9894-a670b0dea663 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:19.737186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3069afad-57cc-442a-9894-a670b0dea663 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:19.737670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3069afad-57cc-442a-9894-a670b0dea663 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:19.739423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-66319aef-7282-49d4-828f-e486fd5d7ad4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088037 Aug 24 05:24:19.740003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1133/2375] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:19.803111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3069afad-57cc-442a-9894-a670b0dea663 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:19.811847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3069afad-57cc-442a-9894-a670b0dea663 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089064 Aug 24 05:24:19.812432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1243/2376] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:20.214021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d5dc163f-3e4c-484f-9c1f-e5d1325b98f4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:20.214775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d5dc163f-3e4c-484f-9c1f-e5d1325b98f4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:20.221757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dc163f-3e4c-484f-9c1f-e5d1325b98f4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:20.222914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dc163f-3e4c-484f-9c1f-e5d1325b98f4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:20.223350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dc163f-3e4c-484f-9c1f-e5d1325b98f4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:20.224041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dc163f-3e4c-484f-9c1f-e5d1325b98f4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:20.224485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dc163f-3e4c-484f-9c1f-e5d1325b98f4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:20.225017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dc163f-3e4c-484f-9c1f-e5d1325b98f4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:20.291510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d5dc163f-3e4c-484f-9c1f-e5d1325b98f4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:20.300466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d5dc163f-3e4c-484f-9c1f-e5d1325b98f4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091701 Aug 24 05:24:20.301150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1134/2377] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:20.765220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e9b9125d-8b55-4da5-b747-46eb9ce00af2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:20.765784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e9b9125d-8b55-4da5-b747-46eb9ce00af2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:20.768099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=82 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:20.775132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9b9125d-8b55-4da5-b747-46eb9ce00af2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:20.775615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9b9125d-8b55-4da5-b747-46eb9ce00af2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:20.776045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9b9125d-8b55-4da5-b747-46eb9ce00af2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:20.776736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9b9125d-8b55-4da5-b747-46eb9ce00af2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:20.777183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9b9125d-8b55-4da5-b747-46eb9ce00af2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:20.777596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e9b9125d-8b55-4da5-b747-46eb9ce00af2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:20.833859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5bc80790-5468-4ff2-b141-b466baf6e534 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:20.834509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5bc80790-5468-4ff2-b141-b466baf6e534 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:20.841695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bc80790-5468-4ff2-b141-b466baf6e534 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:20.842258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bc80790-5468-4ff2-b141-b466baf6e534 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:20.842552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e9b9125d-8b55-4da5-b747-46eb9ce00af2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:20.842883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bc80790-5468-4ff2-b141-b466baf6e534 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:20.843588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bc80790-5468-4ff2-b141-b466baf6e534 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:20.844042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bc80790-5468-4ff2-b141-b466baf6e534 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:20.844469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bc80790-5468-4ff2-b141-b466baf6e534 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:20.852015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e9b9125d-8b55-4da5-b747-46eb9ce00af2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090663 Aug 24 05:24:20.852595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1244/2378] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:20.915544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5bc80790-5468-4ff2-b141-b466baf6e534 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:20.924012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5bc80790-5468-4ff2-b141-b466baf6e534 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094491 Aug 24 05:24:20.924593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1135/2379] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:21.321892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b171c297-bc6c-4c1d-a6fe-609ac32046f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:21.322503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b171c297-bc6c-4c1d-a6fe-609ac32046f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:21.328791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b171c297-bc6c-4c1d-a6fe-609ac32046f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:21.329268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b171c297-bc6c-4c1d-a6fe-609ac32046f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:21.329695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b171c297-bc6c-4c1d-a6fe-609ac32046f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:21.330383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b171c297-bc6c-4c1d-a6fe-609ac32046f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:21.330864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b171c297-bc6c-4c1d-a6fe-609ac32046f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:21.331314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b171c297-bc6c-4c1d-a6fe-609ac32046f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:21.395632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b171c297-bc6c-4c1d-a6fe-609ac32046f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:21.404082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b171c297-bc6c-4c1d-a6fe-609ac32046f3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086164 Aug 24 05:24:21.404657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1245/2380] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:21.873067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-228dc916-0cc8-4586-8b2e-20eafc64e003 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:21.873661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-228dc916-0cc8-4586-8b2e-20eafc64e003 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:21.880969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-228dc916-0cc8-4586-8b2e-20eafc64e003 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:21.881446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-228dc916-0cc8-4586-8b2e-20eafc64e003 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:21.881875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-228dc916-0cc8-4586-8b2e-20eafc64e003 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:21.882555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-228dc916-0cc8-4586-8b2e-20eafc64e003 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:21.883026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-228dc916-0cc8-4586-8b2e-20eafc64e003 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:21.883439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-228dc916-0cc8-4586-8b2e-20eafc64e003 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:21.946429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-63531568-1b28-4972-a393-5999ea90e9d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:21.947079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-63531568-1b28-4972-a393-5999ea90e9d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:21.948342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-228dc916-0cc8-4586-8b2e-20eafc64e003 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:21.954871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63531568-1b28-4972-a393-5999ea90e9d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:21.955354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63531568-1b28-4972-a393-5999ea90e9d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:21.955788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63531568-1b28-4972-a393-5999ea90e9d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:21.956686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-228dc916-0cc8-4586-8b2e-20eafc64e003 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087452 Aug 24 05:24:21.956869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63531568-1b28-4972-a393-5999ea90e9d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:21.958997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1136/2381] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:21.959161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63531568-1b28-4972-a393-5999ea90e9d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:21.959161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-63531568-1b28-4972-a393-5999ea90e9d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:22.024754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-63531568-1b28-4972-a393-5999ea90e9d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:22.033186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-63531568-1b28-4972-a393-5999ea90e9d7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090992 Aug 24 05:24:22.033764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1246/2382] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:22.426913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c737a386-00cc-482d-afdc-3f6af80376dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:22.427451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c737a386-00cc-482d-afdc-3f6af80376dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:22.433774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c737a386-00cc-482d-afdc-3f6af80376dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:22.434247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c737a386-00cc-482d-afdc-3f6af80376dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:22.434675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c737a386-00cc-482d-afdc-3f6af80376dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:22.435384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c737a386-00cc-482d-afdc-3f6af80376dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:22.435833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c737a386-00cc-482d-afdc-3f6af80376dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:22.436251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c737a386-00cc-482d-afdc-3f6af80376dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:22.499653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c737a386-00cc-482d-afdc-3f6af80376dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:22.509370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c737a386-00cc-482d-afdc-3f6af80376dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087284 Aug 24 05:24:22.509938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1137/2383] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:22.978068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-422cab93-9bd9-4e17-951b-c0c67f846dd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:22.978662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-422cab93-9bd9-4e17-951b-c0c67f846dd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:22.985224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-422cab93-9bd9-4e17-951b-c0c67f846dd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:22.985627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-422cab93-9bd9-4e17-951b-c0c67f846dd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:22.986052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-422cab93-9bd9-4e17-951b-c0c67f846dd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:22.986752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-422cab93-9bd9-4e17-951b-c0c67f846dd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:22.987221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-422cab93-9bd9-4e17-951b-c0c67f846dd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:22.988252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-422cab93-9bd9-4e17-951b-c0c67f846dd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:23.052297 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-422cab93-9bd9-4e17-951b-c0c67f846dd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:23.055063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0ee3769e-0387-411c-b428-f21fa80e5fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:23.056041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0ee3769e-0387-411c-b428-f21fa80e5fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:23.061369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-422cab93-9bd9-4e17-951b-c0c67f846dd3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087246 Aug 24 05:24:23.061950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1247/2384] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:23.062619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee3769e-0387-411c-b428-f21fa80e5fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:23.063211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee3769e-0387-411c-b428-f21fa80e5fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:23.063650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee3769e-0387-411c-b428-f21fa80e5fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:23.064349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee3769e-0387-411c-b428-f21fa80e5fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:23.064807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee3769e-0387-411c-b428-f21fa80e5fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:23.065233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ee3769e-0387-411c-b428-f21fa80e5fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:23.130147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ee3769e-0387-411c-b428-f21fa80e5fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:23.139523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0ee3769e-0387-411c-b428-f21fa80e5fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088344 Aug 24 05:24:23.140107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1138/2385] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:23.531870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7d69c8e7-9d05-4aba-94f6-b7271f4e7857 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:23.532517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7d69c8e7-9d05-4aba-94f6-b7271f4e7857 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:23.539652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69c8e7-9d05-4aba-94f6-b7271f4e7857 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:23.540138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69c8e7-9d05-4aba-94f6-b7271f4e7857 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:23.540593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69c8e7-9d05-4aba-94f6-b7271f4e7857 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:23.541285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69c8e7-9d05-4aba-94f6-b7271f4e7857 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:23.541727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69c8e7-9d05-4aba-94f6-b7271f4e7857 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:23.542149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69c8e7-9d05-4aba-94f6-b7271f4e7857 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:23.608811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7d69c8e7-9d05-4aba-94f6-b7271f4e7857 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:23.619333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7d69c8e7-9d05-4aba-94f6-b7271f4e7857 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091201 Aug 24 05:24:23.619951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1248/2386] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:24.083561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f917395a-7d0f-427c-8932-8cb8a35e9128 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:24.084248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f917395a-7d0f-427c-8932-8cb8a35e9128 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:24.090836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f917395a-7d0f-427c-8932-8cb8a35e9128 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:24.091326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f917395a-7d0f-427c-8932-8cb8a35e9128 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:24.091796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f917395a-7d0f-427c-8932-8cb8a35e9128 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:24.092493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f917395a-7d0f-427c-8932-8cb8a35e9128 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:24.092948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f917395a-7d0f-427c-8932-8cb8a35e9128 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:24.093373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f917395a-7d0f-427c-8932-8cb8a35e9128 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:24.161934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6f3dd7be-0dc6-4608-b789-fed371d2b8fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:24.162341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6f3dd7be-0dc6-4608-b789-fed371d2b8fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:24.164103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f917395a-7d0f-427c-8932-8cb8a35e9128 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:24.168739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f3dd7be-0dc6-4608-b789-fed371d2b8fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:24.169466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f3dd7be-0dc6-4608-b789-fed371d2b8fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:24.169905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f3dd7be-0dc6-4608-b789-fed371d2b8fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:24.170612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f3dd7be-0dc6-4608-b789-fed371d2b8fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:24.171089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f3dd7be-0dc6-4608-b789-fed371d2b8fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:24.171515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f3dd7be-0dc6-4608-b789-fed371d2b8fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:24.172627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f917395a-7d0f-427c-8932-8cb8a35e9128 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093680 Aug 24 05:24:24.173208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1139/2387] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:24.238894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6f3dd7be-0dc6-4608-b789-fed371d2b8fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:24.248424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6f3dd7be-0dc6-4608-b789-fed371d2b8fd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092010 Aug 24 05:24:24.248996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1249/2388] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:24 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:24.640455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1207dd34-34f3-4592-ba97-0021923db550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:24.641102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1207dd34-34f3-4592-ba97-0021923db550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:24.647961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1207dd34-34f3-4592-ba97-0021923db550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:24.648450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1207dd34-34f3-4592-ba97-0021923db550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:24.648890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1207dd34-34f3-4592-ba97-0021923db550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:24.649585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1207dd34-34f3-4592-ba97-0021923db550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:24.650040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1207dd34-34f3-4592-ba97-0021923db550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:24.650489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1207dd34-34f3-4592-ba97-0021923db550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:24.713703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1207dd34-34f3-4592-ba97-0021923db550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:24.722922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1207dd34-34f3-4592-ba97-0021923db550 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085600 Aug 24 05:24:24.723509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1140/2389] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:25.195321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1a98eda3-3927-4dda-856f-12d6c1322965 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:25.195946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1a98eda3-3927-4dda-856f-12d6c1322965 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:25.202578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a98eda3-3927-4dda-856f-12d6c1322965 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:25.203095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a98eda3-3927-4dda-856f-12d6c1322965 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:25.203537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a98eda3-3927-4dda-856f-12d6c1322965 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:25.204220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a98eda3-3927-4dda-856f-12d6c1322965 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:25.204670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a98eda3-3927-4dda-856f-12d6c1322965 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:25.205091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a98eda3-3927-4dda-856f-12d6c1322965 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:25.208443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:25.270102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-485d41a2-b192-4e97-89b4-36f940b2a841 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:25.270790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-485d41a2-b192-4e97-89b4-36f940b2a841 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:25.273254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1a98eda3-3927-4dda-856f-12d6c1322965 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:25.277718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-485d41a2-b192-4e97-89b4-36f940b2a841 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:25.278215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-485d41a2-b192-4e97-89b4-36f940b2a841 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:25.278661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-485d41a2-b192-4e97-89b4-36f940b2a841 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:25.279388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-485d41a2-b192-4e97-89b4-36f940b2a841 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:25.279846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-485d41a2-b192-4e97-89b4-36f940b2a841 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:25.280270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-485d41a2-b192-4e97-89b4-36f940b2a841 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:25.284651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1a98eda3-3927-4dda-856f-12d6c1322965 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093893 Aug 24 05:24:25.285244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1250/2390] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:25.344686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-485d41a2-b192-4e97-89b4-36f940b2a841 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:25.353753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-485d41a2-b192-4e97-89b4-36f940b2a841 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088618 Aug 24 05:24:25.354314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1141/2391] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:25.745463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3cd1bd7d-003f-47e1-a10a-1b3b5a53d5db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:25.746075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3cd1bd7d-003f-47e1-a10a-1b3b5a53d5db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:25.752323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1bd7d-003f-47e1-a10a-1b3b5a53d5db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:25.753879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1bd7d-003f-47e1-a10a-1b3b5a53d5db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:25.753879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1bd7d-003f-47e1-a10a-1b3b5a53d5db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:25.754597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1bd7d-003f-47e1-a10a-1b3b5a53d5db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:25.755086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1bd7d-003f-47e1-a10a-1b3b5a53d5db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:25.755507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cd1bd7d-003f-47e1-a10a-1b3b5a53d5db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:25.824111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3cd1bd7d-003f-47e1-a10a-1b3b5a53d5db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:25.834713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3cd1bd7d-003f-47e1-a10a-1b3b5a53d5db tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.094028 Aug 24 05:24:25.835588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1251/2392] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:26.307276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ef116333-1267-456f-8f4f-4ea6b1fc4bcd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:26.307839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ef116333-1267-456f-8f4f-4ea6b1fc4bcd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:26.314302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef116333-1267-456f-8f4f-4ea6b1fc4bcd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:26.314815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef116333-1267-456f-8f4f-4ea6b1fc4bcd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:26.315257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef116333-1267-456f-8f4f-4ea6b1fc4bcd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:26.316970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef116333-1267-456f-8f4f-4ea6b1fc4bcd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:26.317428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef116333-1267-456f-8f4f-4ea6b1fc4bcd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:26.317853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ef116333-1267-456f-8f4f-4ea6b1fc4bcd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:26.374507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-affa693b-ec02-4217-a426-64abf8fca1c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:26.375210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-affa693b-ec02-4217-a426-64abf8fca1c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:26.383686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-affa693b-ec02-4217-a426-64abf8fca1c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:26.384170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-affa693b-ec02-4217-a426-64abf8fca1c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:26.384628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-affa693b-ec02-4217-a426-64abf8fca1c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:26.385332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-affa693b-ec02-4217-a426-64abf8fca1c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:26.386175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-affa693b-ec02-4217-a426-64abf8fca1c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:26.386175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-affa693b-ec02-4217-a426-64abf8fca1c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:26.388260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ef116333-1267-456f-8f4f-4ea6b1fc4bcd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:26.397319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ef116333-1267-456f-8f4f-4ea6b1fc4bcd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.094674 Aug 24 05:24:26.397910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1142/2393] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:26 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:26.453578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-affa693b-ec02-4217-a426-64abf8fca1c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:26.462422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-affa693b-ec02-4217-a426-64abf8fca1c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091781 Aug 24 05:24:26.463041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1252/2394] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:26.856421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-527e200a-2eef-473a-997a-b71b2b9e97fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:26.857039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-527e200a-2eef-473a-997a-b71b2b9e97fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:26.863277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-527e200a-2eef-473a-997a-b71b2b9e97fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:26.863761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-527e200a-2eef-473a-997a-b71b2b9e97fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:26.864197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-527e200a-2eef-473a-997a-b71b2b9e97fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:26.864890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-527e200a-2eef-473a-997a-b71b2b9e97fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:26.865339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-527e200a-2eef-473a-997a-b71b2b9e97fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:26.865763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-527e200a-2eef-473a-997a-b71b2b9e97fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:26.929258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-527e200a-2eef-473a-997a-b71b2b9e97fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:26.937725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-527e200a-2eef-473a-997a-b71b2b9e97fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085214 Aug 24 05:24:26.938277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1143/2395] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:27.418450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-98e55245-6ee3-47ef-8e15-217f9e2e0f72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:27.419103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-98e55245-6ee3-47ef-8e15-217f9e2e0f72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:27.426253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98e55245-6ee3-47ef-8e15-217f9e2e0f72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:27.426750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98e55245-6ee3-47ef-8e15-217f9e2e0f72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:27.427185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98e55245-6ee3-47ef-8e15-217f9e2e0f72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:27.427869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98e55245-6ee3-47ef-8e15-217f9e2e0f72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:27.428306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98e55245-6ee3-47ef-8e15-217f9e2e0f72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:27.428716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98e55245-6ee3-47ef-8e15-217f9e2e0f72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:27.483693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f3dff848-4a1b-453c-af78-2d86ded90ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:27.484299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f3dff848-4a1b-453c-af78-2d86ded90ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:27.491830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3dff848-4a1b-453c-af78-2d86ded90ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:27.492317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3dff848-4a1b-453c-af78-2d86ded90ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:27.492751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3dff848-4a1b-453c-af78-2d86ded90ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:27.492961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-98e55245-6ee3-47ef-8e15-217f9e2e0f72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:27.493449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3dff848-4a1b-453c-af78-2d86ded90ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:27.493902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3dff848-4a1b-453c-af78-2d86ded90ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:27.494325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3dff848-4a1b-453c-af78-2d86ded90ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:27.501639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-98e55245-6ee3-47ef-8e15-217f9e2e0f72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087076 Aug 24 05:24:27.506624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1253/2396] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:27.559623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f3dff848-4a1b-453c-af78-2d86ded90ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:27.567955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f3dff848-4a1b-453c-af78-2d86ded90ebd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088087 Aug 24 05:24:27.568527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1144/2397] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:27 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:27.959904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a489ac4a-5216-4ce9-a6db-9714897de42c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:27.960796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a489ac4a-5216-4ce9-a6db-9714897de42c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:27.968282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a489ac4a-5216-4ce9-a6db-9714897de42c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:27.968756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a489ac4a-5216-4ce9-a6db-9714897de42c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:27.969180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a489ac4a-5216-4ce9-a6db-9714897de42c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:27.969861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a489ac4a-5216-4ce9-a6db-9714897de42c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:27.970303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a489ac4a-5216-4ce9-a6db-9714897de42c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:27.970750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a489ac4a-5216-4ce9-a6db-9714897de42c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:28.036609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a489ac4a-5216-4ce9-a6db-9714897de42c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:28.044887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a489ac4a-5216-4ce9-a6db-9714897de42c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090163 Aug 24 05:24:28.045453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1254/2398] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:27 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:28.523985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3c9fb4b2-9d19-4539-bfe8-56b4fe102d73 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:28.524630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3c9fb4b2-9d19-4539-bfe8-56b4fe102d73 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:28.531156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9fb4b2-9d19-4539-bfe8-56b4fe102d73 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:28.531640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9fb4b2-9d19-4539-bfe8-56b4fe102d73 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:28.532075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9fb4b2-9d19-4539-bfe8-56b4fe102d73 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:28.532762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9fb4b2-9d19-4539-bfe8-56b4fe102d73 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:28.533210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9fb4b2-9d19-4539-bfe8-56b4fe102d73 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:28.533629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9fb4b2-9d19-4539-bfe8-56b4fe102d73 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:28.588544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f7bb9e9b-07a3-4cb4-a243-81a2c1101575 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:28.589159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f7bb9e9b-07a3-4cb4-a243-81a2c1101575 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:28.595745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7bb9e9b-07a3-4cb4-a243-81a2c1101575 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:28.596237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7bb9e9b-07a3-4cb4-a243-81a2c1101575 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:28.597358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7bb9e9b-07a3-4cb4-a243-81a2c1101575 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:28.597575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c9fb4b2-9d19-4539-bfe8-56b4fe102d73 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:28.598049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7bb9e9b-07a3-4cb4-a243-81a2c1101575 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:28.598499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7bb9e9b-07a3-4cb4-a243-81a2c1101575 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:28.598949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7bb9e9b-07a3-4cb4-a243-81a2c1101575 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:28.606022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3c9fb4b2-9d19-4539-bfe8-56b4fe102d73 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085918 Aug 24 05:24:28.606882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1145/2399] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:28.663431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f7bb9e9b-07a3-4cb4-a243-81a2c1101575 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:28.671579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f7bb9e9b-07a3-4cb4-a243-81a2c1101575 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086906 Aug 24 05:24:28.672139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1255/2400] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:29.066669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-00f37a2b-1a68-462a-96ce-db205f968248 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:29.067310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-00f37a2b-1a68-462a-96ce-db205f968248 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:29.073407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00f37a2b-1a68-462a-96ce-db205f968248 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:29.073886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00f37a2b-1a68-462a-96ce-db205f968248 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:29.074321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00f37a2b-1a68-462a-96ce-db205f968248 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:29.075042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00f37a2b-1a68-462a-96ce-db205f968248 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:29.075500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00f37a2b-1a68-462a-96ce-db205f968248 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:29.075920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-00f37a2b-1a68-462a-96ce-db205f968248 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:29.145180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-00f37a2b-1a68-462a-96ce-db205f968248 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:29.153630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-00f37a2b-1a68-462a-96ce-db205f968248 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090898 Aug 24 05:24:29.154205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1146/2401] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:29.626490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8a9909e1-841e-414c-86f5-63e973332029 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:29.627058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8a9909e1-841e-414c-86f5-63e973332029 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:29.634018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a9909e1-841e-414c-86f5-63e973332029 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:29.634647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a9909e1-841e-414c-86f5-63e973332029 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:29.635205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a9909e1-841e-414c-86f5-63e973332029 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:29.635954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a9909e1-841e-414c-86f5-63e973332029 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:29.636400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a9909e1-841e-414c-86f5-63e973332029 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:29.636811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a9909e1-841e-414c-86f5-63e973332029 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:29.693748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8d5fa89f-ece7-4094-b856-8c032ce933e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:29.694376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8d5fa89f-ece7-4094-b856-8c032ce933e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:29.701214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d5fa89f-ece7-4094-b856-8c032ce933e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:29.701706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d5fa89f-ece7-4094-b856-8c032ce933e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:29.702146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d5fa89f-ece7-4094-b856-8c032ce933e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:29.702417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8a9909e1-841e-414c-86f5-63e973332029 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:29.702866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d5fa89f-ece7-4094-b856-8c032ce933e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:29.703322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d5fa89f-ece7-4094-b856-8c032ce933e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:29.703744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d5fa89f-ece7-4094-b856-8c032ce933e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:29.711566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8a9909e1-841e-414c-86f5-63e973332029 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088951 Aug 24 05:24:29.712148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1256/2402] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:29.770079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8d5fa89f-ece7-4094-b856-8c032ce933e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:29.778489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8d5fa89f-ece7-4094-b856-8c032ce933e3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089430 Aug 24 05:24:29.779086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1147/2403] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:30.173936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2dc56306-1cc3-42fa-a4ea-f990a256c39e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:30.174593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2dc56306-1cc3-42fa-a4ea-f990a256c39e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:30.181506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2dc56306-1cc3-42fa-a4ea-f990a256c39e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:30.181988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2dc56306-1cc3-42fa-a4ea-f990a256c39e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:30.182424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2dc56306-1cc3-42fa-a4ea-f990a256c39e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:30.183150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2dc56306-1cc3-42fa-a4ea-f990a256c39e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:30.183601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2dc56306-1cc3-42fa-a4ea-f990a256c39e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:30.184055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2dc56306-1cc3-42fa-a4ea-f990a256c39e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:30.250328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2dc56306-1cc3-42fa-a4ea-f990a256c39e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:30.259541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2dc56306-1cc3-42fa-a4ea-f990a256c39e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089397 Aug 24 05:24:30.260139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1257/2404] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:30.732512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-30bbbb7e-422a-4fec-a575-d9bfdb4ad9f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:30.733195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-30bbbb7e-422a-4fec-a575-d9bfdb4ad9f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:30.740072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30bbbb7e-422a-4fec-a575-d9bfdb4ad9f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:30.740564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30bbbb7e-422a-4fec-a575-d9bfdb4ad9f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:30.741000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30bbbb7e-422a-4fec-a575-d9bfdb4ad9f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:30.741708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30bbbb7e-422a-4fec-a575-d9bfdb4ad9f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:30.742161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30bbbb7e-422a-4fec-a575-d9bfdb4ad9f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:30.742585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30bbbb7e-422a-4fec-a575-d9bfdb4ad9f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:30.759944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:30.800763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0ede5af1-e25e-453c-ab94-f81d2d700929 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:30.801359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0ede5af1-e25e-453c-ab94-f81d2d700929 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:30.809314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ede5af1-e25e-453c-ab94-f81d2d700929 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:30.809692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-30bbbb7e-422a-4fec-a575-d9bfdb4ad9f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:30.809835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ede5af1-e25e-453c-ab94-f81d2d700929 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:30.810243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ede5af1-e25e-453c-ab94-f81d2d700929 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:30.810959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ede5af1-e25e-453c-ab94-f81d2d700929 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:30.811401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ede5af1-e25e-453c-ab94-f81d2d700929 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:30.811842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0ede5af1-e25e-453c-ab94-f81d2d700929 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:30.818928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-30bbbb7e-422a-4fec-a575-d9bfdb4ad9f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090442 Aug 24 05:24:30.819509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1148/2405] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:30.879084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0ede5af1-e25e-453c-ab94-f81d2d700929 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:30.887486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0ede5af1-e25e-453c-ab94-f81d2d700929 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091373 Aug 24 05:24:30.888063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1258/2406] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:31.281539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eb32c219-3b50-4c50-a740-9e402421e78d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:31.282161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-eb32c219-3b50-4c50-a740-9e402421e78d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:31.290401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb32c219-3b50-4c50-a740-9e402421e78d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:31.290917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb32c219-3b50-4c50-a740-9e402421e78d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:31.291357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb32c219-3b50-4c50-a740-9e402421e78d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:31.292055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb32c219-3b50-4c50-a740-9e402421e78d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:31.292517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb32c219-3b50-4c50-a740-9e402421e78d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:31.292939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb32c219-3b50-4c50-a740-9e402421e78d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:31.360788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-eb32c219-3b50-4c50-a740-9e402421e78d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:31.370052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-eb32c219-3b50-4c50-a740-9e402421e78d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092366 Aug 24 05:24:31.370635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1149/2407] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:31.839233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f343bc17-24c7-49a7-b900-401df34214bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:31.839844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f343bc17-24c7-49a7-b900-401df34214bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:31.847137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f343bc17-24c7-49a7-b900-401df34214bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:31.847631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f343bc17-24c7-49a7-b900-401df34214bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:31.848065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f343bc17-24c7-49a7-b900-401df34214bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:31.848757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f343bc17-24c7-49a7-b900-401df34214bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:31.849206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f343bc17-24c7-49a7-b900-401df34214bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:31.849686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f343bc17-24c7-49a7-b900-401df34214bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:31.908263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3a1552e8-09e4-4895-90d8-c9498db59c6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:31.909780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3a1552e8-09e4-4895-90d8-c9498db59c6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:31.918477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1552e8-09e4-4895-90d8-c9498db59c6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:31.919263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1552e8-09e4-4895-90d8-c9498db59c6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:31.919424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1552e8-09e4-4895-90d8-c9498db59c6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:31.920219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1552e8-09e4-4895-90d8-c9498db59c6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:31.920676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1552e8-09e4-4895-90d8-c9498db59c6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:31.921098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3a1552e8-09e4-4895-90d8-c9498db59c6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:31.921276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f343bc17-24c7-49a7-b900-401df34214bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:31.932227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f343bc17-24c7-49a7-b900-401df34214bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.096003 Aug 24 05:24:31.932227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1259/2408] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:31.995183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3a1552e8-09e4-4895-90d8-c9498db59c6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:32.004056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3a1552e8-09e4-4895-90d8-c9498db59c6c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.099574 Aug 24 05:24:32.004634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1150/2409] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:32.392051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1c809e2c-ce6c-45b8-8310-8bd6650205e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:32.392563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1c809e2c-ce6c-45b8-8310-8bd6650205e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:32.399383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c809e2c-ce6c-45b8-8310-8bd6650205e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:32.400240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c809e2c-ce6c-45b8-8310-8bd6650205e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:32.401040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c809e2c-ce6c-45b8-8310-8bd6650205e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:32.402264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c809e2c-ce6c-45b8-8310-8bd6650205e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:32.403168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c809e2c-ce6c-45b8-8310-8bd6650205e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:32.404031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1c809e2c-ce6c-45b8-8310-8bd6650205e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:32.474440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1c809e2c-ce6c-45b8-8310-8bd6650205e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:32.484050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1c809e2c-ce6c-45b8-8310-8bd6650205e7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095629 Aug 24 05:24:32.484635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1260/2410] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:32.955404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1e14a918-6cd4-4e0c-9394-7dd941aaed0a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:32.956577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1e14a918-6cd4-4e0c-9394-7dd941aaed0a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:32.963831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e14a918-6cd4-4e0c-9394-7dd941aaed0a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:32.964308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e14a918-6cd4-4e0c-9394-7dd941aaed0a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:32.964737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e14a918-6cd4-4e0c-9394-7dd941aaed0a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:32.965428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e14a918-6cd4-4e0c-9394-7dd941aaed0a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:32.965875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e14a918-6cd4-4e0c-9394-7dd941aaed0a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:32.966294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1e14a918-6cd4-4e0c-9394-7dd941aaed0a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:33.026021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4dc65a48-d2de-4e72-b713-6a37ec6150d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:33.026718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4dc65a48-d2de-4e72-b713-6a37ec6150d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:33.037537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dc65a48-d2de-4e72-b713-6a37ec6150d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:33.038766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dc65a48-d2de-4e72-b713-6a37ec6150d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:33.039244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dc65a48-d2de-4e72-b713-6a37ec6150d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:33.040533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dc65a48-d2de-4e72-b713-6a37ec6150d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:33.041134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1e14a918-6cd4-4e0c-9394-7dd941aaed0a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:33.041385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dc65a48-d2de-4e72-b713-6a37ec6150d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:33.042173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4dc65a48-d2de-4e72-b713-6a37ec6150d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:33.049707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1e14a918-6cd4-4e0c-9394-7dd941aaed0a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.098099 Aug 24 05:24:33.050286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1151/2411] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:33.108681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4dc65a48-d2de-4e72-b713-6a37ec6150d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:33.119892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4dc65a48-d2de-4e72-b713-6a37ec6150d8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.098536 Aug 24 05:24:33.120480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1261/2412] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:33 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:33.504848 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-baf8e3f5-8f43-4593-8c43-d2aaddeecd37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:33.505499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-baf8e3f5-8f43-4593-8c43-d2aaddeecd37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:33.512050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baf8e3f5-8f43-4593-8c43-d2aaddeecd37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:33.512537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baf8e3f5-8f43-4593-8c43-d2aaddeecd37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:33.512978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baf8e3f5-8f43-4593-8c43-d2aaddeecd37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:33.513682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baf8e3f5-8f43-4593-8c43-d2aaddeecd37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:33.514137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baf8e3f5-8f43-4593-8c43-d2aaddeecd37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:33.514562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-baf8e3f5-8f43-4593-8c43-d2aaddeecd37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:33.586990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-baf8e3f5-8f43-4593-8c43-d2aaddeecd37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:33.595286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-baf8e3f5-8f43-4593-8c43-d2aaddeecd37 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.094460 Aug 24 05:24:33.595854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1152/2413] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:34.071560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0262a172-da42-40df-8cb3-3ae1d7519aa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:34.072103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0262a172-da42-40df-8cb3-3ae1d7519aa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:34.078495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0262a172-da42-40df-8cb3-3ae1d7519aa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:34.079001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0262a172-da42-40df-8cb3-3ae1d7519aa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:34.079434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0262a172-da42-40df-8cb3-3ae1d7519aa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:34.080113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0262a172-da42-40df-8cb3-3ae1d7519aa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:34.080562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0262a172-da42-40df-8cb3-3ae1d7519aa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:34.081640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0262a172-da42-40df-8cb3-3ae1d7519aa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:34.141433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-36d84574-9ba5-4e4d-8f2a-3921fad93ae9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:34.142033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-36d84574-9ba5-4e4d-8f2a-3921fad93ae9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:34.147885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0262a172-da42-40df-8cb3-3ae1d7519aa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:34.149476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36d84574-9ba5-4e4d-8f2a-3921fad93ae9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:34.149965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36d84574-9ba5-4e4d-8f2a-3921fad93ae9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:34.150398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36d84574-9ba5-4e4d-8f2a-3921fad93ae9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:34.151133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36d84574-9ba5-4e4d-8f2a-3921fad93ae9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:34.151660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36d84574-9ba5-4e4d-8f2a-3921fad93ae9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:34.152084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36d84574-9ba5-4e4d-8f2a-3921fad93ae9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:34.157819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0262a172-da42-40df-8cb3-3ae1d7519aa1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090159 Aug 24 05:24:34.158396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1262/2414] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:34.219437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-36d84574-9ba5-4e4d-8f2a-3921fad93ae9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:34.227885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-36d84574-9ba5-4e4d-8f2a-3921fad93ae9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090260 Aug 24 05:24:34.228450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1153/2415] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:34.616876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-914f5af1-c3ec-4a69-accb-9c4d055ec0d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:34.617586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-914f5af1-c3ec-4a69-accb-9c4d055ec0d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:34.625222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-914f5af1-c3ec-4a69-accb-9c4d055ec0d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:34.625706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-914f5af1-c3ec-4a69-accb-9c4d055ec0d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:34.626145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-914f5af1-c3ec-4a69-accb-9c4d055ec0d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:34.626878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-914f5af1-c3ec-4a69-accb-9c4d055ec0d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:34.627333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-914f5af1-c3ec-4a69-accb-9c4d055ec0d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:34.628482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-914f5af1-c3ec-4a69-accb-9c4d055ec0d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:34.693200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-914f5af1-c3ec-4a69-accb-9c4d055ec0d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:34.701862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-914f5af1-c3ec-4a69-accb-9c4d055ec0d9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088981 Aug 24 05:24:34.702424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1263/2416] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:34 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:35.179340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f0f0ae58-fc5d-4b01-ae8d-3042604b6612 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:35.180187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f0f0ae58-fc5d-4b01-ae8d-3042604b6612 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:35.186845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0f0ae58-fc5d-4b01-ae8d-3042604b6612 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:35.187334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0f0ae58-fc5d-4b01-ae8d-3042604b6612 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:35.187821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0f0ae58-fc5d-4b01-ae8d-3042604b6612 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:35.188490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0f0ae58-fc5d-4b01-ae8d-3042604b6612 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:35.188942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0f0ae58-fc5d-4b01-ae8d-3042604b6612 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:35.189365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0f0ae58-fc5d-4b01-ae8d-3042604b6612 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:35.249116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-58c462e6-4a4c-4aae-9dc3-4224c7d16f71 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:35.249753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-58c462e6-4a4c-4aae-9dc3-4224c7d16f71 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:35.256512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58c462e6-4a4c-4aae-9dc3-4224c7d16f71 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:35.256997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58c462e6-4a4c-4aae-9dc3-4224c7d16f71 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:35.257609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58c462e6-4a4c-4aae-9dc3-4224c7d16f71 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:35.258100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58c462e6-4a4c-4aae-9dc3-4224c7d16f71 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:35.258547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58c462e6-4a4c-4aae-9dc3-4224c7d16f71 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:35.258989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58c462e6-4a4c-4aae-9dc3-4224c7d16f71 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:35.260525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f0f0ae58-fc5d-4b01-ae8d-3042604b6612 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:35.269111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f0f0ae58-fc5d-4b01-ae8d-3042604b6612 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093288 Aug 24 05:24:35.269671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1154/2417] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:35.324775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-58c462e6-4a4c-4aae-9dc3-4224c7d16f71 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:35.333015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-58c462e6-4a4c-4aae-9dc3-4224c7d16f71 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087802 Aug 24 05:24:35.333581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1264/2418] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:35 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:35.727282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-658726d3-fd6c-4552-9fce-e009f3373b18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:35.728157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-658726d3-fd6c-4552-9fce-e009f3373b18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:35.738342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-658726d3-fd6c-4552-9fce-e009f3373b18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:35.738342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-658726d3-fd6c-4552-9fce-e009f3373b18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:35.738942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-658726d3-fd6c-4552-9fce-e009f3373b18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:35.739771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-658726d3-fd6c-4552-9fce-e009f3373b18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:35.740254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-658726d3-fd6c-4552-9fce-e009f3373b18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:35.740709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-658726d3-fd6c-4552-9fce-e009f3373b18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:35.811565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-658726d3-fd6c-4552-9fce-e009f3373b18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:35.820194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-658726d3-fd6c-4552-9fce-e009f3373b18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.100190 Aug 24 05:24:35.820764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1155/2419] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:36.290185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f4051348-250e-499b-97be-54da89037f93 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:36.290811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f4051348-250e-499b-97be-54da89037f93 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:36.297369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4051348-250e-499b-97be-54da89037f93 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:36.297853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4051348-250e-499b-97be-54da89037f93 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:36.298287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4051348-250e-499b-97be-54da89037f93 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:36.299120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4051348-250e-499b-97be-54da89037f93 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:36.299738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4051348-250e-499b-97be-54da89037f93 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:36.300286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4051348-250e-499b-97be-54da89037f93 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:36.353942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2f9085c5-bd16-4a9e-8fc4-8b184c5e1d8f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:36.354553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2f9085c5-bd16-4a9e-8fc4-8b184c5e1d8f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:36.361245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f9085c5-bd16-4a9e-8fc4-8b184c5e1d8f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:36.361729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f9085c5-bd16-4a9e-8fc4-8b184c5e1d8f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:36.362990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f9085c5-bd16-4a9e-8fc4-8b184c5e1d8f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:36.363611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f9085c5-bd16-4a9e-8fc4-8b184c5e1d8f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:36.364069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f9085c5-bd16-4a9e-8fc4-8b184c5e1d8f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:36.364493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f9085c5-bd16-4a9e-8fc4-8b184c5e1d8f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:36.365022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f4051348-250e-499b-97be-54da89037f93 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:36.373938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f4051348-250e-499b-97be-54da89037f93 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087692 Aug 24 05:24:36.374522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1265/2420] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:36.432021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2f9085c5-bd16-4a9e-8fc4-8b184c5e1d8f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:36.442931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2f9085c5-bd16-4a9e-8fc4-8b184c5e1d8f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092916 Aug 24 05:24:36.443508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1156/2421] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:36 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:36.842454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a396c9a9-9215-49ed-8be9-3d37e91490b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:36.843098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a396c9a9-9215-49ed-8be9-3d37e91490b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:36.850071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a396c9a9-9215-49ed-8be9-3d37e91490b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:36.850554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a396c9a9-9215-49ed-8be9-3d37e91490b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:36.851022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a396c9a9-9215-49ed-8be9-3d37e91490b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:36.851713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a396c9a9-9215-49ed-8be9-3d37e91490b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:36.852163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a396c9a9-9215-49ed-8be9-3d37e91490b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:36.852620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a396c9a9-9215-49ed-8be9-3d37e91490b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:36.920261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a396c9a9-9215-49ed-8be9-3d37e91490b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:36.922454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:36.930009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a396c9a9-9215-49ed-8be9-3d37e91490b0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091783 Aug 24 05:24:36.930949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1266/2422] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:37.396083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-16fc7aa4-abbb-49fd-9e0b-18b2d117d67b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:37.396693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-16fc7aa4-abbb-49fd-9e0b-18b2d117d67b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:37.403001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16fc7aa4-abbb-49fd-9e0b-18b2d117d67b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:37.403481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16fc7aa4-abbb-49fd-9e0b-18b2d117d67b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:37.403910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16fc7aa4-abbb-49fd-9e0b-18b2d117d67b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:37.404592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16fc7aa4-abbb-49fd-9e0b-18b2d117d67b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:37.405064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16fc7aa4-abbb-49fd-9e0b-18b2d117d67b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:37.405450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16fc7aa4-abbb-49fd-9e0b-18b2d117d67b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:37.463425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-67293efd-e1f5-415a-bdb8-c2e9c952ece7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:37.464028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-67293efd-e1f5-415a-bdb8-c2e9c952ece7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:37.470590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67293efd-e1f5-415a-bdb8-c2e9c952ece7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:37.470870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-16fc7aa4-abbb-49fd-9e0b-18b2d117d67b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:37.471126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67293efd-e1f5-415a-bdb8-c2e9c952ece7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:37.472118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67293efd-e1f5-415a-bdb8-c2e9c952ece7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:37.473120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67293efd-e1f5-415a-bdb8-c2e9c952ece7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:37.473834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67293efd-e1f5-415a-bdb8-c2e9c952ece7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:37.474073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67293efd-e1f5-415a-bdb8-c2e9c952ece7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:37.480483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-16fc7aa4-abbb-49fd-9e0b-18b2d117d67b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089145 Aug 24 05:24:37.482010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1157/2423] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:37.539136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-67293efd-e1f5-415a-bdb8-c2e9c952ece7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:37.547521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-67293efd-e1f5-415a-bdb8-c2e9c952ece7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087911 Aug 24 05:24:37.548096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1267/2424] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:37.952838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a21d1752-7534-4033-b2c6-40a5d3ea35fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:37.953445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a21d1752-7534-4033-b2c6-40a5d3ea35fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:37.960130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a21d1752-7534-4033-b2c6-40a5d3ea35fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:37.960618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a21d1752-7534-4033-b2c6-40a5d3ea35fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:37.961056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a21d1752-7534-4033-b2c6-40a5d3ea35fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:37.961745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a21d1752-7534-4033-b2c6-40a5d3ea35fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:37.962198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a21d1752-7534-4033-b2c6-40a5d3ea35fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:37.962619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a21d1752-7534-4033-b2c6-40a5d3ea35fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:38.033300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a21d1752-7534-4033-b2c6-40a5d3ea35fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:38.042387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a21d1752-7534-4033-b2c6-40a5d3ea35fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093948 Aug 24 05:24:38.042989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1158/2425] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:38.504308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c9b19d0e-434e-4ea0-a859-ae1d3434322f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:38.504919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c9b19d0e-434e-4ea0-a859-ae1d3434322f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:38.511634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9b19d0e-434e-4ea0-a859-ae1d3434322f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:38.512114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9b19d0e-434e-4ea0-a859-ae1d3434322f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:38.512548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9b19d0e-434e-4ea0-a859-ae1d3434322f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:38.513232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9b19d0e-434e-4ea0-a859-ae1d3434322f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:38.513687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9b19d0e-434e-4ea0-a859-ae1d3434322f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:38.514106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c9b19d0e-434e-4ea0-a859-ae1d3434322f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:38.569810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5e204153-bd23-487f-b472-a4373792723a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:38.570547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5e204153-bd23-487f-b472-a4373792723a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:38.577105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e204153-bd23-487f-b472-a4373792723a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:38.577588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e204153-bd23-487f-b472-a4373792723a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:38.578737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e204153-bd23-487f-b472-a4373792723a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:38.579575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e204153-bd23-487f-b472-a4373792723a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:38.580038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e204153-bd23-487f-b472-a4373792723a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:38.581146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5e204153-bd23-487f-b472-a4373792723a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:38.581270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c9b19d0e-434e-4ea0-a859-ae1d3434322f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:38.589835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c9b19d0e-434e-4ea0-a859-ae1d3434322f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090044 Aug 24 05:24:38.590410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1268/2426] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:38.645410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5e204153-bd23-487f-b472-a4373792723a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:38.653985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5e204153-bd23-487f-b472-a4373792723a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088783 Aug 24 05:24:38.654554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1159/2427] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:39.064584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-684c0395-66e7-4a05-97c1-4df34bb0f56c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:39.065714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-684c0395-66e7-4a05-97c1-4df34bb0f56c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:39.072068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-684c0395-66e7-4a05-97c1-4df34bb0f56c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:39.072549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-684c0395-66e7-4a05-97c1-4df34bb0f56c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:39.072974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-684c0395-66e7-4a05-97c1-4df34bb0f56c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:39.073654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-684c0395-66e7-4a05-97c1-4df34bb0f56c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:39.074093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-684c0395-66e7-4a05-97c1-4df34bb0f56c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:39.074502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-684c0395-66e7-4a05-97c1-4df34bb0f56c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:39.138143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-684c0395-66e7-4a05-97c1-4df34bb0f56c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:39.147259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-684c0395-66e7-4a05-97c1-4df34bb0f56c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086531 Aug 24 05:24:39.147830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1269/2428] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:39.611206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-321416b6-7b50-4534-b428-15b3a62749c8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:39.611803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-321416b6-7b50-4534-b428-15b3a62749c8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:39.618948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321416b6-7b50-4534-b428-15b3a62749c8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:39.619440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321416b6-7b50-4534-b428-15b3a62749c8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:39.619912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321416b6-7b50-4534-b428-15b3a62749c8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:39.620611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321416b6-7b50-4534-b428-15b3a62749c8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:39.621065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321416b6-7b50-4534-b428-15b3a62749c8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:39.621488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-321416b6-7b50-4534-b428-15b3a62749c8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:39.676393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-90120278-54e1-4d0b-88de-71766ed86603 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:39.677012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-90120278-54e1-4d0b-88de-71766ed86603 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:39.683934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90120278-54e1-4d0b-88de-71766ed86603 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:39.684886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90120278-54e1-4d0b-88de-71766ed86603 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:39.685372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90120278-54e1-4d0b-88de-71766ed86603 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:39.686209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90120278-54e1-4d0b-88de-71766ed86603 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:39.686659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90120278-54e1-4d0b-88de-71766ed86603 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:39.687098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90120278-54e1-4d0b-88de-71766ed86603 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:39.689877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-321416b6-7b50-4534-b428-15b3a62749c8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:39.699113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-321416b6-7b50-4534-b428-15b3a62749c8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091753 Aug 24 05:24:39.699674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1160/2429] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:39.756708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-90120278-54e1-4d0b-88de-71766ed86603 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:39.765113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-90120278-54e1-4d0b-88de-71766ed86603 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092890 Aug 24 05:24:39.765691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1270/2430] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:40.168382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ced649cc-0191-457e-ba3e-9c7954c43d6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:40.168991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ced649cc-0191-457e-ba3e-9c7954c43d6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:40.175125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ced649cc-0191-457e-ba3e-9c7954c43d6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:40.175609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ced649cc-0191-457e-ba3e-9c7954c43d6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:40.176045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ced649cc-0191-457e-ba3e-9c7954c43d6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:40.176737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ced649cc-0191-457e-ba3e-9c7954c43d6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:40.177183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ced649cc-0191-457e-ba3e-9c7954c43d6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:40.177603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ced649cc-0191-457e-ba3e-9c7954c43d6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:40.242112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ced649cc-0191-457e-ba3e-9c7954c43d6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:40.250444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ced649cc-0191-457e-ba3e-9c7954c43d6c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085915 Aug 24 05:24:40.251043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1161/2431] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:40.722179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-01b183f6-833a-4843-ba76-c75094c4c25e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:40.722826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-01b183f6-833a-4843-ba76-c75094c4c25e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:40.729441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01b183f6-833a-4843-ba76-c75094c4c25e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:40.729926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01b183f6-833a-4843-ba76-c75094c4c25e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:40.730361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01b183f6-833a-4843-ba76-c75094c4c25e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:40.731092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01b183f6-833a-4843-ba76-c75094c4c25e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:40.731541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01b183f6-833a-4843-ba76-c75094c4c25e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:40.731959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01b183f6-833a-4843-ba76-c75094c4c25e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:40.788251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-849fdb29-f96a-4e57-ae09-038ddcdbed00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:40.788878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-849fdb29-f96a-4e57-ae09-038ddcdbed00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:40.795720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-849fdb29-f96a-4e57-ae09-038ddcdbed00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:40.796905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-849fdb29-f96a-4e57-ae09-038ddcdbed00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:40.797257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-849fdb29-f96a-4e57-ae09-038ddcdbed00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:40.797964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-849fdb29-f96a-4e57-ae09-038ddcdbed00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:40.798420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-849fdb29-f96a-4e57-ae09-038ddcdbed00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:40.798883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-849fdb29-f96a-4e57-ae09-038ddcdbed00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:40.800026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-01b183f6-833a-4843-ba76-c75094c4c25e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:40.808968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-01b183f6-833a-4843-ba76-c75094c4c25e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090775 Aug 24 05:24:40.809665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1271/2432] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:40.869975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-849fdb29-f96a-4e57-ae09-038ddcdbed00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:40.878846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-849fdb29-f96a-4e57-ae09-038ddcdbed00 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.095321 Aug 24 05:24:40.879406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1162/2433] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:41.272486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dbfcef70-5271-4377-a5a1-a26cc0cb34c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:41.273081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dbfcef70-5271-4377-a5a1-a26cc0cb34c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:41.279358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dbfcef70-5271-4377-a5a1-a26cc0cb34c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:41.279835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dbfcef70-5271-4377-a5a1-a26cc0cb34c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:41.280270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dbfcef70-5271-4377-a5a1-a26cc0cb34c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:41.280960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dbfcef70-5271-4377-a5a1-a26cc0cb34c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:41.281407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dbfcef70-5271-4377-a5a1-a26cc0cb34c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:41.281822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dbfcef70-5271-4377-a5a1-a26cc0cb34c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:41.344760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dbfcef70-5271-4377-a5a1-a26cc0cb34c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:41.354234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dbfcef70-5271-4377-a5a1-a26cc0cb34c0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085557 Aug 24 05:24:41.354829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1272/2434] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:41 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:41.830492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b8d86406-d4f8-45a1-a579-b99acb923ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:41.831741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b8d86406-d4f8-45a1-a579-b99acb923ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:41.838243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8d86406-d4f8-45a1-a579-b99acb923ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:41.838751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8d86406-d4f8-45a1-a579-b99acb923ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:41.839186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8d86406-d4f8-45a1-a579-b99acb923ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:41.839864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8d86406-d4f8-45a1-a579-b99acb923ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:41.840332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8d86406-d4f8-45a1-a579-b99acb923ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:41.840731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8d86406-d4f8-45a1-a579-b99acb923ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:41.899994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0480ff89-d08c-4f2c-afc2-aae7506348b8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:41.900665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0480ff89-d08c-4f2c-afc2-aae7506348b8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:41.905880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b8d86406-d4f8-45a1-a579-b99acb923ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:41.907502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0480ff89-d08c-4f2c-afc2-aae7506348b8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:41.907988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0480ff89-d08c-4f2c-afc2-aae7506348b8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:41.908423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0480ff89-d08c-4f2c-afc2-aae7506348b8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:41.909755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0480ff89-d08c-4f2c-afc2-aae7506348b8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:41.910212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0480ff89-d08c-4f2c-afc2-aae7506348b8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:41.910634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0480ff89-d08c-4f2c-afc2-aae7506348b8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:41.914762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b8d86406-d4f8-45a1-a579-b99acb923ffe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088099 Aug 24 05:24:41.915345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1163/2435] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:41.977035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0480ff89-d08c-4f2c-afc2-aae7506348b8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:41.985611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0480ff89-d08c-4f2c-afc2-aae7506348b8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089460 Aug 24 05:24:41.986383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1273/2436] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:42.376372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5600fbc6-43aa-492c-88d8-0a6d8c51e63f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:42.377077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5600fbc6-43aa-492c-88d8-0a6d8c51e63f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:42.383806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5600fbc6-43aa-492c-88d8-0a6d8c51e63f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:42.384284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5600fbc6-43aa-492c-88d8-0a6d8c51e63f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:42.384738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5600fbc6-43aa-492c-88d8-0a6d8c51e63f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:42.385387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5600fbc6-43aa-492c-88d8-0a6d8c51e63f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:42.385829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5600fbc6-43aa-492c-88d8-0a6d8c51e63f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:42.386245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5600fbc6-43aa-492c-88d8-0a6d8c51e63f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:42.466482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5600fbc6-43aa-492c-88d8-0a6d8c51e63f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:42.475085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5600fbc6-43aa-492c-88d8-0a6d8c51e63f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.102732 Aug 24 05:24:42.475662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1164/2437] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:42.937563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d5b01b24-bc27-4c8d-b9c0-04659358b7a3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:42.938185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d5b01b24-bc27-4c8d-b9c0-04659358b7a3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:42.945205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5b01b24-bc27-4c8d-b9c0-04659358b7a3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:42.945674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5b01b24-bc27-4c8d-b9c0-04659358b7a3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:42.946106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5b01b24-bc27-4c8d-b9c0-04659358b7a3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:42.946905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5b01b24-bc27-4c8d-b9c0-04659358b7a3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:42.947416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5b01b24-bc27-4c8d-b9c0-04659358b7a3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:42.947839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5b01b24-bc27-4c8d-b9c0-04659358b7a3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:43.007793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d782a9f2-2a0a-49e7-8138-b698eeb871f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:43.008356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d782a9f2-2a0a-49e7-8138-b698eeb871f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:43.014987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d782a9f2-2a0a-49e7-8138-b698eeb871f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:43.015434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d782a9f2-2a0a-49e7-8138-b698eeb871f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:43.015871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d782a9f2-2a0a-49e7-8138-b698eeb871f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:43.016564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d782a9f2-2a0a-49e7-8138-b698eeb871f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:43.017016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d782a9f2-2a0a-49e7-8138-b698eeb871f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:43.017147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d5b01b24-bc27-4c8d-b9c0-04659358b7a3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:43.017436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d782a9f2-2a0a-49e7-8138-b698eeb871f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:43.020871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:43.028523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d5b01b24-bc27-4c8d-b9c0-04659358b7a3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.094902 Aug 24 05:24:43.029104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1274/2438] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:43.082412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d782a9f2-2a0a-49e7-8138-b698eeb871f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:43.090934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d782a9f2-2a0a-49e7-8138-b698eeb871f2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087115 Aug 24 05:24:43.091501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1165/2439] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:43 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:43.497956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b3f068f4-5f05-47cc-8c1f-8efe3b06ced5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:43.498564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b3f068f4-5f05-47cc-8c1f-8efe3b06ced5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:43.505233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3f068f4-5f05-47cc-8c1f-8efe3b06ced5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:43.505711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3f068f4-5f05-47cc-8c1f-8efe3b06ced5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:43.506145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3f068f4-5f05-47cc-8c1f-8efe3b06ced5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:43.506866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3f068f4-5f05-47cc-8c1f-8efe3b06ced5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:43.507324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3f068f4-5f05-47cc-8c1f-8efe3b06ced5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:43.507747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3f068f4-5f05-47cc-8c1f-8efe3b06ced5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:43.573449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b3f068f4-5f05-47cc-8c1f-8efe3b06ced5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:43.582558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b3f068f4-5f05-47cc-8c1f-8efe3b06ced5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088443 Aug 24 05:24:43.583163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1275/2440] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:44.050784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e1448b4b-c9f3-475a-820f-0d80eee2702b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:44.051363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e1448b4b-c9f3-475a-820f-0d80eee2702b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:44.058143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e1448b4b-c9f3-475a-820f-0d80eee2702b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:44.058651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e1448b4b-c9f3-475a-820f-0d80eee2702b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:44.059111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e1448b4b-c9f3-475a-820f-0d80eee2702b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:44.059812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e1448b4b-c9f3-475a-820f-0d80eee2702b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:44.060259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e1448b4b-c9f3-475a-820f-0d80eee2702b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:44.060680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e1448b4b-c9f3-475a-820f-0d80eee2702b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:44.111475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-33305fee-1cf7-420a-989d-6dd1db915284 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:44.112822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-33305fee-1cf7-420a-989d-6dd1db915284 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:44.119522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33305fee-1cf7-420a-989d-6dd1db915284 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:44.120000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33305fee-1cf7-420a-989d-6dd1db915284 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:44.120439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33305fee-1cf7-420a-989d-6dd1db915284 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:44.121128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33305fee-1cf7-420a-989d-6dd1db915284 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:44.121574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33305fee-1cf7-420a-989d-6dd1db915284 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:44.121989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-33305fee-1cf7-420a-989d-6dd1db915284 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:44.130485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e1448b4b-c9f3-475a-820f-0d80eee2702b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:44.138969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e1448b4b-c9f3-475a-820f-0d80eee2702b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.092660 Aug 24 05:24:44.139554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1166/2441] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:44.187668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-33305fee-1cf7-420a-989d-6dd1db915284 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:44.196340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-33305fee-1cf7-420a-989d-6dd1db915284 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088791 Aug 24 05:24:44.196909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1276/2442] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:44.603565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-99ac557e-5870-45a6-a483-6c6931f4e2e2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:44.604170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-99ac557e-5870-45a6-a483-6c6931f4e2e2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:44.610209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99ac557e-5870-45a6-a483-6c6931f4e2e2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:44.610679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99ac557e-5870-45a6-a483-6c6931f4e2e2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:44.611148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99ac557e-5870-45a6-a483-6c6931f4e2e2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:44.611918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99ac557e-5870-45a6-a483-6c6931f4e2e2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:44.616553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99ac557e-5870-45a6-a483-6c6931f4e2e2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:44.616553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99ac557e-5870-45a6-a483-6c6931f4e2e2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:44.676067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-99ac557e-5870-45a6-a483-6c6931f4e2e2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:44.684959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-99ac557e-5870-45a6-a483-6c6931f4e2e2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085135 Aug 24 05:24:44.685537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1167/2443] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:45.159994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d116313c-c4c5-4907-b0e3-be55d768ba64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:45.160619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d116313c-c4c5-4907-b0e3-be55d768ba64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:45.166960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d116313c-c4c5-4907-b0e3-be55d768ba64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:45.167445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d116313c-c4c5-4907-b0e3-be55d768ba64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:45.167882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d116313c-c4c5-4907-b0e3-be55d768ba64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:45.168568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d116313c-c4c5-4907-b0e3-be55d768ba64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:45.169015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d116313c-c4c5-4907-b0e3-be55d768ba64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:45.169433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d116313c-c4c5-4907-b0e3-be55d768ba64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:45.217138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-25139a0b-b938-4cc7-8857-d64624013f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:45.217749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-25139a0b-b938-4cc7-8857-d64624013f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:45.225291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25139a0b-b938-4cc7-8857-d64624013f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:45.225778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25139a0b-b938-4cc7-8857-d64624013f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:45.226212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25139a0b-b938-4cc7-8857-d64624013f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:45.226944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25139a0b-b938-4cc7-8857-d64624013f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:45.227395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25139a0b-b938-4cc7-8857-d64624013f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:45.227831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-25139a0b-b938-4cc7-8857-d64624013f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:45.232918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d116313c-c4c5-4907-b0e3-be55d768ba64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:45.241341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d116313c-c4c5-4907-b0e3-be55d768ba64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085910 Aug 24 05:24:45.241918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1277/2444] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:45.296297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-25139a0b-b938-4cc7-8857-d64624013f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:45.305944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-25139a0b-b938-4cc7-8857-d64624013f77 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092372 Aug 24 05:24:45.306531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1168/2445] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:45 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:45.707028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ba4c23ff-f161-49f1-93ec-d4f14f1b83bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:45.707640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ba4c23ff-f161-49f1-93ec-d4f14f1b83bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:45.713695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba4c23ff-f161-49f1-93ec-d4f14f1b83bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:45.714173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba4c23ff-f161-49f1-93ec-d4f14f1b83bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:45.714609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba4c23ff-f161-49f1-93ec-d4f14f1b83bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:45.715316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba4c23ff-f161-49f1-93ec-d4f14f1b83bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:45.715764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba4c23ff-f161-49f1-93ec-d4f14f1b83bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:45.716183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba4c23ff-f161-49f1-93ec-d4f14f1b83bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:45.782867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ba4c23ff-f161-49f1-93ec-d4f14f1b83bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:45.791893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ba4c23ff-f161-49f1-93ec-d4f14f1b83bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089419 Aug 24 05:24:45.792466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1278/2446] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:46.262368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f4025b7d-b05b-41d7-9093-98ffa85b696e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:46.263070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f4025b7d-b05b-41d7-9093-98ffa85b696e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:46.265311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=84 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:46.270765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4025b7d-b05b-41d7-9093-98ffa85b696e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:46.271254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4025b7d-b05b-41d7-9093-98ffa85b696e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:46.271696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4025b7d-b05b-41d7-9093-98ffa85b696e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:46.272388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4025b7d-b05b-41d7-9093-98ffa85b696e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:46.272843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4025b7d-b05b-41d7-9093-98ffa85b696e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:46.273270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f4025b7d-b05b-41d7-9093-98ffa85b696e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:46.332528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7f06ccda-6042-451c-816f-570eca1c4202 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:46.333361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7f06ccda-6042-451c-816f-570eca1c4202 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:46.338061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f4025b7d-b05b-41d7-9093-98ffa85b696e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:46.339937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f06ccda-6042-451c-816f-570eca1c4202 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:46.340427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f06ccda-6042-451c-816f-570eca1c4202 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:46.340866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f06ccda-6042-451c-816f-570eca1c4202 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:46.341755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f06ccda-6042-451c-816f-570eca1c4202 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:46.342243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f06ccda-6042-451c-816f-570eca1c4202 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:46.342663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7f06ccda-6042-451c-816f-570eca1c4202 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:46.347484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f4025b7d-b05b-41d7-9093-98ffa85b696e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088883 Aug 24 05:24:46.348085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1169/2447] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:46.409407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7f06ccda-6042-451c-816f-570eca1c4202 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:46.417954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7f06ccda-6042-451c-816f-570eca1c4202 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089778 Aug 24 05:24:46.418528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1279/2448] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:46.814877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-33fa23e4-e6c0-4624-9b50-f637abd6b06d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:46.816281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-33fa23e4-e6c0-4624-9b50-f637abd6b06d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:46.822340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33fa23e4-e6c0-4624-9b50-f637abd6b06d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:46.822851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33fa23e4-e6c0-4624-9b50-f637abd6b06d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:46.823285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33fa23e4-e6c0-4624-9b50-f637abd6b06d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:46.823976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33fa23e4-e6c0-4624-9b50-f637abd6b06d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:46.824421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33fa23e4-e6c0-4624-9b50-f637abd6b06d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:46.824836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33fa23e4-e6c0-4624-9b50-f637abd6b06d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:46.889966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-33fa23e4-e6c0-4624-9b50-f637abd6b06d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:46.898375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-33fa23e4-e6c0-4624-9b50-f637abd6b06d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087408 Aug 24 05:24:46.898991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1170/2449] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:47.368822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2b949a40-3a69-4035-a221-c704db74c7f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:47.369435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2b949a40-3a69-4035-a221-c704db74c7f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:47.376060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b949a40-3a69-4035-a221-c704db74c7f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:47.376541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b949a40-3a69-4035-a221-c704db74c7f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:47.376972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b949a40-3a69-4035-a221-c704db74c7f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:47.378446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b949a40-3a69-4035-a221-c704db74c7f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:47.380474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b949a40-3a69-4035-a221-c704db74c7f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:47.380474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b949a40-3a69-4035-a221-c704db74c7f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:47.439512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b5c571ed-cc4d-4921-958c-d0539173b2a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:47.441216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b5c571ed-cc4d-4921-958c-d0539173b2a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:47.448249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5c571ed-cc4d-4921-958c-d0539173b2a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:47.448768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5c571ed-cc4d-4921-958c-d0539173b2a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:47.449203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5c571ed-cc4d-4921-958c-d0539173b2a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:47.449901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5c571ed-cc4d-4921-958c-d0539173b2a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:47.450152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2b949a40-3a69-4035-a221-c704db74c7f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:47.450349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5c571ed-cc4d-4921-958c-d0539173b2a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:47.450795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5c571ed-cc4d-4921-958c-d0539173b2a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:47.458962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2b949a40-3a69-4035-a221-c704db74c7f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093892 Aug 24 05:24:47.459807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1280/2450] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:47.520670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b5c571ed-cc4d-4921-958c-d0539173b2a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:47.531166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b5c571ed-cc4d-4921-958c-d0539173b2a7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.095176 Aug 24 05:24:47.532186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1171/2451] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:47.919235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d9fc8587-5c88-48c2-848d-c2b156bb0d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:47.919895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d9fc8587-5c88-48c2-848d-c2b156bb0d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:47.926461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9fc8587-5c88-48c2-848d-c2b156bb0d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:47.926972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9fc8587-5c88-48c2-848d-c2b156bb0d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:47.927408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9fc8587-5c88-48c2-848d-c2b156bb0d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:47.928109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9fc8587-5c88-48c2-848d-c2b156bb0d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:47.928553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9fc8587-5c88-48c2-848d-c2b156bb0d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:47.928974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9fc8587-5c88-48c2-848d-c2b156bb0d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:47.995375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d9fc8587-5c88-48c2-848d-c2b156bb0d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:48.004426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d9fc8587-5c88-48c2-848d-c2b156bb0d85 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089036 Aug 24 05:24:48.005005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1281/2452] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:48.480290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-56480578-a8da-42e2-ad3d-f7c0b89ca22c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:48.480906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-56480578-a8da-42e2-ad3d-f7c0b89ca22c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:48.487494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56480578-a8da-42e2-ad3d-f7c0b89ca22c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:48.488015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56480578-a8da-42e2-ad3d-f7c0b89ca22c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:48.488447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56480578-a8da-42e2-ad3d-f7c0b89ca22c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:48.489138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56480578-a8da-42e2-ad3d-f7c0b89ca22c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:48.489588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56480578-a8da-42e2-ad3d-f7c0b89ca22c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:48.490008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56480578-a8da-42e2-ad3d-f7c0b89ca22c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:48.556308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-56480578-a8da-42e2-ad3d-f7c0b89ca22c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:48.557942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5426ecc9-2b0a-4419-bdfb-5a956b967857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:48.558948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5426ecc9-2b0a-4419-bdfb-5a956b967857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:48.565662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-56480578-a8da-42e2-ad3d-f7c0b89ca22c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088736 Aug 24 05:24:48.566173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5426ecc9-2b0a-4419-bdfb-5a956b967857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:48.566498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1172/2453] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:48.566801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5426ecc9-2b0a-4419-bdfb-5a956b967857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:48.567236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5426ecc9-2b0a-4419-bdfb-5a956b967857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:48.567928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5426ecc9-2b0a-4419-bdfb-5a956b967857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:48.568372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5426ecc9-2b0a-4419-bdfb-5a956b967857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:48.568816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5426ecc9-2b0a-4419-bdfb-5a956b967857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:48.636220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5426ecc9-2b0a-4419-bdfb-5a956b967857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:48.645634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5426ecc9-2b0a-4419-bdfb-5a956b967857 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092085 Aug 24 05:24:48.646211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1282/2454] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:49.025637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-254c8a89-aaed-4ca2-be8b-17e93f76104c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:49.026241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-254c8a89-aaed-4ca2-be8b-17e93f76104c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:49.032346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-254c8a89-aaed-4ca2-be8b-17e93f76104c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:49.032833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-254c8a89-aaed-4ca2-be8b-17e93f76104c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:49.033260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-254c8a89-aaed-4ca2-be8b-17e93f76104c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:49.034857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-254c8a89-aaed-4ca2-be8b-17e93f76104c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:49.035397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-254c8a89-aaed-4ca2-be8b-17e93f76104c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:49.035822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-254c8a89-aaed-4ca2-be8b-17e93f76104c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:49.102075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-254c8a89-aaed-4ca2-be8b-17e93f76104c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:49.112227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-254c8a89-aaed-4ca2-be8b-17e93f76104c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089754 Aug 24 05:24:49.112921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1173/2455] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:49.587893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2fc0fb7e-d93c-4f8f-bf49-a7f242f41f9a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:49.588348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2fc0fb7e-d93c-4f8f-bf49-a7f242f41f9a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:49.599073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fc0fb7e-d93c-4f8f-bf49-a7f242f41f9a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:49.600211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fc0fb7e-d93c-4f8f-bf49-a7f242f41f9a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:49.600870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fc0fb7e-d93c-4f8f-bf49-a7f242f41f9a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:49.602011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fc0fb7e-d93c-4f8f-bf49-a7f242f41f9a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:49.602568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fc0fb7e-d93c-4f8f-bf49-a7f242f41f9a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:49.603038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2fc0fb7e-d93c-4f8f-bf49-a7f242f41f9a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:49.620362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:49.666451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7a6797bd-bf8f-443c-8b0e-93ac3e59ff30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:49.667295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7a6797bd-bf8f-443c-8b0e-93ac3e59ff30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:49.673339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2fc0fb7e-d93c-4f8f-bf49-a7f242f41f9a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:49.674430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a6797bd-bf8f-443c-8b0e-93ac3e59ff30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:49.675168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a6797bd-bf8f-443c-8b0e-93ac3e59ff30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:49.675784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a6797bd-bf8f-443c-8b0e-93ac3e59ff30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:49.676480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a6797bd-bf8f-443c-8b0e-93ac3e59ff30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:49.677574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a6797bd-bf8f-443c-8b0e-93ac3e59ff30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:49.677993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7a6797bd-bf8f-443c-8b0e-93ac3e59ff30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:49.682187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2fc0fb7e-d93c-4f8f-bf49-a7f242f41f9a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.098446 Aug 24 05:24:49.682781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1283/2456] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:49.771842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7a6797bd-bf8f-443c-8b0e-93ac3e59ff30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:49.781533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7a6797bd-bf8f-443c-8b0e-93ac3e59ff30 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.119063 Aug 24 05:24:49.782125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1174/2457] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:50.139501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-81358a9f-38a9-4a4a-be74-53705b12ba35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:50.140117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-81358a9f-38a9-4a4a-be74-53705b12ba35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:50.148107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81358a9f-38a9-4a4a-be74-53705b12ba35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:50.148592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81358a9f-38a9-4a4a-be74-53705b12ba35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:50.149201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81358a9f-38a9-4a4a-be74-53705b12ba35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:50.149905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81358a9f-38a9-4a4a-be74-53705b12ba35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:50.150356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81358a9f-38a9-4a4a-be74-53705b12ba35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:50.150802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81358a9f-38a9-4a4a-be74-53705b12ba35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:50.218118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-81358a9f-38a9-4a4a-be74-53705b12ba35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:50.227390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-81358a9f-38a9-4a4a-be74-53705b12ba35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093794 Aug 24 05:24:50.227970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1284/2458] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:50.704057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cfce234d-d8a0-433e-b814-ccc30916606a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:50.704692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cfce234d-d8a0-433e-b814-ccc30916606a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:50.711939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfce234d-d8a0-433e-b814-ccc30916606a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:50.712426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfce234d-d8a0-433e-b814-ccc30916606a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:50.712861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfce234d-d8a0-433e-b814-ccc30916606a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:50.713585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfce234d-d8a0-433e-b814-ccc30916606a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:50.714048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfce234d-d8a0-433e-b814-ccc30916606a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:50.714471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfce234d-d8a0-433e-b814-ccc30916606a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:50.779925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cfce234d-d8a0-433e-b814-ccc30916606a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:50.788866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cfce234d-d8a0-433e-b814-ccc30916606a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088668 Aug 24 05:24:50.789423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1175/2459] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:50.804209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-29127529-460b-446d-8ce9-8f94fc3aa45e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:50.804818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-29127529-460b-446d-8ce9-8f94fc3aa45e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:50.807466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=82 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:50.812611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29127529-460b-446d-8ce9-8f94fc3aa45e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:50.813091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29127529-460b-446d-8ce9-8f94fc3aa45e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:50.813524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29127529-460b-446d-8ce9-8f94fc3aa45e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:50.814220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29127529-460b-446d-8ce9-8f94fc3aa45e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:50.814668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29127529-460b-446d-8ce9-8f94fc3aa45e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:50.815717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-29127529-460b-446d-8ce9-8f94fc3aa45e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:50.881282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-29127529-460b-446d-8ce9-8f94fc3aa45e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:50.889643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-29127529-460b-446d-8ce9-8f94fc3aa45e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089570 Aug 24 05:24:50.891081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1285/2460] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:51.251866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-89f1d0c2-9e57-4765-a837-9a8d4c1ddaf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:51.253167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-89f1d0c2-9e57-4765-a837-9a8d4c1ddaf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:51.259563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89f1d0c2-9e57-4765-a837-9a8d4c1ddaf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:51.260048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89f1d0c2-9e57-4765-a837-9a8d4c1ddaf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:51.260486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89f1d0c2-9e57-4765-a837-9a8d4c1ddaf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:51.261187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89f1d0c2-9e57-4765-a837-9a8d4c1ddaf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:51.261638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89f1d0c2-9e57-4765-a837-9a8d4c1ddaf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:51.262092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-89f1d0c2-9e57-4765-a837-9a8d4c1ddaf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:51.327339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-89f1d0c2-9e57-4765-a837-9a8d4c1ddaf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:51.336572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-89f1d0c2-9e57-4765-a837-9a8d4c1ddaf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090582 Aug 24 05:24:51.337141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1176/2461] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:51.813766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-52931db2-7d3f-420b-8b70-0ea2eada01fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:51.815345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-52931db2-7d3f-420b-8b70-0ea2eada01fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:51.824497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52931db2-7d3f-420b-8b70-0ea2eada01fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:51.825203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52931db2-7d3f-420b-8b70-0ea2eada01fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:51.825863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52931db2-7d3f-420b-8b70-0ea2eada01fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:51.827014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52931db2-7d3f-420b-8b70-0ea2eada01fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:51.827790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52931db2-7d3f-420b-8b70-0ea2eada01fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:51.828494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52931db2-7d3f-420b-8b70-0ea2eada01fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:51.898522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-52931db2-7d3f-420b-8b70-0ea2eada01fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:51.907395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-52931db2-7d3f-420b-8b70-0ea2eada01fc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.099958 Aug 24 05:24:51.907972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1286/2462] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:51.910969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b36f4eec-0fa1-40d8-905d-29bca6f46de6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:51.911778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b36f4eec-0fa1-40d8-905d-29bca6f46de6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:51.918229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36f4eec-0fa1-40d8-905d-29bca6f46de6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:51.918750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36f4eec-0fa1-40d8-905d-29bca6f46de6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:51.919193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36f4eec-0fa1-40d8-905d-29bca6f46de6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:51.919928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36f4eec-0fa1-40d8-905d-29bca6f46de6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:51.920518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36f4eec-0fa1-40d8-905d-29bca6f46de6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:51.920873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36f4eec-0fa1-40d8-905d-29bca6f46de6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:51.988401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b36f4eec-0fa1-40d8-905d-29bca6f46de6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:51.996842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b36f4eec-0fa1-40d8-905d-29bca6f46de6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090127 Aug 24 05:24:51.997428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1177/2463] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:52.358529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a91f2f77-aeb5-485c-ab53-0c4a281d2d52 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:52.359092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a91f2f77-aeb5-485c-ab53-0c4a281d2d52 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:52.366058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a91f2f77-aeb5-485c-ab53-0c4a281d2d52 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:52.366540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a91f2f77-aeb5-485c-ab53-0c4a281d2d52 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:52.367002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a91f2f77-aeb5-485c-ab53-0c4a281d2d52 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:52.367690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a91f2f77-aeb5-485c-ab53-0c4a281d2d52 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:52.368136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a91f2f77-aeb5-485c-ab53-0c4a281d2d52 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:52.368553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a91f2f77-aeb5-485c-ab53-0c4a281d2d52 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:52.437768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a91f2f77-aeb5-485c-ab53-0c4a281d2d52 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:52.447114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a91f2f77-aeb5-485c-ab53-0c4a281d2d52 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092443 Aug 24 05:24:52.447689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1287/2464] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:52.928508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-77da9910-54b7-4328-afe3-a4fa01b7004a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:52.929116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-77da9910-54b7-4328-afe3-a4fa01b7004a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:52.935982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77da9910-54b7-4328-afe3-a4fa01b7004a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:52.936458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77da9910-54b7-4328-afe3-a4fa01b7004a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:52.936893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77da9910-54b7-4328-afe3-a4fa01b7004a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:52.937581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77da9910-54b7-4328-afe3-a4fa01b7004a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:52.938015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77da9910-54b7-4328-afe3-a4fa01b7004a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:52.938426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-77da9910-54b7-4328-afe3-a4fa01b7004a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:53.008757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-77da9910-54b7-4328-afe3-a4fa01b7004a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:53.019207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-77da9910-54b7-4328-afe3-a4fa01b7004a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.094736 Aug 24 05:24:53.019467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fc054eb0-bc97-4b6d-b555-af3a18fbc8ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:53.020104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1178/2465] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:53.020234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fc054eb0-bc97-4b6d-b555-af3a18fbc8ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:53.031865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc054eb0-bc97-4b6d-b555-af3a18fbc8ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:53.032746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc054eb0-bc97-4b6d-b555-af3a18fbc8ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:53.033539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc054eb0-bc97-4b6d-b555-af3a18fbc8ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:53.034812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc054eb0-bc97-4b6d-b555-af3a18fbc8ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:53.035667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc054eb0-bc97-4b6d-b555-af3a18fbc8ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:53.036446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc054eb0-bc97-4b6d-b555-af3a18fbc8ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:53.108706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fc054eb0-bc97-4b6d-b555-af3a18fbc8ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:53.117235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fc054eb0-bc97-4b6d-b555-af3a18fbc8ad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.102633 Aug 24 05:24:53.117826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1288/2466] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:53.468492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-286f7d2a-51ca-41dd-94f1-2b94110393bc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:53.469104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-286f7d2a-51ca-41dd-94f1-2b94110393bc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:53.475598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-286f7d2a-51ca-41dd-94f1-2b94110393bc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:53.476082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-286f7d2a-51ca-41dd-94f1-2b94110393bc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:53.476517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-286f7d2a-51ca-41dd-94f1-2b94110393bc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:53.477208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-286f7d2a-51ca-41dd-94f1-2b94110393bc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:53.477662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-286f7d2a-51ca-41dd-94f1-2b94110393bc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:53.478084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-286f7d2a-51ca-41dd-94f1-2b94110393bc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:53.546110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-286f7d2a-51ca-41dd-94f1-2b94110393bc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:53.554835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-286f7d2a-51ca-41dd-94f1-2b94110393bc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090166 Aug 24 05:24:53.555659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1179/2467] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:54.055666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d028a130-debf-4b9f-a743-db320cf826b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:54.056271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d028a130-debf-4b9f-a743-db320cf826b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:54.062853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d028a130-debf-4b9f-a743-db320cf826b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:54.063340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d028a130-debf-4b9f-a743-db320cf826b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:54.063771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d028a130-debf-4b9f-a743-db320cf826b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:54.064460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d028a130-debf-4b9f-a743-db320cf826b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:54.065428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d028a130-debf-4b9f-a743-db320cf826b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:54.065847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d028a130-debf-4b9f-a743-db320cf826b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:54.131758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d028a130-debf-4b9f-a743-db320cf826b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:54.139748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-76f88f50-b155-470e-8741-fe2d34c5d1a0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:54.140362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-76f88f50-b155-470e-8741-fe2d34c5d1a0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:54.142126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d028a130-debf-4b9f-a743-db320cf826b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090616 Aug 24 05:24:54.142751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1289/2468] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:54.147637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76f88f50-b155-470e-8741-fe2d34c5d1a0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:54.148130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76f88f50-b155-470e-8741-fe2d34c5d1a0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:54.148567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76f88f50-b155-470e-8741-fe2d34c5d1a0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:54.149255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76f88f50-b155-470e-8741-fe2d34c5d1a0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:54.149704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76f88f50-b155-470e-8741-fe2d34c5d1a0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:54.150124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-76f88f50-b155-470e-8741-fe2d34c5d1a0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:54.219929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-76f88f50-b155-470e-8741-fe2d34c5d1a0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:54.228805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-76f88f50-b155-470e-8741-fe2d34c5d1a0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093281 Aug 24 05:24:54.229380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1180/2469] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:54.576907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-61627082-abc5-4163-8b2e-162624baf971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:54.577518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-61627082-abc5-4163-8b2e-162624baf971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:54.584846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61627082-abc5-4163-8b2e-162624baf971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:54.585329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61627082-abc5-4163-8b2e-162624baf971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:54.585764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61627082-abc5-4163-8b2e-162624baf971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:54.586457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61627082-abc5-4163-8b2e-162624baf971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:54.586936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61627082-abc5-4163-8b2e-162624baf971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:54.587354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61627082-abc5-4163-8b2e-162624baf971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:54.662075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-61627082-abc5-4163-8b2e-162624baf971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:54.670594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-61627082-abc5-4163-8b2e-162624baf971 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.097467 Aug 24 05:24:54.671185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1290/2470] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:55.165860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ee9d19a3-311f-4097-a7a9-eb343f86a0c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:55.166475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ee9d19a3-311f-4097-a7a9-eb343f86a0c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:55.173103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee9d19a3-311f-4097-a7a9-eb343f86a0c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:55.173585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee9d19a3-311f-4097-a7a9-eb343f86a0c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:55.174038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee9d19a3-311f-4097-a7a9-eb343f86a0c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:55.174749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee9d19a3-311f-4097-a7a9-eb343f86a0c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:55.175203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee9d19a3-311f-4097-a7a9-eb343f86a0c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:55.175624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee9d19a3-311f-4097-a7a9-eb343f86a0c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:55.240934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ee9d19a3-311f-4097-a7a9-eb343f86a0c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:55.243131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:24:55.249571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4e231b59-e9ab-4043-ae76-1ffdfe139093 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:55.250140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4e231b59-e9ab-4043-ae76-1ffdfe139093 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:55.250758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ee9d19a3-311f-4097-a7a9-eb343f86a0c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088776 Aug 24 05:24:55.251338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1181/2471] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:55.260607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e231b59-e9ab-4043-ae76-1ffdfe139093 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:55.261099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e231b59-e9ab-4043-ae76-1ffdfe139093 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:55.261536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e231b59-e9ab-4043-ae76-1ffdfe139093 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:55.262238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e231b59-e9ab-4043-ae76-1ffdfe139093 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:55.262741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e231b59-e9ab-4043-ae76-1ffdfe139093 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:55.263195 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e231b59-e9ab-4043-ae76-1ffdfe139093 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:55.326324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4e231b59-e9ab-4043-ae76-1ffdfe139093 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:55.335002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4e231b59-e9ab-4043-ae76-1ffdfe139093 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089328 Aug 24 05:24:55.335581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1291/2472] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:55 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:55.692539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d825272c-47d3-49da-9564-27c50750b988 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:55.693143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d825272c-47d3-49da-9564-27c50750b988 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:55.699213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d825272c-47d3-49da-9564-27c50750b988 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:55.699689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d825272c-47d3-49da-9564-27c50750b988 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:55.700116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d825272c-47d3-49da-9564-27c50750b988 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:55.700827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d825272c-47d3-49da-9564-27c50750b988 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:55.701268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d825272c-47d3-49da-9564-27c50750b988 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:55.701683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d825272c-47d3-49da-9564-27c50750b988 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:55.772188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d825272c-47d3-49da-9564-27c50750b988 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:55.780739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d825272c-47d3-49da-9564-27c50750b988 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092223 Aug 24 05:24:55.781310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1182/2473] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:56.273252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-efe263f9-6acd-42c0-8281-4078e72ec441 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:56.273982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-efe263f9-6acd-42c0-8281-4078e72ec441 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:56.280357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efe263f9-6acd-42c0-8281-4078e72ec441 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:56.280829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efe263f9-6acd-42c0-8281-4078e72ec441 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:56.281257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efe263f9-6acd-42c0-8281-4078e72ec441 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:56.281932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efe263f9-6acd-42c0-8281-4078e72ec441 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:56.282378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efe263f9-6acd-42c0-8281-4078e72ec441 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:56.282821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-efe263f9-6acd-42c0-8281-4078e72ec441 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:56.346991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-efe263f9-6acd-42c0-8281-4078e72ec441 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:56.355594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-efe263f9-6acd-42c0-8281-4078e72ec441 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086165 Aug 24 05:24:56.356163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1292/2474] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:56.356295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5009953b-d8ed-47fd-995b-052a5929b4bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:56.356858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5009953b-d8ed-47fd-995b-052a5929b4bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:56.364681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5009953b-d8ed-47fd-995b-052a5929b4bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:56.365160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5009953b-d8ed-47fd-995b-052a5929b4bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:56.365587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5009953b-d8ed-47fd-995b-052a5929b4bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:56.366280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5009953b-d8ed-47fd-995b-052a5929b4bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:56.366755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5009953b-d8ed-47fd-995b-052a5929b4bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:56.367177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5009953b-d8ed-47fd-995b-052a5929b4bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:56.431405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5009953b-d8ed-47fd-995b-052a5929b4bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:56.440240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5009953b-d8ed-47fd-995b-052a5929b4bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087572 Aug 24 05:24:56.444296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1183/2475] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:56.801554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2bf3cf83-b1b8-4715-bb2f-a5e6f8380374 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:56.802164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2bf3cf83-b1b8-4715-bb2f-a5e6f8380374 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:56.808638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf3cf83-b1b8-4715-bb2f-a5e6f8380374 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:56.809118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf3cf83-b1b8-4715-bb2f-a5e6f8380374 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:56.809554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf3cf83-b1b8-4715-bb2f-a5e6f8380374 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:56.810242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf3cf83-b1b8-4715-bb2f-a5e6f8380374 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:56.810713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf3cf83-b1b8-4715-bb2f-a5e6f8380374 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:56.811133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf3cf83-b1b8-4715-bb2f-a5e6f8380374 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:56.874060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2bf3cf83-b1b8-4715-bb2f-a5e6f8380374 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:56.883102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2bf3cf83-b1b8-4715-bb2f-a5e6f8380374 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085487 Aug 24 05:24:56.883689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1293/2476] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:57.376983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-67aeeee0-e88a-4c27-9bf4-ac9785b6d41f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:57.378389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-67aeeee0-e88a-4c27-9bf4-ac9785b6d41f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:57.384907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67aeeee0-e88a-4c27-9bf4-ac9785b6d41f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:57.385389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67aeeee0-e88a-4c27-9bf4-ac9785b6d41f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:57.385822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67aeeee0-e88a-4c27-9bf4-ac9785b6d41f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:57.386509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67aeeee0-e88a-4c27-9bf4-ac9785b6d41f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:57.387000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67aeeee0-e88a-4c27-9bf4-ac9785b6d41f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:57.387426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-67aeeee0-e88a-4c27-9bf4-ac9785b6d41f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:57.450118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-67aeeee0-e88a-4c27-9bf4-ac9785b6d41f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:57.460697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fde2cbe7-6625-4518-aa80-c6df52f4bf65 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:57.461291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fde2cbe7-6625-4518-aa80-c6df52f4bf65 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:57.462111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-67aeeee0-e88a-4c27-9bf4-ac9785b6d41f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088878 Aug 24 05:24:57.462899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1184/2477] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:57.467480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fde2cbe7-6625-4518-aa80-c6df52f4bf65 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:57.467954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fde2cbe7-6625-4518-aa80-c6df52f4bf65 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:57.468384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fde2cbe7-6625-4518-aa80-c6df52f4bf65 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:57.469066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fde2cbe7-6625-4518-aa80-c6df52f4bf65 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:57.469508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fde2cbe7-6625-4518-aa80-c6df52f4bf65 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:57.469918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fde2cbe7-6625-4518-aa80-c6df52f4bf65 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:57.538257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fde2cbe7-6625-4518-aa80-c6df52f4bf65 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:57.546629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fde2cbe7-6625-4518-aa80-c6df52f4bf65 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089795 Aug 24 05:24:57.547221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1294/2478] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:57.904497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9198e214-493a-4319-9ba4-30fea79c377e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:57.905121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9198e214-493a-4319-9ba4-30fea79c377e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:57.911341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9198e214-493a-4319-9ba4-30fea79c377e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:57.911815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9198e214-493a-4319-9ba4-30fea79c377e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:57.912237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9198e214-493a-4319-9ba4-30fea79c377e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:57.912938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9198e214-493a-4319-9ba4-30fea79c377e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:57.913380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9198e214-493a-4319-9ba4-30fea79c377e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:57.913792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9198e214-493a-4319-9ba4-30fea79c377e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:57.976288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9198e214-493a-4319-9ba4-30fea79c377e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:57.989266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9198e214-493a-4319-9ba4-30fea79c377e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088444 Aug 24 05:24:57.989776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1185/2479] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:58.483565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b8c0858b-4942-4ea3-b3eb-c908b1d5f147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:58.484175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b8c0858b-4942-4ea3-b3eb-c908b1d5f147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:58.490675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c0858b-4942-4ea3-b3eb-c908b1d5f147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:58.491184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c0858b-4942-4ea3-b3eb-c908b1d5f147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:58.491622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c0858b-4942-4ea3-b3eb-c908b1d5f147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:58.492303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c0858b-4942-4ea3-b3eb-c908b1d5f147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:58.492754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c0858b-4942-4ea3-b3eb-c908b1d5f147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:58.493172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8c0858b-4942-4ea3-b3eb-c908b1d5f147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:58.556778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b8c0858b-4942-4ea3-b3eb-c908b1d5f147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:58.566008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b8c0858b-4942-4ea3-b3eb-c908b1d5f147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086127 Aug 24 05:24:58.566576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1295/2480] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:58.568637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fc3e2d7c-7850-4dd8-b11d-35e9977a685b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:58.569251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fc3e2d7c-7850-4dd8-b11d-35e9977a685b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:58.575866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc3e2d7c-7850-4dd8-b11d-35e9977a685b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:58.576348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc3e2d7c-7850-4dd8-b11d-35e9977a685b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:58.576788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc3e2d7c-7850-4dd8-b11d-35e9977a685b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:58.577470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc3e2d7c-7850-4dd8-b11d-35e9977a685b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:58.577923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc3e2d7c-7850-4dd8-b11d-35e9977a685b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:58.578347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc3e2d7c-7850-4dd8-b11d-35e9977a685b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:58.644298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fc3e2d7c-7850-4dd8-b11d-35e9977a685b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:58.652574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fc3e2d7c-7850-4dd8-b11d-35e9977a685b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088423 Aug 24 05:24:58.653149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1186/2481] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:24:59.010822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-09cde014-2d90-4d83-9b51-9fa84f3cc697 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:59.011354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-09cde014-2d90-4d83-9b51-9fa84f3cc697 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:59.017404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09cde014-2d90-4d83-9b51-9fa84f3cc697 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:59.018074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09cde014-2d90-4d83-9b51-9fa84f3cc697 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:59.018669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09cde014-2d90-4d83-9b51-9fa84f3cc697 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:59.019383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09cde014-2d90-4d83-9b51-9fa84f3cc697 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:59.019840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09cde014-2d90-4d83-9b51-9fa84f3cc697 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:59.020264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09cde014-2d90-4d83-9b51-9fa84f3cc697 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:59.086599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-09cde014-2d90-4d83-9b51-9fa84f3cc697 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:59.098308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-09cde014-2d90-4d83-9b51-9fa84f3cc697 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091428 Aug 24 05:24:59.099102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1296/2482] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:59.587415 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-34d5d36a-7320-4488-8fea-8acb8d64ccb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:59.588025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-34d5d36a-7320-4488-8fea-8acb8d64ccb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:59.594584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34d5d36a-7320-4488-8fea-8acb8d64ccb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:59.595091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34d5d36a-7320-4488-8fea-8acb8d64ccb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:59.595507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34d5d36a-7320-4488-8fea-8acb8d64ccb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:59.596936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34d5d36a-7320-4488-8fea-8acb8d64ccb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:59.597385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34d5d36a-7320-4488-8fea-8acb8d64ccb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:59.597796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-34d5d36a-7320-4488-8fea-8acb8d64ccb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:59.660872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-34d5d36a-7320-4488-8fea-8acb8d64ccb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:59.669031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-34d5d36a-7320-4488-8fea-8acb8d64ccb3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085494 Aug 24 05:24:59.669740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1187/2483] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:24:59.672975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e1c2eae0-c6b3-4cee-8ccc-a4d0777f030c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:24:59.673583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e1c2eae0-c6b3-4cee-8ccc-a4d0777f030c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:24:59.680686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1c2eae0-c6b3-4cee-8ccc-a4d0777f030c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:59.681170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1c2eae0-c6b3-4cee-8ccc-a4d0777f030c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:59.681605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1c2eae0-c6b3-4cee-8ccc-a4d0777f030c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:59.682298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1c2eae0-c6b3-4cee-8ccc-a4d0777f030c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:24:59.682772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1c2eae0-c6b3-4cee-8ccc-a4d0777f030c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:24:59.683196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1c2eae0-c6b3-4cee-8ccc-a4d0777f030c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:24:59.745608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e1c2eae0-c6b3-4cee-8ccc-a4d0777f030c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:24:59.754587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e1c2eae0-c6b3-4cee-8ccc-a4d0777f030c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085516 Aug 24 05:24:59.755207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1297/2484] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:24:59 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:00.119846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cb547191-1a7d-4efc-9148-be49b2fe8f02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:00.120453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cb547191-1a7d-4efc-9148-be49b2fe8f02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:00.126452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb547191-1a7d-4efc-9148-be49b2fe8f02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:00.127059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb547191-1a7d-4efc-9148-be49b2fe8f02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:00.127561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb547191-1a7d-4efc-9148-be49b2fe8f02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:00.128234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb547191-1a7d-4efc-9148-be49b2fe8f02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:00.128683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb547191-1a7d-4efc-9148-be49b2fe8f02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:00.129099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb547191-1a7d-4efc-9148-be49b2fe8f02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:00.194077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cb547191-1a7d-4efc-9148-be49b2fe8f02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:00.202343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cb547191-1a7d-4efc-9148-be49b2fe8f02 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086410 Aug 24 05:25:00.202932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1188/2485] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:00.690583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-da33545d-6cf5-4522-b5dd-4b49ecdecd39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:00.691243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-da33545d-6cf5-4522-b5dd-4b49ecdecd39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:00.697777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da33545d-6cf5-4522-b5dd-4b49ecdecd39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:00.698259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da33545d-6cf5-4522-b5dd-4b49ecdecd39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:00.698714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da33545d-6cf5-4522-b5dd-4b49ecdecd39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:00.699417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da33545d-6cf5-4522-b5dd-4b49ecdecd39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:00.699869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da33545d-6cf5-4522-b5dd-4b49ecdecd39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:00.700292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da33545d-6cf5-4522-b5dd-4b49ecdecd39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:00.768514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-da33545d-6cf5-4522-b5dd-4b49ecdecd39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:00.775062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-53ffda37-075c-45e0-9bfa-72e5091cc53b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:00.775665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-53ffda37-075c-45e0-9bfa-72e5091cc53b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:00.777003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-da33545d-6cf5-4522-b5dd-4b49ecdecd39 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090593 Aug 24 05:25:00.777756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1298/2486] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:00.782577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ffda37-075c-45e0-9bfa-72e5091cc53b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:00.783807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ffda37-075c-45e0-9bfa-72e5091cc53b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:00.784252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ffda37-075c-45e0-9bfa-72e5091cc53b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:00.784981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ffda37-075c-45e0-9bfa-72e5091cc53b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:00.785433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ffda37-075c-45e0-9bfa-72e5091cc53b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:00.785855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-53ffda37-075c-45e0-9bfa-72e5091cc53b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:00.853131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-53ffda37-075c-45e0-9bfa-72e5091cc53b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:00.862103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-53ffda37-075c-45e0-9bfa-72e5091cc53b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090177 Aug 24 05:25:00.862720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1189/2487] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:01.226715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f80e9a08-96c1-4471-b3b8-3c77284d2b0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:01.227985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f80e9a08-96c1-4471-b3b8-3c77284d2b0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:01.238456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f80e9a08-96c1-4471-b3b8-3c77284d2b0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:01.238832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f80e9a08-96c1-4471-b3b8-3c77284d2b0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:01.239279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f80e9a08-96c1-4471-b3b8-3c77284d2b0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:01.239980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f80e9a08-96c1-4471-b3b8-3c77284d2b0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:01.240433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f80e9a08-96c1-4471-b3b8-3c77284d2b0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:01.241087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f80e9a08-96c1-4471-b3b8-3c77284d2b0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:01.310405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f80e9a08-96c1-4471-b3b8-3c77284d2b0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:01.319136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f80e9a08-96c1-4471-b3b8-3c77284d2b0e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.098960 Aug 24 05:25:01.319774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1299/2488] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:01.800496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ea222d65-bc4e-42b0-b5c0-09fbe871aff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:01.801112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ea222d65-bc4e-42b0-b5c0-09fbe871aff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:01.808177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea222d65-bc4e-42b0-b5c0-09fbe871aff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:01.808666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea222d65-bc4e-42b0-b5c0-09fbe871aff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:01.809108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea222d65-bc4e-42b0-b5c0-09fbe871aff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:01.809808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea222d65-bc4e-42b0-b5c0-09fbe871aff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:01.810255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea222d65-bc4e-42b0-b5c0-09fbe871aff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:01.810677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea222d65-bc4e-42b0-b5c0-09fbe871aff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:01.876718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ea222d65-bc4e-42b0-b5c0-09fbe871aff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:01.883606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f8fc48d4-bc00-49f0-8810-c6bbc3c04aad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:01.884266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f8fc48d4-bc00-49f0-8810-c6bbc3c04aad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:01.887718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ea222d65-bc4e-42b0-b5c0-09fbe871aff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091694 Aug 24 05:25:01.888300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1190/2489] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:01.890754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8fc48d4-bc00-49f0-8810-c6bbc3c04aad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:01.891240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8fc48d4-bc00-49f0-8810-c6bbc3c04aad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:01.891678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8fc48d4-bc00-49f0-8810-c6bbc3c04aad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:01.892381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8fc48d4-bc00-49f0-8810-c6bbc3c04aad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:01.892992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8fc48d4-bc00-49f0-8810-c6bbc3c04aad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:01.893529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8fc48d4-bc00-49f0-8810-c6bbc3c04aad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:01.896279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:01.958228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f8fc48d4-bc00-49f0-8810-c6bbc3c04aad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:01.966596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f8fc48d4-bc00-49f0-8810-c6bbc3c04aad tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086830 Aug 24 05:25:01.967202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1300/2490] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:02.340250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-32c8b220-aa1e-4071-945e-ea17e30c086c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:02.340854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-32c8b220-aa1e-4071-945e-ea17e30c086c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:02.347542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32c8b220-aa1e-4071-945e-ea17e30c086c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:02.348016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32c8b220-aa1e-4071-945e-ea17e30c086c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:02.348441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32c8b220-aa1e-4071-945e-ea17e30c086c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:02.349114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32c8b220-aa1e-4071-945e-ea17e30c086c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:02.349563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32c8b220-aa1e-4071-945e-ea17e30c086c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:02.349974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32c8b220-aa1e-4071-945e-ea17e30c086c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:02.412008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-32c8b220-aa1e-4071-945e-ea17e30c086c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:02.420073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-32c8b220-aa1e-4071-945e-ea17e30c086c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.083669 Aug 24 05:25:02.420629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1191/2491] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:02.909481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e25b55b0-02fc-4cf5-8304-0cf49221f8c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:02.910106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e25b55b0-02fc-4cf5-8304-0cf49221f8c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:02.916583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e25b55b0-02fc-4cf5-8304-0cf49221f8c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:02.917058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e25b55b0-02fc-4cf5-8304-0cf49221f8c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:02.917495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e25b55b0-02fc-4cf5-8304-0cf49221f8c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:02.918175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e25b55b0-02fc-4cf5-8304-0cf49221f8c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:02.918621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e25b55b0-02fc-4cf5-8304-0cf49221f8c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:02.919063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e25b55b0-02fc-4cf5-8304-0cf49221f8c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:02.982974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e25b55b0-02fc-4cf5-8304-0cf49221f8c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:02.988011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-072c00bf-09d2-4d24-91e9-c20437aa5e12 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:02.988549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-072c00bf-09d2-4d24-91e9-c20437aa5e12 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:02.992106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e25b55b0-02fc-4cf5-8304-0cf49221f8c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087047 Aug 24 05:25:02.992684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1301/2492] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:03.001615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-072c00bf-09d2-4d24-91e9-c20437aa5e12 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:03.001615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-072c00bf-09d2-4d24-91e9-c20437aa5e12 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:03.001615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-072c00bf-09d2-4d24-91e9-c20437aa5e12 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:03.001615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-072c00bf-09d2-4d24-91e9-c20437aa5e12 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:03.002079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-072c00bf-09d2-4d24-91e9-c20437aa5e12 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:03.002079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-072c00bf-09d2-4d24-91e9-c20437aa5e12 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:03.060647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-072c00bf-09d2-4d24-91e9-c20437aa5e12 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:03.068963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-072c00bf-09d2-4d24-91e9-c20437aa5e12 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085615 Aug 24 05:25:03.069526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1192/2493] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:03.442532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d3bc561e-406e-477d-80ed-b3094afd0c96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:03.443463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d3bc561e-406e-477d-80ed-b3094afd0c96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:03.451610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3bc561e-406e-477d-80ed-b3094afd0c96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:03.452055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3bc561e-406e-477d-80ed-b3094afd0c96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:03.452489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3bc561e-406e-477d-80ed-b3094afd0c96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:03.453176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3bc561e-406e-477d-80ed-b3094afd0c96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:03.453624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3bc561e-406e-477d-80ed-b3094afd0c96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:03.454124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3bc561e-406e-477d-80ed-b3094afd0c96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:03.532689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d3bc561e-406e-477d-80ed-b3094afd0c96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:03.540998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d3bc561e-406e-477d-80ed-b3094afd0c96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.103945 Aug 24 05:25:03.541564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1302/2494] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:04.013164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ade5173c-cb06-495a-9a76-4ef3e3e3c45a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:04.013723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ade5173c-cb06-495a-9a76-4ef3e3e3c45a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:04.021028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ade5173c-cb06-495a-9a76-4ef3e3e3c45a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:04.021508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ade5173c-cb06-495a-9a76-4ef3e3e3c45a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:04.021973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ade5173c-cb06-495a-9a76-4ef3e3e3c45a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:04.022657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ade5173c-cb06-495a-9a76-4ef3e3e3c45a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:04.023135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ade5173c-cb06-495a-9a76-4ef3e3e3c45a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:04.023559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ade5173c-cb06-495a-9a76-4ef3e3e3c45a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:04.085936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ade5173c-cb06-495a-9a76-4ef3e3e3c45a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:04.089276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2adc1600-a6ce-4f16-8c89-2deab76a86f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:04.089884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2adc1600-a6ce-4f16-8c89-2deab76a86f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:04.094275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ade5173c-cb06-495a-9a76-4ef3e3e3c45a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085053 Aug 24 05:25:04.094872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1193/2495] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:04.096872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2adc1600-a6ce-4f16-8c89-2deab76a86f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:04.097359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2adc1600-a6ce-4f16-8c89-2deab76a86f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:04.097784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2adc1600-a6ce-4f16-8c89-2deab76a86f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:04.098471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2adc1600-a6ce-4f16-8c89-2deab76a86f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:04.098936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2adc1600-a6ce-4f16-8c89-2deab76a86f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:04.099355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2adc1600-a6ce-4f16-8c89-2deab76a86f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:04.162680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2adc1600-a6ce-4f16-8c89-2deab76a86f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:04.171062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2adc1600-a6ce-4f16-8c89-2deab76a86f4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085643 Aug 24 05:25:04.171633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1303/2496] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:04.562740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1f1481c0-d68a-4238-80e7-c803abbfa68c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:04.563265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1f1481c0-d68a-4238-80e7-c803abbfa68c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:04.569825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f1481c0-d68a-4238-80e7-c803abbfa68c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:04.570308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f1481c0-d68a-4238-80e7-c803abbfa68c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:04.570771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f1481c0-d68a-4238-80e7-c803abbfa68c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:04.571454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f1481c0-d68a-4238-80e7-c803abbfa68c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:04.571905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f1481c0-d68a-4238-80e7-c803abbfa68c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:04.572325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f1481c0-d68a-4238-80e7-c803abbfa68c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:04.638951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1f1481c0-d68a-4238-80e7-c803abbfa68c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:04.647942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1f1481c0-d68a-4238-80e7-c803abbfa68c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089200 Aug 24 05:25:04.648504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1194/2497] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:05.116419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8d13433d-dd0b-453d-b20e-c51cba632a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:05.117035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8d13433d-dd0b-453d-b20e-c51cba632a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:05.123482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d13433d-dd0b-453d-b20e-c51cba632a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:05.123953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d13433d-dd0b-453d-b20e-c51cba632a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:05.124381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d13433d-dd0b-453d-b20e-c51cba632a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:05.125056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d13433d-dd0b-453d-b20e-c51cba632a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:05.125498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d13433d-dd0b-453d-b20e-c51cba632a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:05.125910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d13433d-dd0b-453d-b20e-c51cba632a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:05.188648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8d13433d-dd0b-453d-b20e-c51cba632a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:05.192648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3fa1d68c-bab2-4ec3-a9d6-7c981cad5108 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:05.193439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3fa1d68c-bab2-4ec3-a9d6-7c981cad5108 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:05.197812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8d13433d-dd0b-453d-b20e-c51cba632a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085395 Aug 24 05:25:05.198488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1304/2498] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:05.200046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fa1d68c-bab2-4ec3-a9d6-7c981cad5108 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:05.200505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fa1d68c-bab2-4ec3-a9d6-7c981cad5108 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:05.200958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fa1d68c-bab2-4ec3-a9d6-7c981cad5108 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:05.201642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fa1d68c-bab2-4ec3-a9d6-7c981cad5108 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:05.202083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fa1d68c-bab2-4ec3-a9d6-7c981cad5108 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:05.202494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fa1d68c-bab2-4ec3-a9d6-7c981cad5108 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:05.264643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3fa1d68c-bab2-4ec3-a9d6-7c981cad5108 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:05.273465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3fa1d68c-bab2-4ec3-a9d6-7c981cad5108 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085184 Aug 24 05:25:05.274028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1195/2499] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:05.668486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f460231e-55d3-45fb-af3f-b1e7a38c173d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:05.669124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f460231e-55d3-45fb-af3f-b1e7a38c173d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:05.675252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f460231e-55d3-45fb-af3f-b1e7a38c173d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:05.675731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f460231e-55d3-45fb-af3f-b1e7a38c173d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:05.676158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f460231e-55d3-45fb-af3f-b1e7a38c173d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:05.676846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f460231e-55d3-45fb-af3f-b1e7a38c173d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:05.677293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f460231e-55d3-45fb-af3f-b1e7a38c173d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:05.677712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f460231e-55d3-45fb-af3f-b1e7a38c173d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:05.744586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f460231e-55d3-45fb-af3f-b1e7a38c173d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:05.754502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f460231e-55d3-45fb-af3f-b1e7a38c173d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089852 Aug 24 05:25:05.755133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1305/2500] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:06.219863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-28538e4f-1224-406d-880f-295735cda6d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:06.220478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-28538e4f-1224-406d-880f-295735cda6d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:06.227127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28538e4f-1224-406d-880f-295735cda6d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:06.227608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28538e4f-1224-406d-880f-295735cda6d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:06.228039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28538e4f-1224-406d-880f-295735cda6d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:06.228745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28538e4f-1224-406d-880f-295735cda6d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:06.229174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28538e4f-1224-406d-880f-295735cda6d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:06.229688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28538e4f-1224-406d-880f-295735cda6d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:06.292586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-28538e4f-1224-406d-880f-295735cda6d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:06.294201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5c40a0e4-a815-4c60-86c9-5bc2e6d4de0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:06.294844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5c40a0e4-a815-4c60-86c9-5bc2e6d4de0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:06.301685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-28538e4f-1224-406d-880f-295735cda6d5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085729 Aug 24 05:25:06.301972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c40a0e4-a815-4c60-86c9-5bc2e6d4de0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:06.302265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1196/2501] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:06.302455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c40a0e4-a815-4c60-86c9-5bc2e6d4de0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:06.302917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c40a0e4-a815-4c60-86c9-5bc2e6d4de0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:06.303734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c40a0e4-a815-4c60-86c9-5bc2e6d4de0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:06.304185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c40a0e4-a815-4c60-86c9-5bc2e6d4de0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:06.304603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c40a0e4-a815-4c60-86c9-5bc2e6d4de0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:06.371746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5c40a0e4-a815-4c60-86c9-5bc2e6d4de0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:06.380835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5c40a0e4-a815-4c60-86c9-5bc2e6d4de0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090327 Aug 24 05:25:06.381427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1306/2502] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:06.776017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-91a7bad1-3379-457e-b28e-423334b884c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:06.776646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-91a7bad1-3379-457e-b28e-423334b884c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:06.782757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-91a7bad1-3379-457e-b28e-423334b884c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:06.783844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-91a7bad1-3379-457e-b28e-423334b884c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:06.784422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-91a7bad1-3379-457e-b28e-423334b884c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:06.785109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-91a7bad1-3379-457e-b28e-423334b884c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:06.785558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-91a7bad1-3379-457e-b28e-423334b884c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:06.785979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-91a7bad1-3379-457e-b28e-423334b884c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:06.846988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-91a7bad1-3379-457e-b28e-423334b884c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:06.855044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-91a7bad1-3379-457e-b28e-423334b884c9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.082935 Aug 24 05:25:06.855605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1197/2503] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:07.324444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-22dd3a93-0797-4509-ae21-9821ced1e0e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:07.325258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-22dd3a93-0797-4509-ae21-9821ced1e0e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:07.332582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22dd3a93-0797-4509-ae21-9821ced1e0e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:07.333056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22dd3a93-0797-4509-ae21-9821ced1e0e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:07.333489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22dd3a93-0797-4509-ae21-9821ced1e0e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:07.334177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22dd3a93-0797-4509-ae21-9821ced1e0e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:07.334620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22dd3a93-0797-4509-ae21-9821ced1e0e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:07.335068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22dd3a93-0797-4509-ae21-9821ced1e0e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:07.401601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-22dd3a93-0797-4509-ae21-9821ced1e0e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:07.401836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f5f9d647-fa83-4363-aa79-831bcbbaa998 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:07.402279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f5f9d647-fa83-4363-aa79-831bcbbaa998 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:07.408027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-22dd3a93-0797-4509-ae21-9821ced1e0e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088002 Aug 24 05:25:07.408357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5f9d647-fa83-4363-aa79-831bcbbaa998 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:07.408976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1307/2504] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:07.409193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5f9d647-fa83-4363-aa79-831bcbbaa998 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:07.409365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5f9d647-fa83-4363-aa79-831bcbbaa998 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:07.410134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5f9d647-fa83-4363-aa79-831bcbbaa998 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:07.410587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5f9d647-fa83-4363-aa79-831bcbbaa998 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:07.411170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5f9d647-fa83-4363-aa79-831bcbbaa998 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:07.427479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:07.484973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f5f9d647-fa83-4363-aa79-831bcbbaa998 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:07.494091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f5f9d647-fa83-4363-aa79-831bcbbaa998 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.096481 Aug 24 05:25:07.494659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1198/2505] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:07.876443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4a0ea8cc-a9f2-4903-bda0-afdacb7ff87b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:07.877080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4a0ea8cc-a9f2-4903-bda0-afdacb7ff87b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:07.883204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a0ea8cc-a9f2-4903-bda0-afdacb7ff87b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:07.883683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a0ea8cc-a9f2-4903-bda0-afdacb7ff87b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:07.884112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a0ea8cc-a9f2-4903-bda0-afdacb7ff87b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:07.884825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a0ea8cc-a9f2-4903-bda0-afdacb7ff87b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:07.885257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a0ea8cc-a9f2-4903-bda0-afdacb7ff87b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:07.885676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a0ea8cc-a9f2-4903-bda0-afdacb7ff87b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:07.950829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4a0ea8cc-a9f2-4903-bda0-afdacb7ff87b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:07.960284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4a0ea8cc-a9f2-4903-bda0-afdacb7ff87b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087596 Aug 24 05:25:07.960864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1308/2506] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:08.429665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8cd23349-4ec6-4a2e-8831-0afdcc6262af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:08.430291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8cd23349-4ec6-4a2e-8831-0afdcc6262af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:08.437337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8cd23349-4ec6-4a2e-8831-0afdcc6262af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:08.437824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8cd23349-4ec6-4a2e-8831-0afdcc6262af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:08.438266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8cd23349-4ec6-4a2e-8831-0afdcc6262af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:08.438997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8cd23349-4ec6-4a2e-8831-0afdcc6262af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:08.440207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8cd23349-4ec6-4a2e-8831-0afdcc6262af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:08.440922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8cd23349-4ec6-4a2e-8831-0afdcc6262af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:08.507185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8cd23349-4ec6-4a2e-8831-0afdcc6262af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:08.513769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ab15456b-3d65-436a-87d7-4fd54a37e3f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:08.514374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ab15456b-3d65-436a-87d7-4fd54a37e3f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:08.515559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8cd23349-4ec6-4a2e-8831-0afdcc6262af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089865 Aug 24 05:25:08.516143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1199/2507] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:08.521837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab15456b-3d65-436a-87d7-4fd54a37e3f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:08.522319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab15456b-3d65-436a-87d7-4fd54a37e3f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:08.522761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab15456b-3d65-436a-87d7-4fd54a37e3f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:08.523445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab15456b-3d65-436a-87d7-4fd54a37e3f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:08.523885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab15456b-3d65-436a-87d7-4fd54a37e3f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:08.524309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ab15456b-3d65-436a-87d7-4fd54a37e3f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:08.593755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ab15456b-3d65-436a-87d7-4fd54a37e3f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:08.604440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ab15456b-3d65-436a-87d7-4fd54a37e3f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094373 Aug 24 05:25:08.605034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1309/2508] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:08.984246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-794acce2-82d4-44c7-bd90-a228618184d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:08.984967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-794acce2-82d4-44c7-bd90-a228618184d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:08.991499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-794acce2-82d4-44c7-bd90-a228618184d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:08.991907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-794acce2-82d4-44c7-bd90-a228618184d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:08.992334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-794acce2-82d4-44c7-bd90-a228618184d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:08.993009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-794acce2-82d4-44c7-bd90-a228618184d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:08.993451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-794acce2-82d4-44c7-bd90-a228618184d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:08.993863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-794acce2-82d4-44c7-bd90-a228618184d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:09.062503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-794acce2-82d4-44c7-bd90-a228618184d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:09.072660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-794acce2-82d4-44c7-bd90-a228618184d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092300 Aug 24 05:25:09.073246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1200/2509] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:09.538419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3dcb837e-3e41-4dbb-8f2f-73e51f6bd148 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:09.539314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3dcb837e-3e41-4dbb-8f2f-73e51f6bd148 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:09.545833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dcb837e-3e41-4dbb-8f2f-73e51f6bd148 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:09.546328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dcb837e-3e41-4dbb-8f2f-73e51f6bd148 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:09.546765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dcb837e-3e41-4dbb-8f2f-73e51f6bd148 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:09.547489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dcb837e-3e41-4dbb-8f2f-73e51f6bd148 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:09.547938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dcb837e-3e41-4dbb-8f2f-73e51f6bd148 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:09.548357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3dcb837e-3e41-4dbb-8f2f-73e51f6bd148 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:09.622609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3dcb837e-3e41-4dbb-8f2f-73e51f6bd148 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:09.625454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bb30e3f5-73fc-4e71-98ea-c9ed979433fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:09.626102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bb30e3f5-73fc-4e71-98ea-c9ed979433fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:09.631784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3dcb837e-3e41-4dbb-8f2f-73e51f6bd148 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.097751 Aug 24 05:25:09.632390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1310/2510] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:09.632665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb30e3f5-73fc-4e71-98ea-c9ed979433fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:09.633144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb30e3f5-73fc-4e71-98ea-c9ed979433fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:09.633574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb30e3f5-73fc-4e71-98ea-c9ed979433fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:09.634260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb30e3f5-73fc-4e71-98ea-c9ed979433fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:09.634716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb30e3f5-73fc-4e71-98ea-c9ed979433fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:09.635142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bb30e3f5-73fc-4e71-98ea-c9ed979433fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:09.699556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bb30e3f5-73fc-4e71-98ea-c9ed979433fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:09.708644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bb30e3f5-73fc-4e71-98ea-c9ed979433fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086967 Aug 24 05:25:09.709237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1201/2511] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:10.094855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b0afdf10-f759-4fe6-aae3-69b568d3214c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:10.095455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b0afdf10-f759-4fe6-aae3-69b568d3214c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:10.101897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0afdf10-f759-4fe6-aae3-69b568d3214c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:10.102371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0afdf10-f759-4fe6-aae3-69b568d3214c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:10.102828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0afdf10-f759-4fe6-aae3-69b568d3214c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:10.103504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0afdf10-f759-4fe6-aae3-69b568d3214c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:10.103949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0afdf10-f759-4fe6-aae3-69b568d3214c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:10.104364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0afdf10-f759-4fe6-aae3-69b568d3214c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:10.168063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b0afdf10-f759-4fe6-aae3-69b568d3214c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:10.176870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b0afdf10-f759-4fe6-aae3-69b568d3214c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085906 Aug 24 05:25:10.177437 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1311/2512] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:10.653932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-16d676e4-9ea4-49b1-aa7e-5e0455bbe31d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:10.654553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-16d676e4-9ea4-49b1-aa7e-5e0455bbe31d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:10.661550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d676e4-9ea4-49b1-aa7e-5e0455bbe31d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:10.662043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d676e4-9ea4-49b1-aa7e-5e0455bbe31d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:10.662491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d676e4-9ea4-49b1-aa7e-5e0455bbe31d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:10.663224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d676e4-9ea4-49b1-aa7e-5e0455bbe31d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:10.663672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d676e4-9ea4-49b1-aa7e-5e0455bbe31d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:10.664093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d676e4-9ea4-49b1-aa7e-5e0455bbe31d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:10.729257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82ae78d9-d69f-468f-9858-cc1ea3572b1b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:10.730249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-82ae78d9-d69f-468f-9858-cc1ea3572b1b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:10.732649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-16d676e4-9ea4-49b1-aa7e-5e0455bbe31d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:10.737224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82ae78d9-d69f-468f-9858-cc1ea3572b1b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:10.737887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82ae78d9-d69f-468f-9858-cc1ea3572b1b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:10.738329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82ae78d9-d69f-468f-9858-cc1ea3572b1b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:10.739203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82ae78d9-d69f-468f-9858-cc1ea3572b1b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:10.739623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82ae78d9-d69f-468f-9858-cc1ea3572b1b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:10.740046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82ae78d9-d69f-468f-9858-cc1ea3572b1b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:10.741660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-16d676e4-9ea4-49b1-aa7e-5e0455bbe31d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091927 Aug 24 05:25:10.742482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1202/2513] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:10.808696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-82ae78d9-d69f-468f-9858-cc1ea3572b1b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:10.818054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-82ae78d9-d69f-468f-9858-cc1ea3572b1b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092658 Aug 24 05:25:10.818669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1312/2514] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:11.199066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b4036237-181a-409d-84ea-bd8d4e9bfa0f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:11.199606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b4036237-181a-409d-84ea-bd8d4e9bfa0f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:11.205765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4036237-181a-409d-84ea-bd8d4e9bfa0f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:11.206247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4036237-181a-409d-84ea-bd8d4e9bfa0f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:11.206721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4036237-181a-409d-84ea-bd8d4e9bfa0f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:11.207410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4036237-181a-409d-84ea-bd8d4e9bfa0f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:11.207861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4036237-181a-409d-84ea-bd8d4e9bfa0f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:11.208282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4036237-181a-409d-84ea-bd8d4e9bfa0f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:11.269608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b4036237-181a-409d-84ea-bd8d4e9bfa0f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:11.277774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b4036237-181a-409d-84ea-bd8d4e9bfa0f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.082665 Aug 24 05:25:11.278338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1203/2515] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:11.763777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b96ce994-3d8c-4e97-bbb6-7445373289cd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:11.764389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b96ce994-3d8c-4e97-bbb6-7445373289cd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:11.771090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b96ce994-3d8c-4e97-bbb6-7445373289cd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:11.771570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b96ce994-3d8c-4e97-bbb6-7445373289cd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:11.772008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b96ce994-3d8c-4e97-bbb6-7445373289cd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:11.772694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b96ce994-3d8c-4e97-bbb6-7445373289cd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:11.773147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b96ce994-3d8c-4e97-bbb6-7445373289cd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:11.773573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b96ce994-3d8c-4e97-bbb6-7445373289cd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:11.836437 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b96ce994-3d8c-4e97-bbb6-7445373289cd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:11.840349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8ffee595-58de-4407-a5e0-c7a1e0d1980c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:11.840991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8ffee595-58de-4407-a5e0-c7a1e0d1980c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:11.845816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b96ce994-3d8c-4e97-bbb6-7445373289cd tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085991 Aug 24 05:25:11.847301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1313/2516] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:11.850780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ffee595-58de-4407-a5e0-c7a1e0d1980c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:11.851440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ffee595-58de-4407-a5e0-c7a1e0d1980c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:11.851921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ffee595-58de-4407-a5e0-c7a1e0d1980c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:11.852645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ffee595-58de-4407-a5e0-c7a1e0d1980c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:11.853099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ffee595-58de-4407-a5e0-c7a1e0d1980c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:11.853524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ffee595-58de-4407-a5e0-c7a1e0d1980c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:11.922655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8ffee595-58de-4407-a5e0-c7a1e0d1980c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:11.931591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8ffee595-58de-4407-a5e0-c7a1e0d1980c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.096497 Aug 24 05:25:11.932169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1204/2517] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:12.298275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e3a01e4c-0cb9-465b-b403-0dd0620afae6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:12.298919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e3a01e4c-0cb9-465b-b403-0dd0620afae6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:12.305159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3a01e4c-0cb9-465b-b403-0dd0620afae6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:12.305902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3a01e4c-0cb9-465b-b403-0dd0620afae6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:12.306332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3a01e4c-0cb9-465b-b403-0dd0620afae6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:12.307037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3a01e4c-0cb9-465b-b403-0dd0620afae6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:12.307482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3a01e4c-0cb9-465b-b403-0dd0620afae6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:12.307905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3a01e4c-0cb9-465b-b403-0dd0620afae6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:12.372843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e3a01e4c-0cb9-465b-b403-0dd0620afae6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:12.381039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e3a01e4c-0cb9-465b-b403-0dd0620afae6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086627 Aug 24 05:25:12.381605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1314/2518] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:12.868344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-23670576-0b81-47bc-a226-a9b076726c5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:12.868991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-23670576-0b81-47bc-a226-a9b076726c5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:12.875479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23670576-0b81-47bc-a226-a9b076726c5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:12.875963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23670576-0b81-47bc-a226-a9b076726c5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:12.876404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23670576-0b81-47bc-a226-a9b076726c5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:12.877090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23670576-0b81-47bc-a226-a9b076726c5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:12.877599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23670576-0b81-47bc-a226-a9b076726c5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:12.878026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23670576-0b81-47bc-a226-a9b076726c5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:12.940821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-23670576-0b81-47bc-a226-a9b076726c5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:12.949824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-23670576-0b81-47bc-a226-a9b076726c5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085347 Aug 24 05:25:12.950403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1205/2519] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:12.954630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-647b5243-92b1-4529-9572-d611e6eb05e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:12.956115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-647b5243-92b1-4529-9572-d611e6eb05e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:12.963168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-647b5243-92b1-4529-9572-d611e6eb05e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:12.963728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-647b5243-92b1-4529-9572-d611e6eb05e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:12.964161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-647b5243-92b1-4529-9572-d611e6eb05e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:12.964877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-647b5243-92b1-4529-9572-d611e6eb05e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:12.965325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-647b5243-92b1-4529-9572-d611e6eb05e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:12.965740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-647b5243-92b1-4529-9572-d611e6eb05e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:13.029294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-647b5243-92b1-4529-9572-d611e6eb05e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:13.037605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-647b5243-92b1-4529-9572-d611e6eb05e2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088004 Aug 24 05:25:13.038168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1315/2520] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:13.401829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-46734d00-3f69-4d14-8bc5-56b9b7febd8f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:13.402470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-46734d00-3f69-4d14-8bc5-56b9b7febd8f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:13.409133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46734d00-3f69-4d14-8bc5-56b9b7febd8f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:13.409751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46734d00-3f69-4d14-8bc5-56b9b7febd8f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:13.410193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46734d00-3f69-4d14-8bc5-56b9b7febd8f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:13.410915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46734d00-3f69-4d14-8bc5-56b9b7febd8f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:13.411423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46734d00-3f69-4d14-8bc5-56b9b7febd8f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:13.411847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46734d00-3f69-4d14-8bc5-56b9b7febd8f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:13.477150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-46734d00-3f69-4d14-8bc5-56b9b7febd8f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:13.485593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-46734d00-3f69-4d14-8bc5-56b9b7febd8f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087613 Aug 24 05:25:13.486159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1206/2521] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:13.971285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9d51d7eb-0f8d-4f11-99f9-b3779d07e0aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:13.972069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9d51d7eb-0f8d-4f11-99f9-b3779d07e0aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:13.978803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d51d7eb-0f8d-4f11-99f9-b3779d07e0aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:13.979280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d51d7eb-0f8d-4f11-99f9-b3779d07e0aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:13.979715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d51d7eb-0f8d-4f11-99f9-b3779d07e0aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:13.980392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d51d7eb-0f8d-4f11-99f9-b3779d07e0aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:13.980838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d51d7eb-0f8d-4f11-99f9-b3779d07e0aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:13.981257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9d51d7eb-0f8d-4f11-99f9-b3779d07e0aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:14.044656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9d51d7eb-0f8d-4f11-99f9-b3779d07e0aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:14.046824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:14.054602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9d51d7eb-0f8d-4f11-99f9-b3779d07e0aa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087339 Aug 24 05:25:14.055205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1316/2522] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:14.058909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-452ab671-83cf-4846-bac3-2bbec5eb437b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:14.059526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-452ab671-83cf-4846-bac3-2bbec5eb437b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:14.066125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-452ab671-83cf-4846-bac3-2bbec5eb437b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:14.066712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-452ab671-83cf-4846-bac3-2bbec5eb437b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:14.067370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-452ab671-83cf-4846-bac3-2bbec5eb437b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:14.068168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-452ab671-83cf-4846-bac3-2bbec5eb437b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:14.068780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-452ab671-83cf-4846-bac3-2bbec5eb437b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:14.069308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-452ab671-83cf-4846-bac3-2bbec5eb437b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:14.131728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-452ab671-83cf-4846-bac3-2bbec5eb437b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:14.139821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-452ab671-83cf-4846-bac3-2bbec5eb437b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085268 Aug 24 05:25:14.140407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1207/2523] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:14 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:14.507109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5923b04e-3b91-4618-94b3-86ed9fdef143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:14.507715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5923b04e-3b91-4618-94b3-86ed9fdef143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:14.513816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5923b04e-3b91-4618-94b3-86ed9fdef143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:14.514293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5923b04e-3b91-4618-94b3-86ed9fdef143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:14.514803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5923b04e-3b91-4618-94b3-86ed9fdef143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:14.515484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5923b04e-3b91-4618-94b3-86ed9fdef143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:14.515933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5923b04e-3b91-4618-94b3-86ed9fdef143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:14.516349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5923b04e-3b91-4618-94b3-86ed9fdef143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:14.578392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5923b04e-3b91-4618-94b3-86ed9fdef143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:14.586870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5923b04e-3b91-4618-94b3-86ed9fdef143 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084216 Aug 24 05:25:14.587439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1317/2524] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:15.075471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-15990d51-f084-411a-aa11-8f9efd2c2dbf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:15.076080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-15990d51-f084-411a-aa11-8f9efd2c2dbf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:15.083877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15990d51-f084-411a-aa11-8f9efd2c2dbf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:15.084359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15990d51-f084-411a-aa11-8f9efd2c2dbf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:15.085045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15990d51-f084-411a-aa11-8f9efd2c2dbf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:15.085740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15990d51-f084-411a-aa11-8f9efd2c2dbf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:15.086194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15990d51-f084-411a-aa11-8f9efd2c2dbf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:15.086613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15990d51-f084-411a-aa11-8f9efd2c2dbf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:15.149948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-15990d51-f084-411a-aa11-8f9efd2c2dbf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:15.158454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-15990d51-f084-411a-aa11-8f9efd2c2dbf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086874 Aug 24 05:25:15.159079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1208/2525] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:15.160794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-81fe5da8-9176-4acb-a0da-97d9750ce558 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:15.161413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-81fe5da8-9176-4acb-a0da-97d9750ce558 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:15.167671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81fe5da8-9176-4acb-a0da-97d9750ce558 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:15.168138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81fe5da8-9176-4acb-a0da-97d9750ce558 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:15.168565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81fe5da8-9176-4acb-a0da-97d9750ce558 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:15.169243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81fe5da8-9176-4acb-a0da-97d9750ce558 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:15.169686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81fe5da8-9176-4acb-a0da-97d9750ce558 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:15.170110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-81fe5da8-9176-4acb-a0da-97d9750ce558 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:15.236466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-81fe5da8-9176-4acb-a0da-97d9750ce558 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:15.245628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-81fe5da8-9176-4acb-a0da-97d9750ce558 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089098 Aug 24 05:25:15.246197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1318/2526] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:15.607543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f0a046cf-4f6e-4ff2-892a-0c01d2239f7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:15.608160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f0a046cf-4f6e-4ff2-892a-0c01d2239f7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:15.614410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0a046cf-4f6e-4ff2-892a-0c01d2239f7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:15.614941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0a046cf-4f6e-4ff2-892a-0c01d2239f7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:15.615380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0a046cf-4f6e-4ff2-892a-0c01d2239f7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:15.616096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0a046cf-4f6e-4ff2-892a-0c01d2239f7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:15.616547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0a046cf-4f6e-4ff2-892a-0c01d2239f7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:15.616976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0a046cf-4f6e-4ff2-892a-0c01d2239f7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:15.682408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f0a046cf-4f6e-4ff2-892a-0c01d2239f7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:15.691252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f0a046cf-4f6e-4ff2-892a-0c01d2239f7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087157 Aug 24 05:25:15.691823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1209/2527] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:16.180210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8582a1c7-e019-4c8c-8dfa-fcebbd7bb64b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:16.181082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8582a1c7-e019-4c8c-8dfa-fcebbd7bb64b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:16.187504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8582a1c7-e019-4c8c-8dfa-fcebbd7bb64b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:16.187979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8582a1c7-e019-4c8c-8dfa-fcebbd7bb64b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:16.188410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8582a1c7-e019-4c8c-8dfa-fcebbd7bb64b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:16.189083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8582a1c7-e019-4c8c-8dfa-fcebbd7bb64b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:16.189529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8582a1c7-e019-4c8c-8dfa-fcebbd7bb64b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:16.189945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8582a1c7-e019-4c8c-8dfa-fcebbd7bb64b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:16.253717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8582a1c7-e019-4c8c-8dfa-fcebbd7bb64b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:16.262674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8582a1c7-e019-4c8c-8dfa-fcebbd7bb64b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086488 Aug 24 05:25:16.263199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1319/2528] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:16 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:16.266931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6d555d86-0b9b-4726-8af8-03bdfa368f6e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:16.267544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6d555d86-0b9b-4726-8af8-03bdfa368f6e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:16.273854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d555d86-0b9b-4726-8af8-03bdfa368f6e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:16.274318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d555d86-0b9b-4726-8af8-03bdfa368f6e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:16.274782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d555d86-0b9b-4726-8af8-03bdfa368f6e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:16.275464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d555d86-0b9b-4726-8af8-03bdfa368f6e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:16.275949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d555d86-0b9b-4726-8af8-03bdfa368f6e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:16.276371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d555d86-0b9b-4726-8af8-03bdfa368f6e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:16.340559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6d555d86-0b9b-4726-8af8-03bdfa368f6e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:16.349325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6d555d86-0b9b-4726-8af8-03bdfa368f6e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086150 Aug 24 05:25:16.349888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1210/2529] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:16.712726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-be72c215-7446-4a63-8f78-22aafc902f0d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:16.713458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-be72c215-7446-4a63-8f78-22aafc902f0d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:16.719512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be72c215-7446-4a63-8f78-22aafc902f0d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:16.719986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be72c215-7446-4a63-8f78-22aafc902f0d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:16.720450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be72c215-7446-4a63-8f78-22aafc902f0d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:16.721093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be72c215-7446-4a63-8f78-22aafc902f0d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:16.721538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be72c215-7446-4a63-8f78-22aafc902f0d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:16.721956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be72c215-7446-4a63-8f78-22aafc902f0d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:16.800020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-be72c215-7446-4a63-8f78-22aafc902f0d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:16.809394 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-be72c215-7446-4a63-8f78-22aafc902f0d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.100528 Aug 24 05:25:16.809964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1320/2530] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:16 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:17.283985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4070027b-fe2f-4597-8623-5ed283a31920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:17.284597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4070027b-fe2f-4597-8623-5ed283a31920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:17.287574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=84 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:17.292898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4070027b-fe2f-4597-8623-5ed283a31920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:17.293381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4070027b-fe2f-4597-8623-5ed283a31920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:17.293815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4070027b-fe2f-4597-8623-5ed283a31920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:17.294506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4070027b-fe2f-4597-8623-5ed283a31920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:17.294979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4070027b-fe2f-4597-8623-5ed283a31920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:17.295398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4070027b-fe2f-4597-8623-5ed283a31920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:17.359959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4070027b-fe2f-4597-8623-5ed283a31920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:17.368781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4070027b-fe2f-4597-8623-5ed283a31920 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088652 Aug 24 05:25:17.369355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1211/2531] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:17.369543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-88150f14-a18e-4f0b-8fdf-55bfa52a5e70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:17.370345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-88150f14-a18e-4f0b-8fdf-55bfa52a5e70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:17.377835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88150f14-a18e-4f0b-8fdf-55bfa52a5e70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:17.378322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88150f14-a18e-4f0b-8fdf-55bfa52a5e70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:17.378792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88150f14-a18e-4f0b-8fdf-55bfa52a5e70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:17.379665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88150f14-a18e-4f0b-8fdf-55bfa52a5e70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:17.380171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88150f14-a18e-4f0b-8fdf-55bfa52a5e70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:17.380530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88150f14-a18e-4f0b-8fdf-55bfa52a5e70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:17.443707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-88150f14-a18e-4f0b-8fdf-55bfa52a5e70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:17.451946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-88150f14-a18e-4f0b-8fdf-55bfa52a5e70 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086236 Aug 24 05:25:17.452518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1321/2532] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:17 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:17.831099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-78c3e7ec-f9ad-44f2-9cd6-e9c5d83c9c69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:17.831726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-78c3e7ec-f9ad-44f2-9cd6-e9c5d83c9c69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:17.837827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c3e7ec-f9ad-44f2-9cd6-e9c5d83c9c69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:17.838298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c3e7ec-f9ad-44f2-9cd6-e9c5d83c9c69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:17.838740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c3e7ec-f9ad-44f2-9cd6-e9c5d83c9c69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:17.839412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c3e7ec-f9ad-44f2-9cd6-e9c5d83c9c69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:17.839855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c3e7ec-f9ad-44f2-9cd6-e9c5d83c9c69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:17.840268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78c3e7ec-f9ad-44f2-9cd6-e9c5d83c9c69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:17.905153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-78c3e7ec-f9ad-44f2-9cd6-e9c5d83c9c69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:17.914277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-78c3e7ec-f9ad-44f2-9cd6-e9c5d83c9c69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086968 Aug 24 05:25:17.914902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1212/2533] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:18.389118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b5164bde-90aa-4943-9469-db1378514096 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:18.389756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b5164bde-90aa-4943-9469-db1378514096 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:18.396693 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5164bde-90aa-4943-9469-db1378514096 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:18.397162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5164bde-90aa-4943-9469-db1378514096 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:18.397586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5164bde-90aa-4943-9469-db1378514096 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:18.398261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5164bde-90aa-4943-9469-db1378514096 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:18.398720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5164bde-90aa-4943-9469-db1378514096 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:18.399138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5164bde-90aa-4943-9469-db1378514096 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:18.464878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b5164bde-90aa-4943-9469-db1378514096 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:18.473287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7eb0d4ed-cf57-4dee-9d56-afb802c819b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:18.473821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b5164bde-90aa-4943-9469-db1378514096 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088357 Aug 24 05:25:18.473934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7eb0d4ed-cf57-4dee-9d56-afb802c819b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:18.474171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1322/2534] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:18.480432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eb0d4ed-cf57-4dee-9d56-afb802c819b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:18.480914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eb0d4ed-cf57-4dee-9d56-afb802c819b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:18.481348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eb0d4ed-cf57-4dee-9d56-afb802c819b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:18.482099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eb0d4ed-cf57-4dee-9d56-afb802c819b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:18.482554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eb0d4ed-cf57-4dee-9d56-afb802c819b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:18.483006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eb0d4ed-cf57-4dee-9d56-afb802c819b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:18.548302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7eb0d4ed-cf57-4dee-9d56-afb802c819b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:18.557251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7eb0d4ed-cf57-4dee-9d56-afb802c819b5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087812 Aug 24 05:25:18.557811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1213/2535] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:18.935704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1b76e24e-8660-4d4c-a5f8-62acbd34f310 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:18.936316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1b76e24e-8660-4d4c-a5f8-62acbd34f310 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:18.943058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b76e24e-8660-4d4c-a5f8-62acbd34f310 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:18.943540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b76e24e-8660-4d4c-a5f8-62acbd34f310 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:18.943972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b76e24e-8660-4d4c-a5f8-62acbd34f310 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:18.944694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b76e24e-8660-4d4c-a5f8-62acbd34f310 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:18.945143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b76e24e-8660-4d4c-a5f8-62acbd34f310 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:18.945565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b76e24e-8660-4d4c-a5f8-62acbd34f310 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:19.007263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1b76e24e-8660-4d4c-a5f8-62acbd34f310 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:19.015534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1b76e24e-8660-4d4c-a5f8-62acbd34f310 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.083750 Aug 24 05:25:19.016109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1323/2536] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:19.496033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a9957341-0902-4e8f-8006-c082d0bbd832 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:19.496746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a9957341-0902-4e8f-8006-c082d0bbd832 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:19.503295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9957341-0902-4e8f-8006-c082d0bbd832 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:19.503763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9957341-0902-4e8f-8006-c082d0bbd832 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:19.504465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9957341-0902-4e8f-8006-c082d0bbd832 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:19.505145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9957341-0902-4e8f-8006-c082d0bbd832 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:19.505585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9957341-0902-4e8f-8006-c082d0bbd832 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:19.505998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a9957341-0902-4e8f-8006-c082d0bbd832 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:19.570818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a9957341-0902-4e8f-8006-c082d0bbd832 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:19.578382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-da56b93e-b25f-471f-a535-90d16fc12453 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:19.579039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-da56b93e-b25f-471f-a535-90d16fc12453 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:19.580255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a9957341-0902-4e8f-8006-c082d0bbd832 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088310 Aug 24 05:25:19.581029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1214/2537] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:19.587313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da56b93e-b25f-471f-a535-90d16fc12453 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:19.587433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da56b93e-b25f-471f-a535-90d16fc12453 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:19.588036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da56b93e-b25f-471f-a535-90d16fc12453 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:19.588677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da56b93e-b25f-471f-a535-90d16fc12453 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:19.589245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da56b93e-b25f-471f-a535-90d16fc12453 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:19.589743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-da56b93e-b25f-471f-a535-90d16fc12453 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:19.657631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-da56b93e-b25f-471f-a535-90d16fc12453 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:19.666717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-da56b93e-b25f-471f-a535-90d16fc12453 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093217 Aug 24 05:25:19.667287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1324/2538] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:20.036751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-115d7435-edfd-477d-ae60-4298a6f7339d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:20.037349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-115d7435-edfd-477d-ae60-4298a6f7339d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:20.043314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-115d7435-edfd-477d-ae60-4298a6f7339d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:20.043787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-115d7435-edfd-477d-ae60-4298a6f7339d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:20.044212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-115d7435-edfd-477d-ae60-4298a6f7339d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:20.044883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-115d7435-edfd-477d-ae60-4298a6f7339d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:20.045326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-115d7435-edfd-477d-ae60-4298a6f7339d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:20.045739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-115d7435-edfd-477d-ae60-4298a6f7339d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:20.049579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:20.107979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-115d7435-edfd-477d-ae60-4298a6f7339d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:20.116652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-115d7435-edfd-477d-ae60-4298a6f7339d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084080 Aug 24 05:25:20.117225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1215/2539] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:20.601542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d42cf049-42f7-4de3-963c-b5ac5458cda2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:20.602154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d42cf049-42f7-4de3-963c-b5ac5458cda2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:20.608614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d42cf049-42f7-4de3-963c-b5ac5458cda2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:20.609087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d42cf049-42f7-4de3-963c-b5ac5458cda2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:20.609520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d42cf049-42f7-4de3-963c-b5ac5458cda2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:20.610193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d42cf049-42f7-4de3-963c-b5ac5458cda2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:20.610640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d42cf049-42f7-4de3-963c-b5ac5458cda2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:20.611091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d42cf049-42f7-4de3-963c-b5ac5458cda2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:20.672825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d42cf049-42f7-4de3-963c-b5ac5458cda2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:20.681761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d42cf049-42f7-4de3-963c-b5ac5458cda2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084229 Aug 24 05:25:20.682336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1325/2540] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:20.687593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fe646ced-b455-4d5a-9a08-29ef670c12c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:20.688207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fe646ced-b455-4d5a-9a08-29ef670c12c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:20.696008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe646ced-b455-4d5a-9a08-29ef670c12c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:20.696492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe646ced-b455-4d5a-9a08-29ef670c12c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:20.696932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe646ced-b455-4d5a-9a08-29ef670c12c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:20.697615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe646ced-b455-4d5a-9a08-29ef670c12c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:20.698067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe646ced-b455-4d5a-9a08-29ef670c12c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:20.698491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe646ced-b455-4d5a-9a08-29ef670c12c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:20.762526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fe646ced-b455-4d5a-9a08-29ef670c12c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:20.771035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fe646ced-b455-4d5a-9a08-29ef670c12c7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087185 Aug 24 05:25:20.771604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1216/2541] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:21.138082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-716d4425-95eb-4ff5-97ba-37ec2105f75b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:21.138704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-716d4425-95eb-4ff5-97ba-37ec2105f75b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:21.140593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=82 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:21.146399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-716d4425-95eb-4ff5-97ba-37ec2105f75b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:21.146906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-716d4425-95eb-4ff5-97ba-37ec2105f75b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:21.147340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-716d4425-95eb-4ff5-97ba-37ec2105f75b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:21.148023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-716d4425-95eb-4ff5-97ba-37ec2105f75b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:21.148468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-716d4425-95eb-4ff5-97ba-37ec2105f75b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:21.148885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-716d4425-95eb-4ff5-97ba-37ec2105f75b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:21.214196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-716d4425-95eb-4ff5-97ba-37ec2105f75b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:21.222317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-716d4425-95eb-4ff5-97ba-37ec2105f75b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088176 Aug 24 05:25:21.223512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1326/2542] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:21.702380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6691d3db-63c8-4c88-93ef-6a8a4b1a2360 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:21.703009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6691d3db-63c8-4c88-93ef-6a8a4b1a2360 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:21.709668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6691d3db-63c8-4c88-93ef-6a8a4b1a2360 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:21.710162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6691d3db-63c8-4c88-93ef-6a8a4b1a2360 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:21.710599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6691d3db-63c8-4c88-93ef-6a8a4b1a2360 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:21.711314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6691d3db-63c8-4c88-93ef-6a8a4b1a2360 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:21.711767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6691d3db-63c8-4c88-93ef-6a8a4b1a2360 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:21.712190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6691d3db-63c8-4c88-93ef-6a8a4b1a2360 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:21.776899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6691d3db-63c8-4c88-93ef-6a8a4b1a2360 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:21.785684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6691d3db-63c8-4c88-93ef-6a8a4b1a2360 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086655 Aug 24 05:25:21.786264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1217/2543] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:21.792122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-27871b85-3234-4890-9ab8-86de6b06d058 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:21.792725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-27871b85-3234-4890-9ab8-86de6b06d058 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:21.799285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27871b85-3234-4890-9ab8-86de6b06d058 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:21.799800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27871b85-3234-4890-9ab8-86de6b06d058 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:21.800229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27871b85-3234-4890-9ab8-86de6b06d058 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:21.801578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27871b85-3234-4890-9ab8-86de6b06d058 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:21.802025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27871b85-3234-4890-9ab8-86de6b06d058 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:21.802477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27871b85-3234-4890-9ab8-86de6b06d058 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:21.865145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-27871b85-3234-4890-9ab8-86de6b06d058 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:21.873521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-27871b85-3234-4890-9ab8-86de6b06d058 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085240 Aug 24 05:25:21.874087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1327/2544] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:22.244135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4207bc34-a73b-4d5e-bf46-c074cb03a405 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:22.244744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4207bc34-a73b-4d5e-bf46-c074cb03a405 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:22.250784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4207bc34-a73b-4d5e-bf46-c074cb03a405 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:22.251263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4207bc34-a73b-4d5e-bf46-c074cb03a405 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:22.251695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4207bc34-a73b-4d5e-bf46-c074cb03a405 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:22.252370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4207bc34-a73b-4d5e-bf46-c074cb03a405 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:22.252817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4207bc34-a73b-4d5e-bf46-c074cb03a405 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:22.253234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4207bc34-a73b-4d5e-bf46-c074cb03a405 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:22.318385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4207bc34-a73b-4d5e-bf46-c074cb03a405 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:22.326703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4207bc34-a73b-4d5e-bf46-c074cb03a405 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086456 Aug 24 05:25:22.327286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1218/2545] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:22.806945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-17403bb9-23f5-4f65-b1c1-315909ca76c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:22.807556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-17403bb9-23f5-4f65-b1c1-315909ca76c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:22.814010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17403bb9-23f5-4f65-b1c1-315909ca76c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:22.814601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17403bb9-23f5-4f65-b1c1-315909ca76c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:22.815031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17403bb9-23f5-4f65-b1c1-315909ca76c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:22.815712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17403bb9-23f5-4f65-b1c1-315909ca76c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:22.816165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17403bb9-23f5-4f65-b1c1-315909ca76c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:22.816625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17403bb9-23f5-4f65-b1c1-315909ca76c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:22.878736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-17403bb9-23f5-4f65-b1c1-315909ca76c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:22.887338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-17403bb9-23f5-4f65-b1c1-315909ca76c6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084546 Aug 24 05:25:22.887983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1328/2546] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:22.893186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-51b87c5c-b0a2-43d2-8ddb-4d9c76acd38a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:22.893870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-51b87c5c-b0a2-43d2-8ddb-4d9c76acd38a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:22.901063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51b87c5c-b0a2-43d2-8ddb-4d9c76acd38a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:22.901541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51b87c5c-b0a2-43d2-8ddb-4d9c76acd38a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:22.901972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51b87c5c-b0a2-43d2-8ddb-4d9c76acd38a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:22.902652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51b87c5c-b0a2-43d2-8ddb-4d9c76acd38a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:22.903129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51b87c5c-b0a2-43d2-8ddb-4d9c76acd38a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:22.903546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51b87c5c-b0a2-43d2-8ddb-4d9c76acd38a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:22.967640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-51b87c5c-b0a2-43d2-8ddb-4d9c76acd38a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:22.976081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-51b87c5c-b0a2-43d2-8ddb-4d9c76acd38a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086712 Aug 24 05:25:22.976637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1219/2547] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:22 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:23.348246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-23514371-f9fc-43bd-9e67-413d24c5deaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:23.348856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-23514371-f9fc-43bd-9e67-413d24c5deaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:23.354897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23514371-f9fc-43bd-9e67-413d24c5deaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:23.355382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23514371-f9fc-43bd-9e67-413d24c5deaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:23.355818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23514371-f9fc-43bd-9e67-413d24c5deaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:23.356498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23514371-f9fc-43bd-9e67-413d24c5deaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:23.356948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23514371-f9fc-43bd-9e67-413d24c5deaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:23.357370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23514371-f9fc-43bd-9e67-413d24c5deaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:23.418972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-23514371-f9fc-43bd-9e67-413d24c5deaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:23.427912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-23514371-f9fc-43bd-9e67-413d24c5deaf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.083571 Aug 24 05:25:23.428480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1329/2548] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:23.908605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-94dc7ece-f539-4c83-8968-723c046a756c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:23.909201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-94dc7ece-f539-4c83-8968-723c046a756c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:23.915777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94dc7ece-f539-4c83-8968-723c046a756c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:23.916260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94dc7ece-f539-4c83-8968-723c046a756c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:23.916698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94dc7ece-f539-4c83-8968-723c046a756c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:23.917380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94dc7ece-f539-4c83-8968-723c046a756c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:23.917836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94dc7ece-f539-4c83-8968-723c046a756c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:23.918293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-94dc7ece-f539-4c83-8968-723c046a756c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:23.986059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-94dc7ece-f539-4c83-8968-723c046a756c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:23.995003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-94dc7ece-f539-4c83-8968-723c046a756c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090199 Aug 24 05:25:23.995645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1220/2549] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:23.996824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2c41b67d-2d5a-458a-956a-175ad06b345b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:23.997428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2c41b67d-2d5a-458a-956a-175ad06b345b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:24.004853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c41b67d-2d5a-458a-956a-175ad06b345b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:24.005624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c41b67d-2d5a-458a-956a-175ad06b345b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:24.006058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c41b67d-2d5a-458a-956a-175ad06b345b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:24.006781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c41b67d-2d5a-458a-956a-175ad06b345b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:24.007231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c41b67d-2d5a-458a-956a-175ad06b345b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:24.007639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2c41b67d-2d5a-458a-956a-175ad06b345b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:24.077377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2c41b67d-2d5a-458a-956a-175ad06b345b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:24.086994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2c41b67d-2d5a-458a-956a-175ad06b345b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093942 Aug 24 05:25:24.087562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1330/2550] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:24.448785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-202ad17f-698a-4342-919f-7fc55962698a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:24.449305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-202ad17f-698a-4342-919f-7fc55962698a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:24.455297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-202ad17f-698a-4342-919f-7fc55962698a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:24.455770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-202ad17f-698a-4342-919f-7fc55962698a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:24.456200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-202ad17f-698a-4342-919f-7fc55962698a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:24.456909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-202ad17f-698a-4342-919f-7fc55962698a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:24.457409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-202ad17f-698a-4342-919f-7fc55962698a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:24.457825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-202ad17f-698a-4342-919f-7fc55962698a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:24.518820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-202ad17f-698a-4342-919f-7fc55962698a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:24.527306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-202ad17f-698a-4342-919f-7fc55962698a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.082453 Aug 24 05:25:24.527866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1221/2551] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:25.016390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-059533bf-1fa2-4a1f-a059-ec7dd0695147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:25.016978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-059533bf-1fa2-4a1f-a059-ec7dd0695147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:25.024141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-059533bf-1fa2-4a1f-a059-ec7dd0695147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:25.024626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-059533bf-1fa2-4a1f-a059-ec7dd0695147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:25.025063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-059533bf-1fa2-4a1f-a059-ec7dd0695147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:25.025765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-059533bf-1fa2-4a1f-a059-ec7dd0695147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:25.026230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-059533bf-1fa2-4a1f-a059-ec7dd0695147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:25.026661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-059533bf-1fa2-4a1f-a059-ec7dd0695147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:25.092250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-059533bf-1fa2-4a1f-a059-ec7dd0695147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:25.101703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-059533bf-1fa2-4a1f-a059-ec7dd0695147 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089055 Aug 24 05:25:25.102645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1331/2552] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:25.107449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f1a92ae6-3e13-48a6-afa4-7084337f771e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:25.108068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f1a92ae6-3e13-48a6-afa4-7084337f771e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:25.114639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1a92ae6-3e13-48a6-afa4-7084337f771e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:25.115158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1a92ae6-3e13-48a6-afa4-7084337f771e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:25.115597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1a92ae6-3e13-48a6-afa4-7084337f771e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:25.116289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1a92ae6-3e13-48a6-afa4-7084337f771e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:25.116744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1a92ae6-3e13-48a6-afa4-7084337f771e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:25.117169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1a92ae6-3e13-48a6-afa4-7084337f771e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:25.186546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f1a92ae6-3e13-48a6-afa4-7084337f771e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:25.196189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f1a92ae6-3e13-48a6-afa4-7084337f771e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092681 Aug 24 05:25:25.196770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1222/2553] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:25.548892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f8efbb16-f291-4259-8b1d-c2591ca5ebc4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:25.549495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f8efbb16-f291-4259-8b1d-c2591ca5ebc4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:25.556008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8efbb16-f291-4259-8b1d-c2591ca5ebc4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:25.556493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8efbb16-f291-4259-8b1d-c2591ca5ebc4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:25.556927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8efbb16-f291-4259-8b1d-c2591ca5ebc4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:25.557604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8efbb16-f291-4259-8b1d-c2591ca5ebc4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:25.558056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8efbb16-f291-4259-8b1d-c2591ca5ebc4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:25.558478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f8efbb16-f291-4259-8b1d-c2591ca5ebc4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:25.623668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f8efbb16-f291-4259-8b1d-c2591ca5ebc4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:25.632812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f8efbb16-f291-4259-8b1d-c2591ca5ebc4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087753 Aug 24 05:25:25.633316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1332/2554] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:26.123511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e918d0e0-ef13-402f-b350-a2ee001c65c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:26.124275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e918d0e0-ef13-402f-b350-a2ee001c65c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:26.130826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e918d0e0-ef13-402f-b350-a2ee001c65c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:26.131305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e918d0e0-ef13-402f-b350-a2ee001c65c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:26.131733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e918d0e0-ef13-402f-b350-a2ee001c65c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:26.132409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e918d0e0-ef13-402f-b350-a2ee001c65c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:26.132852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e918d0e0-ef13-402f-b350-a2ee001c65c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:26.133273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e918d0e0-ef13-402f-b350-a2ee001c65c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:26.214542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e918d0e0-ef13-402f-b350-a2ee001c65c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:26.218039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6d4518be-2e71-4fc4-984c-db7b3179cd2e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:26.218553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6d4518be-2e71-4fc4-984c-db7b3179cd2e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:26.223544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e918d0e0-ef13-402f-b350-a2ee001c65c2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.103296 Aug 24 05:25:26.224125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1223/2555] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:26 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:26.227353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d4518be-2e71-4fc4-984c-db7b3179cd2e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:26.227845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d4518be-2e71-4fc4-984c-db7b3179cd2e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:26.228284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d4518be-2e71-4fc4-984c-db7b3179cd2e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:26.228976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d4518be-2e71-4fc4-984c-db7b3179cd2e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:26.229609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d4518be-2e71-4fc4-984c-db7b3179cd2e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:26.230055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6d4518be-2e71-4fc4-984c-db7b3179cd2e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:26.246606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:26.295309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6d4518be-2e71-4fc4-984c-db7b3179cd2e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:26.306036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6d4518be-2e71-4fc4-984c-db7b3179cd2e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091653 Aug 24 05:25:26.306641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1333/2556] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:26.653565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-deee871b-625b-4d99-943e-1729fac2c9f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:26.654171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-deee871b-625b-4d99-943e-1729fac2c9f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:26.660864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deee871b-625b-4d99-943e-1729fac2c9f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:26.661350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deee871b-625b-4d99-943e-1729fac2c9f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:26.661778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deee871b-625b-4d99-943e-1729fac2c9f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:26.662454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deee871b-625b-4d99-943e-1729fac2c9f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:26.663046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deee871b-625b-4d99-943e-1729fac2c9f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:26.663467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-deee871b-625b-4d99-943e-1729fac2c9f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:26.727553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-deee871b-625b-4d99-943e-1729fac2c9f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:26.735755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-deee871b-625b-4d99-943e-1729fac2c9f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086079 Aug 24 05:25:26.736313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1224/2557] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:27.244794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-36db17f2-241e-4092-9f7d-5221cf669895 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:27.245412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-36db17f2-241e-4092-9f7d-5221cf669895 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:27.251907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36db17f2-241e-4092-9f7d-5221cf669895 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:27.252387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36db17f2-241e-4092-9f7d-5221cf669895 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:27.252823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36db17f2-241e-4092-9f7d-5221cf669895 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:27.253503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36db17f2-241e-4092-9f7d-5221cf669895 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:27.254612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36db17f2-241e-4092-9f7d-5221cf669895 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:27.255238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-36db17f2-241e-4092-9f7d-5221cf669895 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:27.320279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-36db17f2-241e-4092-9f7d-5221cf669895 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:27.326184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-81caf386-3ce9-4683-a7db-cf6204d9073d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:27.326816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-81caf386-3ce9-4683-a7db-cf6204d9073d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:27.328543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-36db17f2-241e-4092-9f7d-5221cf669895 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087657 Aug 24 05:25:27.329116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1334/2558] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:27.333404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81caf386-3ce9-4683-a7db-cf6204d9073d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:27.333877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81caf386-3ce9-4683-a7db-cf6204d9073d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:27.334304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81caf386-3ce9-4683-a7db-cf6204d9073d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:27.335083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81caf386-3ce9-4683-a7db-cf6204d9073d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:27.335532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81caf386-3ce9-4683-a7db-cf6204d9073d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:27.335955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-81caf386-3ce9-4683-a7db-cf6204d9073d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:27.397942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-81caf386-3ce9-4683-a7db-cf6204d9073d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:27.406311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-81caf386-3ce9-4683-a7db-cf6204d9073d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.083855 Aug 24 05:25:27.406907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1225/2559] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:27 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:27.756979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-849e3be4-134b-4875-bc2d-d64921fd7c23 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:27.757617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-849e3be4-134b-4875-bc2d-d64921fd7c23 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:27.764354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849e3be4-134b-4875-bc2d-d64921fd7c23 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:27.764838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849e3be4-134b-4875-bc2d-d64921fd7c23 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:27.765267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849e3be4-134b-4875-bc2d-d64921fd7c23 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:27.765960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849e3be4-134b-4875-bc2d-d64921fd7c23 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:27.766398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849e3be4-134b-4875-bc2d-d64921fd7c23 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:27.766846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-849e3be4-134b-4875-bc2d-d64921fd7c23 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:27.828724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-849e3be4-134b-4875-bc2d-d64921fd7c23 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:27.837725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-849e3be4-134b-4875-bc2d-d64921fd7c23 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084819 Aug 24 05:25:27.838292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1335/2560] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:27 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:28.349544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ebbf2160-8cdb-4cce-877e-1def04cf9202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:28.350151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ebbf2160-8cdb-4cce-877e-1def04cf9202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:28.356702 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebbf2160-8cdb-4cce-877e-1def04cf9202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:28.357180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebbf2160-8cdb-4cce-877e-1def04cf9202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:28.357615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebbf2160-8cdb-4cce-877e-1def04cf9202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:28.358299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebbf2160-8cdb-4cce-877e-1def04cf9202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:28.358774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebbf2160-8cdb-4cce-877e-1def04cf9202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:28.359199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebbf2160-8cdb-4cce-877e-1def04cf9202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:28.424239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ebbf2160-8cdb-4cce-877e-1def04cf9202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:28.426462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cd7a22a9-79cf-4f47-814b-5ee2e8a5147c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:28.427097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cd7a22a9-79cf-4f47-814b-5ee2e8a5147c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:28.433210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ebbf2160-8cdb-4cce-877e-1def04cf9202 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087610 Aug 24 05:25:28.433871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1226/2561] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:28.434006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd7a22a9-79cf-4f47-814b-5ee2e8a5147c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:28.434424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd7a22a9-79cf-4f47-814b-5ee2e8a5147c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:28.434890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd7a22a9-79cf-4f47-814b-5ee2e8a5147c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:28.435582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd7a22a9-79cf-4f47-814b-5ee2e8a5147c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:28.436028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd7a22a9-79cf-4f47-814b-5ee2e8a5147c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:28.436438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd7a22a9-79cf-4f47-814b-5ee2e8a5147c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:28.499446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cd7a22a9-79cf-4f47-814b-5ee2e8a5147c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:28.508358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cd7a22a9-79cf-4f47-814b-5ee2e8a5147c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085749 Aug 24 05:25:28.508930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1336/2562] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:28.859190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7f73391b-3ccd-45db-ba59-95ab26fac228 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:28.859792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7f73391b-3ccd-45db-ba59-95ab26fac228 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:28.866360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f73391b-3ccd-45db-ba59-95ab26fac228 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:28.866947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f73391b-3ccd-45db-ba59-95ab26fac228 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:28.867378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f73391b-3ccd-45db-ba59-95ab26fac228 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:28.868049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f73391b-3ccd-45db-ba59-95ab26fac228 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:28.868492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f73391b-3ccd-45db-ba59-95ab26fac228 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:28.868903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f73391b-3ccd-45db-ba59-95ab26fac228 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:28.929780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7f73391b-3ccd-45db-ba59-95ab26fac228 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:28.938392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7f73391b-3ccd-45db-ba59-95ab26fac228 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.083106 Aug 24 05:25:28.939023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1227/2563] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:29.454744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-50983d39-0cbc-43a3-b101-7582b9ac5d53 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:29.455354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-50983d39-0cbc-43a3-b101-7582b9ac5d53 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:29.461818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50983d39-0cbc-43a3-b101-7582b9ac5d53 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:29.462291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50983d39-0cbc-43a3-b101-7582b9ac5d53 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:29.462746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50983d39-0cbc-43a3-b101-7582b9ac5d53 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:29.463423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50983d39-0cbc-43a3-b101-7582b9ac5d53 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:29.463871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50983d39-0cbc-43a3-b101-7582b9ac5d53 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:29.464289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-50983d39-0cbc-43a3-b101-7582b9ac5d53 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:29.525305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-50983d39-0cbc-43a3-b101-7582b9ac5d53 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:29.533975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-50983d39-0cbc-43a3-b101-7582b9ac5d53 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.083022 Aug 24 05:25:29.534473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-93306c5c-be49-480f-a4a2-690ec760149b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:29.535000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1337/2564] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:29.535204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-93306c5c-be49-480f-a4a2-690ec760149b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:29.541695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93306c5c-be49-480f-a4a2-690ec760149b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:29.542176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93306c5c-be49-480f-a4a2-690ec760149b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:29.542609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93306c5c-be49-480f-a4a2-690ec760149b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:29.543332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93306c5c-be49-480f-a4a2-690ec760149b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:29.543784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93306c5c-be49-480f-a4a2-690ec760149b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:29.544202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93306c5c-be49-480f-a4a2-690ec760149b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:29.606054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-93306c5c-be49-480f-a4a2-690ec760149b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:29.614974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-93306c5c-be49-480f-a4a2-690ec760149b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085530 Aug 24 05:25:29.615540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1228/2565] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:29.960019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fcfc6bdb-faf0-4240-9aa1-ce64cde77ec2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:29.960631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fcfc6bdb-faf0-4240-9aa1-ce64cde77ec2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:29.966586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcfc6bdb-faf0-4240-9aa1-ce64cde77ec2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:29.967101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcfc6bdb-faf0-4240-9aa1-ce64cde77ec2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:29.967539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcfc6bdb-faf0-4240-9aa1-ce64cde77ec2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:29.968219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcfc6bdb-faf0-4240-9aa1-ce64cde77ec2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:29.968668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcfc6bdb-faf0-4240-9aa1-ce64cde77ec2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:29.969089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fcfc6bdb-faf0-4240-9aa1-ce64cde77ec2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:30.033483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fcfc6bdb-faf0-4240-9aa1-ce64cde77ec2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:30.042392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fcfc6bdb-faf0-4240-9aa1-ce64cde77ec2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086456 Aug 24 05:25:30.043007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1338/2566] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:30.554670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-aa716cb7-ca72-426f-9fa2-eeee05fd464d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:30.555306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-aa716cb7-ca72-426f-9fa2-eeee05fd464d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:30.562004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa716cb7-ca72-426f-9fa2-eeee05fd464d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:30.562486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa716cb7-ca72-426f-9fa2-eeee05fd464d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:30.562946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa716cb7-ca72-426f-9fa2-eeee05fd464d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:30.563626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa716cb7-ca72-426f-9fa2-eeee05fd464d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:30.564081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa716cb7-ca72-426f-9fa2-eeee05fd464d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:30.564497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa716cb7-ca72-426f-9fa2-eeee05fd464d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:30.626828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-aa716cb7-ca72-426f-9fa2-eeee05fd464d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:30.636419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-aa716cb7-ca72-426f-9fa2-eeee05fd464d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085576 Aug 24 05:25:30.636996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0007f5d2-7050-4916-9c01-6ca469fcebcd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:30.637493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1229/2567] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:30.637852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0007f5d2-7050-4916-9c01-6ca469fcebcd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:30.647358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0007f5d2-7050-4916-9c01-6ca469fcebcd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:30.647836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0007f5d2-7050-4916-9c01-6ca469fcebcd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:30.648269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0007f5d2-7050-4916-9c01-6ca469fcebcd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:30.648957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0007f5d2-7050-4916-9c01-6ca469fcebcd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:30.649404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0007f5d2-7050-4916-9c01-6ca469fcebcd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:30.649856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0007f5d2-7050-4916-9c01-6ca469fcebcd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:30.713694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0007f5d2-7050-4916-9c01-6ca469fcebcd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:30.721929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0007f5d2-7050-4916-9c01-6ca469fcebcd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088743 Aug 24 05:25:30.722554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1339/2568] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:31.064243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4fe33e87-57ca-413f-8564-4e0eb847ccf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:31.064861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4fe33e87-57ca-413f-8564-4e0eb847ccf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:31.071605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fe33e87-57ca-413f-8564-4e0eb847ccf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:31.072083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fe33e87-57ca-413f-8564-4e0eb847ccf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:31.072520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fe33e87-57ca-413f-8564-4e0eb847ccf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:31.073199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fe33e87-57ca-413f-8564-4e0eb847ccf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:31.073651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fe33e87-57ca-413f-8564-4e0eb847ccf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:31.074074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fe33e87-57ca-413f-8564-4e0eb847ccf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:31.139010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4fe33e87-57ca-413f-8564-4e0eb847ccf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:31.147508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4fe33e87-57ca-413f-8564-4e0eb847ccf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087165 Aug 24 05:25:31.148073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1230/2569] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:31.657808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-996772ca-ea55-4222-b320-6ee971e1cf74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:31.658368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-996772ca-ea55-4222-b320-6ee971e1cf74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:31.665486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996772ca-ea55-4222-b320-6ee971e1cf74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:31.665955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996772ca-ea55-4222-b320-6ee971e1cf74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:31.666379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996772ca-ea55-4222-b320-6ee971e1cf74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:31.667069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996772ca-ea55-4222-b320-6ee971e1cf74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:31.667511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996772ca-ea55-4222-b320-6ee971e1cf74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:31.667921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-996772ca-ea55-4222-b320-6ee971e1cf74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:31.730369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-996772ca-ea55-4222-b320-6ee971e1cf74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:31.738788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-996772ca-ea55-4222-b320-6ee971e1cf74 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084803 Aug 24 05:25:31.739426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1340/2570] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:31.741810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-42d14dc2-bbda-41ac-9a96-4b101e0a9e63 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:31.742420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-42d14dc2-bbda-41ac-9a96-4b101e0a9e63 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:31.749241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42d14dc2-bbda-41ac-9a96-4b101e0a9e63 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:31.749724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42d14dc2-bbda-41ac-9a96-4b101e0a9e63 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:31.750156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42d14dc2-bbda-41ac-9a96-4b101e0a9e63 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:31.751492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42d14dc2-bbda-41ac-9a96-4b101e0a9e63 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:31.751967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42d14dc2-bbda-41ac-9a96-4b101e0a9e63 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:31.752384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-42d14dc2-bbda-41ac-9a96-4b101e0a9e63 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:31.817928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-42d14dc2-bbda-41ac-9a96-4b101e0a9e63 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:31.820185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:31.827575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-42d14dc2-bbda-41ac-9a96-4b101e0a9e63 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089943 Aug 24 05:25:31.828137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1231/2571] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:32.168298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fad95201-c2e0-4b1a-af2b-6dbebe483710 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:32.168907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fad95201-c2e0-4b1a-af2b-6dbebe483710 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:32.174948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fad95201-c2e0-4b1a-af2b-6dbebe483710 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:32.175426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fad95201-c2e0-4b1a-af2b-6dbebe483710 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:32.175958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fad95201-c2e0-4b1a-af2b-6dbebe483710 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:32.176640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fad95201-c2e0-4b1a-af2b-6dbebe483710 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:32.177096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fad95201-c2e0-4b1a-af2b-6dbebe483710 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:32.177520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fad95201-c2e0-4b1a-af2b-6dbebe483710 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:32.242456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fad95201-c2e0-4b1a-af2b-6dbebe483710 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:32.256540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fad95201-c2e0-4b1a-af2b-6dbebe483710 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091851 Aug 24 05:25:32.257122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1341/2572] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:32.760316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fa559667-1f76-430c-ad88-4be97cdb9c0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:32.760928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fa559667-1f76-430c-ad88-4be97cdb9c0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:32.768094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa559667-1f76-430c-ad88-4be97cdb9c0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:32.768776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa559667-1f76-430c-ad88-4be97cdb9c0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:32.770066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa559667-1f76-430c-ad88-4be97cdb9c0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:32.770763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa559667-1f76-430c-ad88-4be97cdb9c0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:32.771535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa559667-1f76-430c-ad88-4be97cdb9c0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:32.772327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa559667-1f76-430c-ad88-4be97cdb9c0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:32.849331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ba30987c-3b45-4202-bfa8-92d4f8d79556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:32.850012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ba30987c-3b45-4202-bfa8-92d4f8d79556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:32.850143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fa559667-1f76-430c-ad88-4be97cdb9c0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:32.856974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba30987c-3b45-4202-bfa8-92d4f8d79556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:32.858171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba30987c-3b45-4202-bfa8-92d4f8d79556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:32.858709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba30987c-3b45-4202-bfa8-92d4f8d79556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:32.859539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba30987c-3b45-4202-bfa8-92d4f8d79556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:32.860076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba30987c-3b45-4202-bfa8-92d4f8d79556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:32.860721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba30987c-3b45-4202-bfa8-92d4f8d79556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:32.864699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fa559667-1f76-430c-ad88-4be97cdb9c0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.108131 Aug 24 05:25:32.865619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1232/2573] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:32.939567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ba30987c-3b45-4202-bfa8-92d4f8d79556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:32.949974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ba30987c-3b45-4202-bfa8-92d4f8d79556 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.104624 Aug 24 05:25:32.950554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1342/2574] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:33.283004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e72d6297-e88d-4064-8e67-494daa4a48f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:33.283610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e72d6297-e88d-4064-8e67-494daa4a48f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:33.290253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e72d6297-e88d-4064-8e67-494daa4a48f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:33.290758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e72d6297-e88d-4064-8e67-494daa4a48f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:33.291191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e72d6297-e88d-4064-8e67-494daa4a48f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:33.291868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e72d6297-e88d-4064-8e67-494daa4a48f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:33.292314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e72d6297-e88d-4064-8e67-494daa4a48f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:33.292729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e72d6297-e88d-4064-8e67-494daa4a48f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:33.353881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e72d6297-e88d-4064-8e67-494daa4a48f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:33.362188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e72d6297-e88d-4064-8e67-494daa4a48f6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.083060 Aug 24 05:25:33.362767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1233/2575] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:33.885670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4d2ccec7-a955-435d-a4b1-d4cb7bfd5055 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:33.886280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4d2ccec7-a955-435d-a4b1-d4cb7bfd5055 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:33.893098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2ccec7-a955-435d-a4b1-d4cb7bfd5055 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:33.893909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2ccec7-a955-435d-a4b1-d4cb7bfd5055 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:33.895198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2ccec7-a955-435d-a4b1-d4cb7bfd5055 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:33.896105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2ccec7-a955-435d-a4b1-d4cb7bfd5055 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:33.896556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2ccec7-a955-435d-a4b1-d4cb7bfd5055 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:33.896979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d2ccec7-a955-435d-a4b1-d4cb7bfd5055 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:33.972822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4d2ccec7-a955-435d-a4b1-d4cb7bfd5055 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:33.978421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-722b99cf-68ba-46d2-af2a-1ab9258736f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:33.979072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-722b99cf-68ba-46d2-af2a-1ab9258736f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:33.982015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4d2ccec7-a955-435d-a4b1-d4cb7bfd5055 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.100154 Aug 24 05:25:33.982847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1343/2576] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:33.985830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-722b99cf-68ba-46d2-af2a-1ab9258736f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:33.986261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-722b99cf-68ba-46d2-af2a-1ab9258736f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:33.986820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-722b99cf-68ba-46d2-af2a-1ab9258736f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:33.987525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-722b99cf-68ba-46d2-af2a-1ab9258736f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:33.988014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-722b99cf-68ba-46d2-af2a-1ab9258736f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:33.988440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-722b99cf-68ba-46d2-af2a-1ab9258736f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:34.057805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-722b99cf-68ba-46d2-af2a-1ab9258736f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:34.066943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-722b99cf-68ba-46d2-af2a-1ab9258736f0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092367 Aug 24 05:25:34.067675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1234/2577] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:33 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:34.382847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aaa306d6-e9f6-4ea2-aa65-93afb3d40bde tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:34.383455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aaa306d6-e9f6-4ea2-aa65-93afb3d40bde tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:34.389573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaa306d6-e9f6-4ea2-aa65-93afb3d40bde tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:34.390061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaa306d6-e9f6-4ea2-aa65-93afb3d40bde tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:34.390498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaa306d6-e9f6-4ea2-aa65-93afb3d40bde tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:34.391214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaa306d6-e9f6-4ea2-aa65-93afb3d40bde tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:34.391667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaa306d6-e9f6-4ea2-aa65-93afb3d40bde tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:34.392088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaa306d6-e9f6-4ea2-aa65-93afb3d40bde tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:34.453809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aaa306d6-e9f6-4ea2-aa65-93afb3d40bde tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:34.462882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aaa306d6-e9f6-4ea2-aa65-93afb3d40bde tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084543 Aug 24 05:25:34.463447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1344/2578] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:34 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:35.002435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3049d5f5-59ae-40ca-83ad-d383c94f51db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:35.003055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3049d5f5-59ae-40ca-83ad-d383c94f51db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:35.009402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3049d5f5-59ae-40ca-83ad-d383c94f51db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:35.009909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3049d5f5-59ae-40ca-83ad-d383c94f51db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:35.010335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3049d5f5-59ae-40ca-83ad-d383c94f51db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:35.011038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3049d5f5-59ae-40ca-83ad-d383c94f51db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:35.011483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3049d5f5-59ae-40ca-83ad-d383c94f51db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:35.011915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3049d5f5-59ae-40ca-83ad-d383c94f51db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:35.073537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3049d5f5-59ae-40ca-83ad-d383c94f51db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:35.081891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3049d5f5-59ae-40ca-83ad-d383c94f51db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.083244 Aug 24 05:25:35.082472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1235/2579] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:35.087878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7be16fe6-e3d9-4e10-8a4e-ffd50b4e4b79 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:35.088480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7be16fe6-e3d9-4e10-8a4e-ffd50b4e4b79 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:35.095351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7be16fe6-e3d9-4e10-8a4e-ffd50b4e4b79 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:35.095819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7be16fe6-e3d9-4e10-8a4e-ffd50b4e4b79 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:35.096246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7be16fe6-e3d9-4e10-8a4e-ffd50b4e4b79 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:35.096911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7be16fe6-e3d9-4e10-8a4e-ffd50b4e4b79 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:35.097939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7be16fe6-e3d9-4e10-8a4e-ffd50b4e4b79 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:35.098430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7be16fe6-e3d9-4e10-8a4e-ffd50b4e4b79 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:35.159721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7be16fe6-e3d9-4e10-8a4e-ffd50b4e4b79 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:35.168080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7be16fe6-e3d9-4e10-8a4e-ffd50b4e4b79 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.084002 Aug 24 05:25:35.168650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1345/2580] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:35 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:35.483461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6d8b9e57-8636-4fa4-88c6-53857df0dc56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:35.484070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6d8b9e57-8636-4fa4-88c6-53857df0dc56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:35.490808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d8b9e57-8636-4fa4-88c6-53857df0dc56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:35.491291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d8b9e57-8636-4fa4-88c6-53857df0dc56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:35.491724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d8b9e57-8636-4fa4-88c6-53857df0dc56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:35.492405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d8b9e57-8636-4fa4-88c6-53857df0dc56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:35.492855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d8b9e57-8636-4fa4-88c6-53857df0dc56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:35.493274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d8b9e57-8636-4fa4-88c6-53857df0dc56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:35.555090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6d8b9e57-8636-4fa4-88c6-53857df0dc56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:35.564117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6d8b9e57-8636-4fa4-88c6-53857df0dc56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084486 Aug 24 05:25:35.564681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1236/2581] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:36.103178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-01427fd9-43c1-47d9-b152-d66b41fcb57c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:36.103793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-01427fd9-43c1-47d9-b152-d66b41fcb57c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:36.110133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01427fd9-43c1-47d9-b152-d66b41fcb57c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:36.110600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01427fd9-43c1-47d9-b152-d66b41fcb57c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:36.111069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01427fd9-43c1-47d9-b152-d66b41fcb57c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:36.111749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01427fd9-43c1-47d9-b152-d66b41fcb57c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:36.112187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01427fd9-43c1-47d9-b152-d66b41fcb57c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:36.112598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-01427fd9-43c1-47d9-b152-d66b41fcb57c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:36.178788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-01427fd9-43c1-47d9-b152-d66b41fcb57c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:36.187584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-01427fd9-43c1-47d9-b152-d66b41fcb57c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088392 Aug 24 05:25:36.188142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1346/2582] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:36.280498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8dd468f0-e44f-4f60-b334-af0ffac0f46f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:36.281108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8dd468f0-e44f-4f60-b334-af0ffac0f46f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:36.287213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dd468f0-e44f-4f60-b334-af0ffac0f46f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:36.287694 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dd468f0-e44f-4f60-b334-af0ffac0f46f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:36.288132 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dd468f0-e44f-4f60-b334-af0ffac0f46f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:36.288814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dd468f0-e44f-4f60-b334-af0ffac0f46f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:36.289260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dd468f0-e44f-4f60-b334-af0ffac0f46f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:36.289678 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8dd468f0-e44f-4f60-b334-af0ffac0f46f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:36.351445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8dd468f0-e44f-4f60-b334-af0ffac0f46f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:36.359734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8dd468f0-e44f-4f60-b334-af0ffac0f46f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.175398 Aug 24 05:25:36.360234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1237/2583] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:36 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:36.585587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-69e39d93-bea6-497a-a288-43747f0432c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:36.586194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-69e39d93-bea6-497a-a288-43747f0432c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:36.592249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e39d93-bea6-497a-a288-43747f0432c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:36.592727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e39d93-bea6-497a-a288-43747f0432c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:36.593161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e39d93-bea6-497a-a288-43747f0432c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:36.593839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e39d93-bea6-497a-a288-43747f0432c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:36.594289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e39d93-bea6-497a-a288-43747f0432c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:36.594727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e39d93-bea6-497a-a288-43747f0432c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:36.660680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-69e39d93-bea6-497a-a288-43747f0432c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:36.668993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-69e39d93-bea6-497a-a288-43747f0432c5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087411 Aug 24 05:25:36.669561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1347/2584] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:37.208385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-69a6157f-9957-4eeb-9ea7-78124808d705 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:37.208988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-69a6157f-9957-4eeb-9ea7-78124808d705 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:37.215151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69a6157f-9957-4eeb-9ea7-78124808d705 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:37.215623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69a6157f-9957-4eeb-9ea7-78124808d705 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:37.216048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69a6157f-9957-4eeb-9ea7-78124808d705 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:37.216723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69a6157f-9957-4eeb-9ea7-78124808d705 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:37.217165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69a6157f-9957-4eeb-9ea7-78124808d705 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:37.217584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69a6157f-9957-4eeb-9ea7-78124808d705 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:37.284370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-69a6157f-9957-4eeb-9ea7-78124808d705 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:37.293067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-69a6157f-9957-4eeb-9ea7-78124808d705 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088747 Aug 24 05:25:37.293627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1238/2585] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:37.383237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6c0ae0b8-6151-4d4e-b540-dca60e776ea3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:37.383917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6c0ae0b8-6151-4d4e-b540-dca60e776ea3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:37.390428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c0ae0b8-6151-4d4e-b540-dca60e776ea3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:37.390945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c0ae0b8-6151-4d4e-b540-dca60e776ea3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:37.391378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c0ae0b8-6151-4d4e-b540-dca60e776ea3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:37.392060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c0ae0b8-6151-4d4e-b540-dca60e776ea3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:37.392512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c0ae0b8-6151-4d4e-b540-dca60e776ea3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:37.392966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c0ae0b8-6151-4d4e-b540-dca60e776ea3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:37.454374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6c0ae0b8-6151-4d4e-b540-dca60e776ea3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:37.462916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6c0ae0b8-6151-4d4e-b540-dca60e776ea3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.083559 Aug 24 05:25:37.463426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1348/2586] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:37.691783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c25e18ed-043d-4210-9062-1d33c7bdf808 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:37.692323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c25e18ed-043d-4210-9062-1d33c7bdf808 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:37.698566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c25e18ed-043d-4210-9062-1d33c7bdf808 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:37.699117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c25e18ed-043d-4210-9062-1d33c7bdf808 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:37.699554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c25e18ed-043d-4210-9062-1d33c7bdf808 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:37.700264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c25e18ed-043d-4210-9062-1d33c7bdf808 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:37.700714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c25e18ed-043d-4210-9062-1d33c7bdf808 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:37.701133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c25e18ed-043d-4210-9062-1d33c7bdf808 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:37.763108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c25e18ed-043d-4210-9062-1d33c7bdf808 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:37.771882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c25e18ed-043d-4210-9062-1d33c7bdf808 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084593 Aug 24 05:25:37.772435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1239/2587] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:38.314006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5220f314-15f0-4f7a-805f-3128bcc3ae25 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:38.314605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5220f314-15f0-4f7a-805f-3128bcc3ae25 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:38.320607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5220f314-15f0-4f7a-805f-3128bcc3ae25 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:38.321076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5220f314-15f0-4f7a-805f-3128bcc3ae25 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:38.321504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5220f314-15f0-4f7a-805f-3128bcc3ae25 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:38.322174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5220f314-15f0-4f7a-805f-3128bcc3ae25 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:38.322615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5220f314-15f0-4f7a-805f-3128bcc3ae25 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:38.323050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5220f314-15f0-4f7a-805f-3128bcc3ae25 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:38.387192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5220f314-15f0-4f7a-805f-3128bcc3ae25 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:38.396582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5220f314-15f0-4f7a-805f-3128bcc3ae25 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086401 Aug 24 05:25:38.397164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1349/2588] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:38.484027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f6805a4f-e8d5-4a96-b4e0-9f1f01643f0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:38.484662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f6805a4f-e8d5-4a96-b4e0-9f1f01643f0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:38.491343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6805a4f-e8d5-4a96-b4e0-9f1f01643f0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:38.491828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6805a4f-e8d5-4a96-b4e0-9f1f01643f0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:38.492266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6805a4f-e8d5-4a96-b4e0-9f1f01643f0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:38.492951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6805a4f-e8d5-4a96-b4e0-9f1f01643f0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:38.493406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6805a4f-e8d5-4a96-b4e0-9f1f01643f0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:38.493829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6805a4f-e8d5-4a96-b4e0-9f1f01643f0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:38.556129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f6805a4f-e8d5-4a96-b4e0-9f1f01643f0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:38.564352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f6805a4f-e8d5-4a96-b4e0-9f1f01643f0f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.084203 Aug 24 05:25:38.564848 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1240/2589] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:38.792358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-349b8f2c-4bc2-45aa-b9c7-971703b86b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:38.792957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-349b8f2c-4bc2-45aa-b9c7-971703b86b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:38.799106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349b8f2c-4bc2-45aa-b9c7-971703b86b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:38.799620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349b8f2c-4bc2-45aa-b9c7-971703b86b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:38.800047 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349b8f2c-4bc2-45aa-b9c7-971703b86b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:38.800733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349b8f2c-4bc2-45aa-b9c7-971703b86b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:38.801331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349b8f2c-4bc2-45aa-b9c7-971703b86b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:38.801751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349b8f2c-4bc2-45aa-b9c7-971703b86b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:38.804413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:38.868004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-349b8f2c-4bc2-45aa-b9c7-971703b86b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:38.876273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-349b8f2c-4bc2-45aa-b9c7-971703b86b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087725 Aug 24 05:25:38.876844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1350/2590] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:39.417283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2ea82f05-a1dd-4daa-8da5-74e5b6558432 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:39.417893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2ea82f05-a1dd-4daa-8da5-74e5b6558432 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:39.424070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ea82f05-a1dd-4daa-8da5-74e5b6558432 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.424538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ea82f05-a1dd-4daa-8da5-74e5b6558432 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.424984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ea82f05-a1dd-4daa-8da5-74e5b6558432 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.426443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ea82f05-a1dd-4daa-8da5-74e5b6558432 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.426925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ea82f05-a1dd-4daa-8da5-74e5b6558432 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.427349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ea82f05-a1dd-4daa-8da5-74e5b6558432 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.490910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2ea82f05-a1dd-4daa-8da5-74e5b6558432 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:39.499729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2ea82f05-a1dd-4daa-8da5-74e5b6558432 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086334 Aug 24 05:25:39.500311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1241/2591] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:39.586036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b8577c80-424d-43d4-878a-f1667308b500 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:39.586679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b8577c80-424d-43d4-878a-f1667308b500 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:39.593597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8577c80-424d-43d4-878a-f1667308b500 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.594086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8577c80-424d-43d4-878a-f1667308b500 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.595119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8577c80-424d-43d4-878a-f1667308b500 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.595237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8577c80-424d-43d4-878a-f1667308b500 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.595815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8577c80-424d-43d4-878a-f1667308b500 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.596486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b8577c80-424d-43d4-878a-f1667308b500 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.663204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b8577c80-424d-43d4-878a-f1667308b500 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:39.671597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b8577c80-424d-43d4-878a-f1667308b500 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090313 Aug 24 05:25:39.672182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1351/2592] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:39.897943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e3dc56ba-0e67-4b95-ba72-020b2d230d82 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:39.898469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e3dc56ba-0e67-4b95-ba72-020b2d230d82 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:39.904642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3dc56ba-0e67-4b95-ba72-020b2d230d82 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.905131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3dc56ba-0e67-4b95-ba72-020b2d230d82 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.905597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3dc56ba-0e67-4b95-ba72-020b2d230d82 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.906294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3dc56ba-0e67-4b95-ba72-020b2d230d82 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:39.906767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3dc56ba-0e67-4b95-ba72-020b2d230d82 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:39.907196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e3dc56ba-0e67-4b95-ba72-020b2d230d82 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:39.974363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e3dc56ba-0e67-4b95-ba72-020b2d230d82 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:39.982914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e3dc56ba-0e67-4b95-ba72-020b2d230d82 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089635 Aug 24 05:25:39.983488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1242/2593] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:40.521430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e8eeb106-87c9-4e59-a11e-63fdc58d3abb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:40.522097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e8eeb106-87c9-4e59-a11e-63fdc58d3abb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:40.529983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8eeb106-87c9-4e59-a11e-63fdc58d3abb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:40.530460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8eeb106-87c9-4e59-a11e-63fdc58d3abb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:40.530914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8eeb106-87c9-4e59-a11e-63fdc58d3abb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:40.531595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8eeb106-87c9-4e59-a11e-63fdc58d3abb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:40.532034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8eeb106-87c9-4e59-a11e-63fdc58d3abb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:40.532448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e8eeb106-87c9-4e59-a11e-63fdc58d3abb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:40.596883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e8eeb106-87c9-4e59-a11e-63fdc58d3abb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:40.608443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e8eeb106-87c9-4e59-a11e-63fdc58d3abb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091522 Aug 24 05:25:40.609037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1352/2594] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:40.693504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5a419878-8b35-449b-aa28-5bb5c5c694da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:40.694180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5a419878-8b35-449b-aa28-5bb5c5c694da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:40.700758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a419878-8b35-449b-aa28-5bb5c5c694da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:40.701237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a419878-8b35-449b-aa28-5bb5c5c694da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:40.701706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a419878-8b35-449b-aa28-5bb5c5c694da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:40.702397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a419878-8b35-449b-aa28-5bb5c5c694da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:40.702881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a419878-8b35-449b-aa28-5bb5c5c694da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:40.703308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a419878-8b35-449b-aa28-5bb5c5c694da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:40.770252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5a419878-8b35-449b-aa28-5bb5c5c694da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:40.778541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5a419878-8b35-449b-aa28-5bb5c5c694da tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089072 Aug 24 05:25:40.779145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1243/2595] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:41.004819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-12d784f4-ec2a-4a36-90a3-a3bbba35aa58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:41.005500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-12d784f4-ec2a-4a36-90a3-a3bbba35aa58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:41.011680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12d784f4-ec2a-4a36-90a3-a3bbba35aa58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:41.012162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12d784f4-ec2a-4a36-90a3-a3bbba35aa58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:41.012600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12d784f4-ec2a-4a36-90a3-a3bbba35aa58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:41.013289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12d784f4-ec2a-4a36-90a3-a3bbba35aa58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:41.013742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12d784f4-ec2a-4a36-90a3-a3bbba35aa58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:41.014165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12d784f4-ec2a-4a36-90a3-a3bbba35aa58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:41.077512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-12d784f4-ec2a-4a36-90a3-a3bbba35aa58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:41.086956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-12d784f4-ec2a-4a36-90a3-a3bbba35aa58 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086552 Aug 24 05:25:41.087542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1353/2596] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:41.632630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-399436a4-ba01-490e-b2c4-f318b6636ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:41.633232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-399436a4-ba01-490e-b2c4-f318b6636ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:41.639331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399436a4-ba01-490e-b2c4-f318b6636ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:41.639757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399436a4-ba01-490e-b2c4-f318b6636ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:41.640188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399436a4-ba01-490e-b2c4-f318b6636ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:41.640863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399436a4-ba01-490e-b2c4-f318b6636ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:41.641308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399436a4-ba01-490e-b2c4-f318b6636ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:41.641721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-399436a4-ba01-490e-b2c4-f318b6636ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:41.704979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-399436a4-ba01-490e-b2c4-f318b6636ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:41.714058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-399436a4-ba01-490e-b2c4-f318b6636ef4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085570 Aug 24 05:25:41.714625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1244/2597] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:41.799328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a63de4f0-14ec-45c8-9d7e-c0871589c63e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:41.799924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a63de4f0-14ec-45c8-9d7e-c0871589c63e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:41.807511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a63de4f0-14ec-45c8-9d7e-c0871589c63e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:41.807991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a63de4f0-14ec-45c8-9d7e-c0871589c63e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:41.808423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a63de4f0-14ec-45c8-9d7e-c0871589c63e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:41.809112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a63de4f0-14ec-45c8-9d7e-c0871589c63e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:41.809561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a63de4f0-14ec-45c8-9d7e-c0871589c63e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:41.809980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a63de4f0-14ec-45c8-9d7e-c0871589c63e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:41.876275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a63de4f0-14ec-45c8-9d7e-c0871589c63e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:41.886789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a63de4f0-14ec-45c8-9d7e-c0871589c63e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091246 Aug 24 05:25:41.887373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1354/2598] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:42.108399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8ced19fa-4462-4d68-a27a-a2a849128b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:42.109009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8ced19fa-4462-4d68-a27a-a2a849128b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:42.115439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ced19fa-4462-4d68-a27a-a2a849128b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:42.115915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ced19fa-4462-4d68-a27a-a2a849128b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:42.116347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ced19fa-4462-4d68-a27a-a2a849128b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:42.117039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ced19fa-4462-4d68-a27a-a2a849128b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:42.117484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ced19fa-4462-4d68-a27a-a2a849128b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:42.117903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ced19fa-4462-4d68-a27a-a2a849128b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:42.181758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8ced19fa-4462-4d68-a27a-a2a849128b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:42.190049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8ced19fa-4462-4d68-a27a-a2a849128b3f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085534 Aug 24 05:25:42.190626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1245/2599] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:42.734874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-12eabc40-c545-49a8-9d12-49b072c83889 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:42.735727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-12eabc40-c545-49a8-9d12-49b072c83889 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:42.742325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12eabc40-c545-49a8-9d12-49b072c83889 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:42.742841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12eabc40-c545-49a8-9d12-49b072c83889 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:42.743278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12eabc40-c545-49a8-9d12-49b072c83889 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:42.743982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12eabc40-c545-49a8-9d12-49b072c83889 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:42.744433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12eabc40-c545-49a8-9d12-49b072c83889 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:42.744858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12eabc40-c545-49a8-9d12-49b072c83889 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:42.810031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-12eabc40-c545-49a8-9d12-49b072c83889 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:42.818231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-12eabc40-c545-49a8-9d12-49b072c83889 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087242 Aug 24 05:25:42.818821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1355/2600] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:42.907590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9f9e581e-476d-47c5-8e84-a2497df340c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:42.908467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9f9e581e-476d-47c5-8e84-a2497df340c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:42.915110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f9e581e-476d-47c5-8e84-a2497df340c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:42.915588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f9e581e-476d-47c5-8e84-a2497df340c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:42.916022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f9e581e-476d-47c5-8e84-a2497df340c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:42.916729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f9e581e-476d-47c5-8e84-a2497df340c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:42.917179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f9e581e-476d-47c5-8e84-a2497df340c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:42.917598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9f9e581e-476d-47c5-8e84-a2497df340c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:42.984665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9f9e581e-476d-47c5-8e84-a2497df340c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:42.994349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9f9e581e-476d-47c5-8e84-a2497df340c2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090657 Aug 24 05:25:42.994888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1246/2601] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:43.211714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-40bb6d6d-cbbc-4993-94e6-0b02b003727d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:43.212326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-40bb6d6d-cbbc-4993-94e6-0b02b003727d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:43.218354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40bb6d6d-cbbc-4993-94e6-0b02b003727d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:43.218874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40bb6d6d-cbbc-4993-94e6-0b02b003727d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:43.219315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40bb6d6d-cbbc-4993-94e6-0b02b003727d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:43.220005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40bb6d6d-cbbc-4993-94e6-0b02b003727d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:43.220457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40bb6d6d-cbbc-4993-94e6-0b02b003727d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:43.220876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40bb6d6d-cbbc-4993-94e6-0b02b003727d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:43.285727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-40bb6d6d-cbbc-4993-94e6-0b02b003727d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:43.294538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-40bb6d6d-cbbc-4993-94e6-0b02b003727d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086680 Aug 24 05:25:43.295151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1356/2602] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:43.840067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9dbc1cd3-8afc-4b2b-9dbf-4ee197ab0276 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:43.840672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9dbc1cd3-8afc-4b2b-9dbf-4ee197ab0276 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:43.846679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbc1cd3-8afc-4b2b-9dbf-4ee197ab0276 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:43.848117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbc1cd3-8afc-4b2b-9dbf-4ee197ab0276 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:43.848709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbc1cd3-8afc-4b2b-9dbf-4ee197ab0276 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:43.849414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbc1cd3-8afc-4b2b-9dbf-4ee197ab0276 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:43.849910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbc1cd3-8afc-4b2b-9dbf-4ee197ab0276 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:43.850291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbc1cd3-8afc-4b2b-9dbf-4ee197ab0276 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:43.914973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9dbc1cd3-8afc-4b2b-9dbf-4ee197ab0276 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:43.923333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9dbc1cd3-8afc-4b2b-9dbf-4ee197ab0276 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087115 Aug 24 05:25:43.923914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1247/2603] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:44.015824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-45df4a26-3a0c-44ac-a360-59cb97c6f87e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:44.016381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-45df4a26-3a0c-44ac-a360-59cb97c6f87e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:44.023127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45df4a26-3a0c-44ac-a360-59cb97c6f87e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:44.023606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45df4a26-3a0c-44ac-a360-59cb97c6f87e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:44.024037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45df4a26-3a0c-44ac-a360-59cb97c6f87e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:44.024725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45df4a26-3a0c-44ac-a360-59cb97c6f87e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:44.025174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45df4a26-3a0c-44ac-a360-59cb97c6f87e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:44.025587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45df4a26-3a0c-44ac-a360-59cb97c6f87e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:44.090405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-45df4a26-3a0c-44ac-a360-59cb97c6f87e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:44.098926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-45df4a26-3a0c-44ac-a360-59cb97c6f87e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086934 Aug 24 05:25:44.099510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1357/2604] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:44.317626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-65e1cfda-581c-4fc7-a7aa-35d5010c074c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:44.318152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-65e1cfda-581c-4fc7-a7aa-35d5010c074c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:44.324322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e1cfda-581c-4fc7-a7aa-35d5010c074c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:44.324797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e1cfda-581c-4fc7-a7aa-35d5010c074c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:44.325224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e1cfda-581c-4fc7-a7aa-35d5010c074c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:44.325900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e1cfda-581c-4fc7-a7aa-35d5010c074c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:44.326343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e1cfda-581c-4fc7-a7aa-35d5010c074c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:44.326793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65e1cfda-581c-4fc7-a7aa-35d5010c074c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:44.345313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:44.397650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-65e1cfda-581c-4fc7-a7aa-35d5010c074c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:44.406041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-65e1cfda-581c-4fc7-a7aa-35d5010c074c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093255 Aug 24 05:25:44.406617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1248/2605] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:44.945143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-38be177e-ded5-47be-8e8a-3350d52b50c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:44.945879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-38be177e-ded5-47be-8e8a-3350d52b50c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:44.955018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38be177e-ded5-47be-8e8a-3350d52b50c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:44.955830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38be177e-ded5-47be-8e8a-3350d52b50c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:44.956549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38be177e-ded5-47be-8e8a-3350d52b50c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:44.957932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38be177e-ded5-47be-8e8a-3350d52b50c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:44.958426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38be177e-ded5-47be-8e8a-3350d52b50c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:44.959444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38be177e-ded5-47be-8e8a-3350d52b50c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:45.026999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-38be177e-ded5-47be-8e8a-3350d52b50c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:45.036733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-38be177e-ded5-47be-8e8a-3350d52b50c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.095929 Aug 24 05:25:45.037448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1358/2606] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:45.119268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3310eed0-977f-4954-ac88-a077a993e65a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:45.119881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3310eed0-977f-4954-ac88-a077a993e65a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:45.126434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3310eed0-977f-4954-ac88-a077a993e65a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:45.126950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3310eed0-977f-4954-ac88-a077a993e65a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:45.127388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3310eed0-977f-4954-ac88-a077a993e65a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:45.128077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3310eed0-977f-4954-ac88-a077a993e65a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:45.128591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3310eed0-977f-4954-ac88-a077a993e65a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:45.129016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3310eed0-977f-4954-ac88-a077a993e65a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:45.194806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3310eed0-977f-4954-ac88-a077a993e65a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:45.203265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3310eed0-977f-4954-ac88-a077a993e65a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087783 Aug 24 05:25:45.203853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1249/2607] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:45 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:45.430565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-16483a28-4de4-4709-97f9-b45e2849b757 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:45.431461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-16483a28-4de4-4709-97f9-b45e2849b757 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:45.437659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16483a28-4de4-4709-97f9-b45e2849b757 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:45.438143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16483a28-4de4-4709-97f9-b45e2849b757 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:45.438574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16483a28-4de4-4709-97f9-b45e2849b757 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:45.439290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16483a28-4de4-4709-97f9-b45e2849b757 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:45.439737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16483a28-4de4-4709-97f9-b45e2849b757 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:45.440153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-16483a28-4de4-4709-97f9-b45e2849b757 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:45.504022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-16483a28-4de4-4709-97f9-b45e2849b757 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:45.513738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-16483a28-4de4-4709-97f9-b45e2849b757 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086981 Aug 24 05:25:45.514312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1359/2608] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:46.057805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cfb7aae1-4a14-4969-893b-7d10fef6ffa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:46.058326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cfb7aae1-4a14-4969-893b-7d10fef6ffa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:46.064581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfb7aae1-4a14-4969-893b-7d10fef6ffa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:46.065068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfb7aae1-4a14-4969-893b-7d10fef6ffa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:46.065500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfb7aae1-4a14-4969-893b-7d10fef6ffa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:46.066955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfb7aae1-4a14-4969-893b-7d10fef6ffa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:46.067409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfb7aae1-4a14-4969-893b-7d10fef6ffa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:46.067837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cfb7aae1-4a14-4969-893b-7d10fef6ffa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:46.133023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cfb7aae1-4a14-4969-893b-7d10fef6ffa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:46.141388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cfb7aae1-4a14-4969-893b-7d10fef6ffa9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087816 Aug 24 05:25:46.141967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1250/2609] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:46.226182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-43e5eb14-1b13-45cb-aef0-453bf4e7a66e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:46.226871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-43e5eb14-1b13-45cb-aef0-453bf4e7a66e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:46.233499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43e5eb14-1b13-45cb-aef0-453bf4e7a66e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:46.233978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43e5eb14-1b13-45cb-aef0-453bf4e7a66e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:46.234408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43e5eb14-1b13-45cb-aef0-453bf4e7a66e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:46.235140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43e5eb14-1b13-45cb-aef0-453bf4e7a66e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:46.235573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43e5eb14-1b13-45cb-aef0-453bf4e7a66e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:46.236015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-43e5eb14-1b13-45cb-aef0-453bf4e7a66e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:46.301020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-43e5eb14-1b13-45cb-aef0-453bf4e7a66e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:46.309626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-43e5eb14-1b13-45cb-aef0-453bf4e7a66e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088122 Aug 24 05:25:46.310139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1360/2610] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:46.534786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-22031c1e-18c9-478f-9106-2c52426ef8d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:46.535394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-22031c1e-18c9-478f-9106-2c52426ef8d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:46.542065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22031c1e-18c9-478f-9106-2c52426ef8d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:46.542547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22031c1e-18c9-478f-9106-2c52426ef8d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:46.543004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22031c1e-18c9-478f-9106-2c52426ef8d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:46.543695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22031c1e-18c9-478f-9106-2c52426ef8d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:46.544148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22031c1e-18c9-478f-9106-2c52426ef8d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:46.544568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22031c1e-18c9-478f-9106-2c52426ef8d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:46.607766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-22031c1e-18c9-478f-9106-2c52426ef8d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:46.616892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-22031c1e-18c9-478f-9106-2c52426ef8d8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086114 Aug 24 05:25:46.617468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1251/2611] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:47.161861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4e5a4bb1-843e-4a06-ba0d-1ab936436863 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:47.162490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4e5a4bb1-843e-4a06-ba0d-1ab936436863 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:47.168543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5a4bb1-843e-4a06-ba0d-1ab936436863 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:47.169016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5a4bb1-843e-4a06-ba0d-1ab936436863 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:47.169439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5a4bb1-843e-4a06-ba0d-1ab936436863 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:47.170140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5a4bb1-843e-4a06-ba0d-1ab936436863 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:47.170583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5a4bb1-843e-4a06-ba0d-1ab936436863 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:47.171075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e5a4bb1-843e-4a06-ba0d-1ab936436863 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:47.233417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4e5a4bb1-843e-4a06-ba0d-1ab936436863 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:47.242733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4e5a4bb1-843e-4a06-ba0d-1ab936436863 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085354 Aug 24 05:25:47.243311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1361/2612] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:47.329335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-92d3e82a-f596-4972-900e-4d4bcb30bbde tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:47.329970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-92d3e82a-f596-4972-900e-4d4bcb30bbde tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:47.333128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=82 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:47.338812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92d3e82a-f596-4972-900e-4d4bcb30bbde tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:47.339329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92d3e82a-f596-4972-900e-4d4bcb30bbde tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:47.339766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92d3e82a-f596-4972-900e-4d4bcb30bbde tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:47.340453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92d3e82a-f596-4972-900e-4d4bcb30bbde tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:47.340903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92d3e82a-f596-4972-900e-4d4bcb30bbde tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:47.341327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-92d3e82a-f596-4972-900e-4d4bcb30bbde tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:47.405441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-92d3e82a-f596-4972-900e-4d4bcb30bbde tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:47.415030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-92d3e82a-f596-4972-900e-4d4bcb30bbde tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089409 Aug 24 05:25:47.415563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1252/2613] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:47.639331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2b25d535-08b7-4dde-bd8d-f2c4346d410a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:47.640032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2b25d535-08b7-4dde-bd8d-f2c4346d410a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:47.646907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b25d535-08b7-4dde-bd8d-f2c4346d410a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:47.647393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b25d535-08b7-4dde-bd8d-f2c4346d410a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:47.647828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b25d535-08b7-4dde-bd8d-f2c4346d410a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:47.648525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b25d535-08b7-4dde-bd8d-f2c4346d410a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:47.648982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b25d535-08b7-4dde-bd8d-f2c4346d410a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:47.649401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b25d535-08b7-4dde-bd8d-f2c4346d410a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:47.716605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2b25d535-08b7-4dde-bd8d-f2c4346d410a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:47.725462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2b25d535-08b7-4dde-bd8d-f2c4346d410a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089998 Aug 24 05:25:47.726038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1362/2614] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:48.263544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7eae09f0-9b0e-42da-8be7-9a010ca941ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:48.264181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7eae09f0-9b0e-42da-8be7-9a010ca941ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:48.273949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eae09f0-9b0e-42da-8be7-9a010ca941ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:48.274435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eae09f0-9b0e-42da-8be7-9a010ca941ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:48.274897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eae09f0-9b0e-42da-8be7-9a010ca941ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:48.275593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eae09f0-9b0e-42da-8be7-9a010ca941ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:48.276042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eae09f0-9b0e-42da-8be7-9a010ca941ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:48.276456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7eae09f0-9b0e-42da-8be7-9a010ca941ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:48.340386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7eae09f0-9b0e-42da-8be7-9a010ca941ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:48.349671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7eae09f0-9b0e-42da-8be7-9a010ca941ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089976 Aug 24 05:25:48.350246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1253/2615] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:48.436003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-016705ec-5608-4879-b3c6-dad5b9e0caf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:48.436728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-016705ec-5608-4879-b3c6-dad5b9e0caf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:48.445227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-016705ec-5608-4879-b3c6-dad5b9e0caf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:48.445883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-016705ec-5608-4879-b3c6-dad5b9e0caf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:48.446321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-016705ec-5608-4879-b3c6-dad5b9e0caf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:48.447265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-016705ec-5608-4879-b3c6-dad5b9e0caf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:48.448071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-016705ec-5608-4879-b3c6-dad5b9e0caf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:48.448764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-016705ec-5608-4879-b3c6-dad5b9e0caf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:48.513358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-016705ec-5608-4879-b3c6-dad5b9e0caf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:48.522731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-016705ec-5608-4879-b3c6-dad5b9e0caf6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090393 Aug 24 05:25:48.523228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1363/2616] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:48.746871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5de30640-381b-470f-ac6d-53109559362b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:48.747480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5de30640-381b-470f-ac6d-53109559362b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:48.754439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5de30640-381b-470f-ac6d-53109559362b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:48.755147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5de30640-381b-470f-ac6d-53109559362b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:48.755583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5de30640-381b-470f-ac6d-53109559362b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:48.756280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5de30640-381b-470f-ac6d-53109559362b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:48.756732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5de30640-381b-470f-ac6d-53109559362b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:48.757155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5de30640-381b-470f-ac6d-53109559362b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:48.824785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5de30640-381b-470f-ac6d-53109559362b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:48.834058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5de30640-381b-470f-ac6d-53109559362b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091017 Aug 24 05:25:48.834640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1254/2617] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:49.370711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-236dbf6e-d531-4458-959e-52d690758896 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:49.371320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-236dbf6e-d531-4458-959e-52d690758896 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:49.377324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-236dbf6e-d531-4458-959e-52d690758896 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:49.377794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-236dbf6e-d531-4458-959e-52d690758896 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:49.378222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-236dbf6e-d531-4458-959e-52d690758896 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:49.379083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-236dbf6e-d531-4458-959e-52d690758896 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:49.379528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-236dbf6e-d531-4458-959e-52d690758896 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:49.379944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-236dbf6e-d531-4458-959e-52d690758896 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:49.446227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-236dbf6e-d531-4458-959e-52d690758896 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:49.456123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-236dbf6e-d531-4458-959e-52d690758896 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089279 Aug 24 05:25:49.457339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1364/2618] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:49.542561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f9ae93ee-6245-4ab1-bd29-08f344260333 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:49.543187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f9ae93ee-6245-4ab1-bd29-08f344260333 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:49.549732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9ae93ee-6245-4ab1-bd29-08f344260333 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:49.550268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9ae93ee-6245-4ab1-bd29-08f344260333 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:49.550816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9ae93ee-6245-4ab1-bd29-08f344260333 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:49.554261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9ae93ee-6245-4ab1-bd29-08f344260333 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:49.554261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9ae93ee-6245-4ab1-bd29-08f344260333 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:49.554261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9ae93ee-6245-4ab1-bd29-08f344260333 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:49.622255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f9ae93ee-6245-4ab1-bd29-08f344260333 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:49.631667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f9ae93ee-6245-4ab1-bd29-08f344260333 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092991 Aug 24 05:25:49.632249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1255/2619] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:49.854401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e213ef19-fbe4-4405-a4ba-21e806b0a678 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:49.855642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e213ef19-fbe4-4405-a4ba-21e806b0a678 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:49.861684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e213ef19-fbe4-4405-a4ba-21e806b0a678 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:49.862155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e213ef19-fbe4-4405-a4ba-21e806b0a678 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:49.863113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e213ef19-fbe4-4405-a4ba-21e806b0a678 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:49.863796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e213ef19-fbe4-4405-a4ba-21e806b0a678 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:49.864244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e213ef19-fbe4-4405-a4ba-21e806b0a678 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:49.864655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e213ef19-fbe4-4405-a4ba-21e806b0a678 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:49.928749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e213ef19-fbe4-4405-a4ba-21e806b0a678 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:49.938309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e213ef19-fbe4-4405-a4ba-21e806b0a678 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087803 Aug 24 05:25:49.938927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1365/2620] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:50.478650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-805f667a-0e43-43eb-8d45-478724a14e67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:50.479300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-805f667a-0e43-43eb-8d45-478724a14e67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:50.485454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-805f667a-0e43-43eb-8d45-478724a14e67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:50.485930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-805f667a-0e43-43eb-8d45-478724a14e67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:50.486354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-805f667a-0e43-43eb-8d45-478724a14e67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:50.487088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-805f667a-0e43-43eb-8d45-478724a14e67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:50.488088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-805f667a-0e43-43eb-8d45-478724a14e67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:50.488731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-805f667a-0e43-43eb-8d45-478724a14e67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:50.558752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-805f667a-0e43-43eb-8d45-478724a14e67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:50.567262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-805f667a-0e43-43eb-8d45-478724a14e67 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.092799 Aug 24 05:25:50.567845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1256/2621] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:50.652239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5dacbda7-9193-4917-8501-268230ac9630 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:50.652855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5dacbda7-9193-4917-8501-268230ac9630 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:50.659451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacbda7-9193-4917-8501-268230ac9630 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:50.659957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacbda7-9193-4917-8501-268230ac9630 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:50.660462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacbda7-9193-4917-8501-268230ac9630 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:50.661192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacbda7-9193-4917-8501-268230ac9630 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:50.661641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacbda7-9193-4917-8501-268230ac9630 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:50.662064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5dacbda7-9193-4917-8501-268230ac9630 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:50.729616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5dacbda7-9193-4917-8501-268230ac9630 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:50.731799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:50.740144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5dacbda7-9193-4917-8501-268230ac9630 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091808 Aug 24 05:25:50.740768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1366/2622] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:50.960365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3f065c93-f7f6-42d4-93c1-e50847269b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:50.961004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3f065c93-f7f6-42d4-93c1-e50847269b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:50.967183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f065c93-f7f6-42d4-93c1-e50847269b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:50.967660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f065c93-f7f6-42d4-93c1-e50847269b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:50.968089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f065c93-f7f6-42d4-93c1-e50847269b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:50.968802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f065c93-f7f6-42d4-93c1-e50847269b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:50.969247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f065c93-f7f6-42d4-93c1-e50847269b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:50.969664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3f065c93-f7f6-42d4-93c1-e50847269b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:51.036301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3f065c93-f7f6-42d4-93c1-e50847269b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:51.044524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3f065c93-f7f6-42d4-93c1-e50847269b39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088700 Aug 24 05:25:51.045077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1257/2623] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:51.588870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-72ca52ac-a56e-4ce2-9b02-2fd6cb837512 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:51.589505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-72ca52ac-a56e-4ce2-9b02-2fd6cb837512 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:51.591427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=82 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:51.597434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ca52ac-a56e-4ce2-9b02-2fd6cb837512 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:51.597944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ca52ac-a56e-4ce2-9b02-2fd6cb837512 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:51.598384 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ca52ac-a56e-4ce2-9b02-2fd6cb837512 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:51.599119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ca52ac-a56e-4ce2-9b02-2fd6cb837512 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:51.599576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ca52ac-a56e-4ce2-9b02-2fd6cb837512 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:51.600000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-72ca52ac-a56e-4ce2-9b02-2fd6cb837512 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:51.662899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-72ca52ac-a56e-4ce2-9b02-2fd6cb837512 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:51.671135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-72ca52ac-a56e-4ce2-9b02-2fd6cb837512 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086220 Aug 24 05:25:51.671736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1367/2624] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:51.760898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a8ae7cda-f28e-4296-9f16-a351fa53b9b7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:51.761485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a8ae7cda-f28e-4296-9f16-a351fa53b9b7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:51.768140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8ae7cda-f28e-4296-9f16-a351fa53b9b7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:51.768622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8ae7cda-f28e-4296-9f16-a351fa53b9b7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:51.769255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8ae7cda-f28e-4296-9f16-a351fa53b9b7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:51.770275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8ae7cda-f28e-4296-9f16-a351fa53b9b7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:51.770752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8ae7cda-f28e-4296-9f16-a351fa53b9b7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:51.771170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8ae7cda-f28e-4296-9f16-a351fa53b9b7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:51.843540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a8ae7cda-f28e-4296-9f16-a351fa53b9b7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:51.853053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a8ae7cda-f28e-4296-9f16-a351fa53b9b7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.095979 Aug 24 05:25:51.853631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1258/2625] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:52.066717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c5a91305-f536-439e-b61d-b535d1260ac2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:52.067467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c5a91305-f536-439e-b61d-b535d1260ac2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:52.073679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5a91305-f536-439e-b61d-b535d1260ac2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:52.074157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5a91305-f536-439e-b61d-b535d1260ac2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:52.074603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5a91305-f536-439e-b61d-b535d1260ac2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:52.075318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5a91305-f536-439e-b61d-b535d1260ac2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:52.075766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5a91305-f536-439e-b61d-b535d1260ac2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:52.076185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5a91305-f536-439e-b61d-b535d1260ac2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:52.140550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c5a91305-f536-439e-b61d-b535d1260ac2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:52.150121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c5a91305-f536-439e-b61d-b535d1260ac2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087970 Aug 24 05:25:52.150731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1368/2626] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:52.692522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a0b2b235-f6ec-43b6-a440-434b65e3bd27 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:52.693122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a0b2b235-f6ec-43b6-a440-434b65e3bd27 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:52.699301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0b2b235-f6ec-43b6-a440-434b65e3bd27 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:52.699777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0b2b235-f6ec-43b6-a440-434b65e3bd27 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:52.700200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0b2b235-f6ec-43b6-a440-434b65e3bd27 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:52.700879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0b2b235-f6ec-43b6-a440-434b65e3bd27 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:52.701318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0b2b235-f6ec-43b6-a440-434b65e3bd27 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:52.701730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0b2b235-f6ec-43b6-a440-434b65e3bd27 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:52.764940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a0b2b235-f6ec-43b6-a440-434b65e3bd27 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:52.774859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a0b2b235-f6ec-43b6-a440-434b65e3bd27 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086157 Aug 24 05:25:52.775438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1259/2627] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:52.873563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b533b3ef-e264-4f3d-8c15-b11ee18feee6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:52.874159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b533b3ef-e264-4f3d-8c15-b11ee18feee6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:52.880834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b533b3ef-e264-4f3d-8c15-b11ee18feee6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:52.881309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b533b3ef-e264-4f3d-8c15-b11ee18feee6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:52.881735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b533b3ef-e264-4f3d-8c15-b11ee18feee6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:52.882419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b533b3ef-e264-4f3d-8c15-b11ee18feee6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:52.882900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b533b3ef-e264-4f3d-8c15-b11ee18feee6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:52.883321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b533b3ef-e264-4f3d-8c15-b11ee18feee6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:52.948077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b533b3ef-e264-4f3d-8c15-b11ee18feee6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:52.956804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b533b3ef-e264-4f3d-8c15-b11ee18feee6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087147 Aug 24 05:25:52.957400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1369/2628] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:53.170950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f7456cdd-3bf1-4210-bb54-fe46bf11c998 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:53.171561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f7456cdd-3bf1-4210-bb54-fe46bf11c998 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:53.178000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7456cdd-3bf1-4210-bb54-fe46bf11c998 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:53.178485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7456cdd-3bf1-4210-bb54-fe46bf11c998 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:53.178953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7456cdd-3bf1-4210-bb54-fe46bf11c998 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:53.179650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7456cdd-3bf1-4210-bb54-fe46bf11c998 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:53.180106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7456cdd-3bf1-4210-bb54-fe46bf11c998 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:53.180526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7456cdd-3bf1-4210-bb54-fe46bf11c998 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:53.244622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f7456cdd-3bf1-4210-bb54-fe46bf11c998 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:53.253689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f7456cdd-3bf1-4210-bb54-fe46bf11c998 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086049 Aug 24 05:25:53.254267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1260/2629] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:53.796527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f7ffb6b8-82a8-493a-bf2a-7147d6ecb776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:53.797129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f7ffb6b8-82a8-493a-bf2a-7147d6ecb776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:53.804634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7ffb6b8-82a8-493a-bf2a-7147d6ecb776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:53.805391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7ffb6b8-82a8-493a-bf2a-7147d6ecb776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:53.806438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7ffb6b8-82a8-493a-bf2a-7147d6ecb776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:53.807704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7ffb6b8-82a8-493a-bf2a-7147d6ecb776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:53.808432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7ffb6b8-82a8-493a-bf2a-7147d6ecb776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:53.809127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f7ffb6b8-82a8-493a-bf2a-7147d6ecb776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:53.877598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f7ffb6b8-82a8-493a-bf2a-7147d6ecb776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:53.888661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f7ffb6b8-82a8-493a-bf2a-7147d6ecb776 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.095922 Aug 24 05:25:53.889246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1370/2630] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:53.978489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-aba381a6-4d6b-4b85-812e-a0c2f6687d54 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:53.979152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-aba381a6-4d6b-4b85-812e-a0c2f6687d54 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:53.985838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aba381a6-4d6b-4b85-812e-a0c2f6687d54 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:53.986256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aba381a6-4d6b-4b85-812e-a0c2f6687d54 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:53.986667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aba381a6-4d6b-4b85-812e-a0c2f6687d54 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:53.987377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aba381a6-4d6b-4b85-812e-a0c2f6687d54 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:53.988551 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aba381a6-4d6b-4b85-812e-a0c2f6687d54 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:53.989081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aba381a6-4d6b-4b85-812e-a0c2f6687d54 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:54.052872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-aba381a6-4d6b-4b85-812e-a0c2f6687d54 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:54.062741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-aba381a6-4d6b-4b85-812e-a0c2f6687d54 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088031 Aug 24 05:25:54.063349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1261/2631] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:54.275424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-38a6325b-2337-411f-bf93-8dd1a9d65ed4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:54.275944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-38a6325b-2337-411f-bf93-8dd1a9d65ed4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:54.281963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38a6325b-2337-411f-bf93-8dd1a9d65ed4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:54.282455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38a6325b-2337-411f-bf93-8dd1a9d65ed4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:54.282895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38a6325b-2337-411f-bf93-8dd1a9d65ed4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:54.283577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38a6325b-2337-411f-bf93-8dd1a9d65ed4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:54.284019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38a6325b-2337-411f-bf93-8dd1a9d65ed4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:54.284431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38a6325b-2337-411f-bf93-8dd1a9d65ed4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:54.353769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-38a6325b-2337-411f-bf93-8dd1a9d65ed4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:54.363215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-38a6325b-2337-411f-bf93-8dd1a9d65ed4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092364 Aug 24 05:25:54.363801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1371/2632] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:54.909720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a6b919c4-a460-4797-899b-1a638116886a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:54.910334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a6b919c4-a460-4797-899b-1a638116886a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:54.916653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6b919c4-a460-4797-899b-1a638116886a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:54.917133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6b919c4-a460-4797-899b-1a638116886a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:54.917566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6b919c4-a460-4797-899b-1a638116886a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:54.918279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6b919c4-a460-4797-899b-1a638116886a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:54.918743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6b919c4-a460-4797-899b-1a638116886a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:54.919170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a6b919c4-a460-4797-899b-1a638116886a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:54.986529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a6b919c4-a460-4797-899b-1a638116886a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:54.995992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a6b919c4-a460-4797-899b-1a638116886a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090015 Aug 24 05:25:54.997019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1262/2633] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:55.084038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6fa037aa-80e9-46ba-9bf4-80ae53340e37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:55.084956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6fa037aa-80e9-46ba-9bf4-80ae53340e37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:55.091714 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fa037aa-80e9-46ba-9bf4-80ae53340e37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:55.092196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fa037aa-80e9-46ba-9bf4-80ae53340e37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:55.092628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fa037aa-80e9-46ba-9bf4-80ae53340e37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:55.093326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fa037aa-80e9-46ba-9bf4-80ae53340e37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:55.093771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fa037aa-80e9-46ba-9bf4-80ae53340e37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:55.094190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6fa037aa-80e9-46ba-9bf4-80ae53340e37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:55.164164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6fa037aa-80e9-46ba-9bf4-80ae53340e37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:55.172680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6fa037aa-80e9-46ba-9bf4-80ae53340e37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093041 Aug 24 05:25:55.173263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1372/2634] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:55 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:55.386421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f243e55c-67c4-469d-897a-dadc27c33cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:55.386983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f243e55c-67c4-469d-897a-dadc27c33cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:55.393183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f243e55c-67c4-469d-897a-dadc27c33cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:55.393672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f243e55c-67c4-469d-897a-dadc27c33cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:55.394102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f243e55c-67c4-469d-897a-dadc27c33cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:55.394823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f243e55c-67c4-469d-897a-dadc27c33cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:55.395275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f243e55c-67c4-469d-897a-dadc27c33cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:55.395690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f243e55c-67c4-469d-897a-dadc27c33cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:55.460748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f243e55c-67c4-469d-897a-dadc27c33cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:55.469095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f243e55c-67c4-469d-897a-dadc27c33cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087205 Aug 24 05:25:55.469673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1263/2635] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:56.019254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9fd19ccf-e02e-43ae-903d-f8c0ae4dbc4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:56.019893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9fd19ccf-e02e-43ae-903d-f8c0ae4dbc4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:56.026679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fd19ccf-e02e-43ae-903d-f8c0ae4dbc4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:56.027194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fd19ccf-e02e-43ae-903d-f8c0ae4dbc4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:56.027629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fd19ccf-e02e-43ae-903d-f8c0ae4dbc4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:56.028322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fd19ccf-e02e-43ae-903d-f8c0ae4dbc4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:56.028768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fd19ccf-e02e-43ae-903d-f8c0ae4dbc4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:56.029188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fd19ccf-e02e-43ae-903d-f8c0ae4dbc4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:56.101109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9fd19ccf-e02e-43ae-903d-f8c0ae4dbc4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:56.110112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9fd19ccf-e02e-43ae-903d-f8c0ae4dbc4e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.095335 Aug 24 05:25:56.110704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1373/2636] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:56.195035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-734c5071-1e81-4079-885d-7365f509c77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:56.195649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-734c5071-1e81-4079-885d-7365f509c77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:56.202133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-734c5071-1e81-4079-885d-7365f509c77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:56.202608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-734c5071-1e81-4079-885d-7365f509c77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:56.203074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-734c5071-1e81-4079-885d-7365f509c77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:56.203747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-734c5071-1e81-4079-885d-7365f509c77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:56.204223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-734c5071-1e81-4079-885d-7365f509c77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:56.204638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-734c5071-1e81-4079-885d-7365f509c77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:56.268587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-734c5071-1e81-4079-885d-7365f509c77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:56.277713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-734c5071-1e81-4079-885d-7365f509c77b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086841 Aug 24 05:25:56.278294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1264/2637] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:56.489684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8eab61b6-ba20-41ea-9f34-3fb7b107712c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:56.490573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8eab61b6-ba20-41ea-9f34-3fb7b107712c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:56.496957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eab61b6-ba20-41ea-9f34-3fb7b107712c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:56.497429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eab61b6-ba20-41ea-9f34-3fb7b107712c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:56.497853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eab61b6-ba20-41ea-9f34-3fb7b107712c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:56.498530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eab61b6-ba20-41ea-9f34-3fb7b107712c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:56.499002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eab61b6-ba20-41ea-9f34-3fb7b107712c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:56.499413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8eab61b6-ba20-41ea-9f34-3fb7b107712c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:56.566292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8eab61b6-ba20-41ea-9f34-3fb7b107712c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:56.574589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8eab61b6-ba20-41ea-9f34-3fb7b107712c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088765 Aug 24 05:25:56.575193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1374/2638] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:25:57.131955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8afd3e2-0c2c-4d4d-b121-865c93d84a70 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:57.132551 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c8afd3e2-0c2c-4d4d-b121-865c93d84a70 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:57.138674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8afd3e2-0c2c-4d4d-b121-865c93d84a70 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:57.139163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8afd3e2-0c2c-4d4d-b121-865c93d84a70 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:57.139591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8afd3e2-0c2c-4d4d-b121-865c93d84a70 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:57.140274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8afd3e2-0c2c-4d4d-b121-865c93d84a70 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:57.140720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8afd3e2-0c2c-4d4d-b121-865c93d84a70 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:57.141133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8afd3e2-0c2c-4d4d-b121-865c93d84a70 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:57.143855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:25:57.209448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c8afd3e2-0c2c-4d4d-b121-865c93d84a70 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:57.218235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c8afd3e2-0c2c-4d4d-b121-865c93d84a70 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090163 Aug 24 05:25:57.218932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1265/2639] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:57.299810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9c628a30-cd2b-42ba-8501-e7cd0b69e32c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:57.300410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9c628a30-cd2b-42ba-8501-e7cd0b69e32c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:57.307481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c628a30-cd2b-42ba-8501-e7cd0b69e32c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:57.307963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c628a30-cd2b-42ba-8501-e7cd0b69e32c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:57.308399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c628a30-cd2b-42ba-8501-e7cd0b69e32c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:57.309099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c628a30-cd2b-42ba-8501-e7cd0b69e32c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:57.309554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c628a30-cd2b-42ba-8501-e7cd0b69e32c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:57.309975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c628a30-cd2b-42ba-8501-e7cd0b69e32c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:57.374871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9c628a30-cd2b-42ba-8501-e7cd0b69e32c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:57.384593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9c628a30-cd2b-42ba-8501-e7cd0b69e32c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088463 Aug 24 05:25:57.385094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1375/2640] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:57.596120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-03ef6ba8-4c2a-46a7-949e-58ca812cbee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:57.596742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-03ef6ba8-4c2a-46a7-949e-58ca812cbee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:57.603538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03ef6ba8-4c2a-46a7-949e-58ca812cbee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:57.604021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03ef6ba8-4c2a-46a7-949e-58ca812cbee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:57.604479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03ef6ba8-4c2a-46a7-949e-58ca812cbee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:57.605153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03ef6ba8-4c2a-46a7-949e-58ca812cbee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:57.605606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03ef6ba8-4c2a-46a7-949e-58ca812cbee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:57.606031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03ef6ba8-4c2a-46a7-949e-58ca812cbee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:57.671381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-03ef6ba8-4c2a-46a7-949e-58ca812cbee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:57.680583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-03ef6ba8-4c2a-46a7-949e-58ca812cbee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088349 Aug 24 05:25:57.681419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1266/2641] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:58.240014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-930692a0-2f9d-4e86-ae4e-cf479261a247 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:58.240724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-930692a0-2f9d-4e86-ae4e-cf479261a247 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:58.247841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930692a0-2f9d-4e86-ae4e-cf479261a247 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:58.248319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930692a0-2f9d-4e86-ae4e-cf479261a247 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:58.248755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930692a0-2f9d-4e86-ae4e-cf479261a247 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:58.249447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930692a0-2f9d-4e86-ae4e-cf479261a247 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:58.249900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930692a0-2f9d-4e86-ae4e-cf479261a247 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:58.250320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-930692a0-2f9d-4e86-ae4e-cf479261a247 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:58.313399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-930692a0-2f9d-4e86-ae4e-cf479261a247 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:58.324836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-930692a0-2f9d-4e86-ae4e-cf479261a247 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088487 Aug 24 05:25:58.325432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1376/2642] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:58.405569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-18bafc2c-873d-480b-82aa-1f447f1c6fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:58.406162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-18bafc2c-873d-480b-82aa-1f447f1c6fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:58.413040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bafc2c-873d-480b-82aa-1f447f1c6fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:58.413529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bafc2c-873d-480b-82aa-1f447f1c6fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:58.413970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bafc2c-873d-480b-82aa-1f447f1c6fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:58.414671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bafc2c-873d-480b-82aa-1f447f1c6fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:58.415148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bafc2c-873d-480b-82aa-1f447f1c6fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:58.415574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bafc2c-873d-480b-82aa-1f447f1c6fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:58.480273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-18bafc2c-873d-480b-82aa-1f447f1c6fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:58.488647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-18bafc2c-873d-480b-82aa-1f447f1c6fd0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087068 Aug 24 05:25:58.489221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1267/2643] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:58.702609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7d6352fb-f5ad-45e3-b8ff-36510752eacc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:58.703654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7d6352fb-f5ad-45e3-b8ff-36510752eacc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:58.713339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d6352fb-f5ad-45e3-b8ff-36510752eacc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:58.713860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d6352fb-f5ad-45e3-b8ff-36510752eacc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:58.714294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d6352fb-f5ad-45e3-b8ff-36510752eacc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:58.715042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d6352fb-f5ad-45e3-b8ff-36510752eacc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:58.715496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d6352fb-f5ad-45e3-b8ff-36510752eacc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:58.715918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d6352fb-f5ad-45e3-b8ff-36510752eacc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:58.781805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7d6352fb-f5ad-45e3-b8ff-36510752eacc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:58.790431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7d6352fb-f5ad-45e3-b8ff-36510752eacc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092647 Aug 24 05:25:58.791058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1377/2644] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:59.348750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b0c110ca-96f6-4e34-9fbb-2e601974f9e5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:59.349272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b0c110ca-96f6-4e34-9fbb-2e601974f9e5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:59.355999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0c110ca-96f6-4e34-9fbb-2e601974f9e5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:59.356481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0c110ca-96f6-4e34-9fbb-2e601974f9e5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:59.356915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0c110ca-96f6-4e34-9fbb-2e601974f9e5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:59.357602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0c110ca-96f6-4e34-9fbb-2e601974f9e5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:59.358052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0c110ca-96f6-4e34-9fbb-2e601974f9e5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:59.358471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b0c110ca-96f6-4e34-9fbb-2e601974f9e5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:59.422213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b0c110ca-96f6-4e34-9fbb-2e601974f9e5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:59.431423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b0c110ca-96f6-4e34-9fbb-2e601974f9e5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086278 Aug 24 05:25:59.431993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1268/2645] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:59.510914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e0eafbf4-1d89-4d15-9612-80b9db76770c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:59.511516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e0eafbf4-1d89-4d15-9612-80b9db76770c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:59.518273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0eafbf4-1d89-4d15-9612-80b9db76770c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:59.518853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0eafbf4-1d89-4d15-9612-80b9db76770c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:59.519219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0eafbf4-1d89-4d15-9612-80b9db76770c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:59.519914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0eafbf4-1d89-4d15-9612-80b9db76770c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:59.520363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0eafbf4-1d89-4d15-9612-80b9db76770c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:59.520817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0eafbf4-1d89-4d15-9612-80b9db76770c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:59.588610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e0eafbf4-1d89-4d15-9612-80b9db76770c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:59.597144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e0eafbf4-1d89-4d15-9612-80b9db76770c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090040 Aug 24 05:25:59.597692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1378/2646] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:59 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:25:59.812562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e6fc0a02-c34e-4d32-ac47-91c5e2f44d4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:25:59.813166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e6fc0a02-c34e-4d32-ac47-91c5e2f44d4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:25:59.819704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6fc0a02-c34e-4d32-ac47-91c5e2f44d4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:59.820180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6fc0a02-c34e-4d32-ac47-91c5e2f44d4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:59.820606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6fc0a02-c34e-4d32-ac47-91c5e2f44d4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:59.821282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6fc0a02-c34e-4d32-ac47-91c5e2f44d4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:25:59.821723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6fc0a02-c34e-4d32-ac47-91c5e2f44d4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:25:59.822134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e6fc0a02-c34e-4d32-ac47-91c5e2f44d4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:25:59.884795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e6fc0a02-c34e-4d32-ac47-91c5e2f44d4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:25:59.893195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e6fc0a02-c34e-4d32-ac47-91c5e2f44d4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084460 Aug 24 05:25:59.893758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1269/2647] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:25:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:00.453123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-47dc5850-4eef-4477-a99f-a446510ff540 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:00.453734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-47dc5850-4eef-4477-a99f-a446510ff540 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:00.460991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47dc5850-4eef-4477-a99f-a446510ff540 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:00.461480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47dc5850-4eef-4477-a99f-a446510ff540 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:00.461921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47dc5850-4eef-4477-a99f-a446510ff540 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:00.462625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47dc5850-4eef-4477-a99f-a446510ff540 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:00.463147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47dc5850-4eef-4477-a99f-a446510ff540 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:00.463563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-47dc5850-4eef-4477-a99f-a446510ff540 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:00.532775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-47dc5850-4eef-4477-a99f-a446510ff540 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:00.542553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-47dc5850-4eef-4477-a99f-a446510ff540 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093414 Aug 24 05:26:00.543186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1379/2648] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:00.618923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2ba86fd9-233e-49f7-a2e1-a84648e7820e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:00.619523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2ba86fd9-233e-49f7-a2e1-a84648e7820e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:00.626278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba86fd9-233e-49f7-a2e1-a84648e7820e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:00.626797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba86fd9-233e-49f7-a2e1-a84648e7820e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:00.627230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba86fd9-233e-49f7-a2e1-a84648e7820e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:00.627928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba86fd9-233e-49f7-a2e1-a84648e7820e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:00.628373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba86fd9-233e-49f7-a2e1-a84648e7820e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:00.628799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2ba86fd9-233e-49f7-a2e1-a84648e7820e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:00.629866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:26:00.630084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:26:00.699976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2ba86fd9-233e-49f7-a2e1-a84648e7820e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:00.711693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2ba86fd9-233e-49f7-a2e1-a84648e7820e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.097035 Aug 24 05:26:00.712270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1270/2649] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:00.914725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4d3a272d-1162-4ab1-9fc7-f6f8c64fb883 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:00.915235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4d3a272d-1162-4ab1-9fc7-f6f8c64fb883 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:00.921424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d3a272d-1162-4ab1-9fc7-f6f8c64fb883 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:00.921901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d3a272d-1162-4ab1-9fc7-f6f8c64fb883 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:00.922331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d3a272d-1162-4ab1-9fc7-f6f8c64fb883 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:00.923060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d3a272d-1162-4ab1-9fc7-f6f8c64fb883 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:00.923503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d3a272d-1162-4ab1-9fc7-f6f8c64fb883 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:00.923923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d3a272d-1162-4ab1-9fc7-f6f8c64fb883 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:00.989329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4d3a272d-1162-4ab1-9fc7-f6f8c64fb883 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:00.998629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4d3a272d-1162-4ab1-9fc7-f6f8c64fb883 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088369 Aug 24 05:26:00.999238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1380/2650] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:01.197460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:26:01.197694 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:26:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:26:01.564400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a7117263-8030-4a91-bad1-43f1855a18a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:01.565040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a7117263-8030-4a91-bad1-43f1855a18a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:01.571316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7117263-8030-4a91-bad1-43f1855a18a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:01.571894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7117263-8030-4a91-bad1-43f1855a18a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:01.572331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7117263-8030-4a91-bad1-43f1855a18a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:01.573017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7117263-8030-4a91-bad1-43f1855a18a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:01.573470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7117263-8030-4a91-bad1-43f1855a18a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:01.573957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a7117263-8030-4a91-bad1-43f1855a18a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:01.639270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a7117263-8030-4a91-bad1-43f1855a18a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:01.647703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a7117263-8030-4a91-bad1-43f1855a18a5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087200 Aug 24 05:26:01.648265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1271/2651] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:01.732326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-154b2947-246c-4395-a779-ca322de1520c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:01.733055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-154b2947-246c-4395-a779-ca322de1520c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:01.739802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-154b2947-246c-4395-a779-ca322de1520c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:01.740907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-154b2947-246c-4395-a779-ca322de1520c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:01.741335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-154b2947-246c-4395-a779-ca322de1520c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:01.742029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-154b2947-246c-4395-a779-ca322de1520c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:01.742474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-154b2947-246c-4395-a779-ca322de1520c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:01.742925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-154b2947-246c-4395-a779-ca322de1520c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:01.811228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-154b2947-246c-4395-a779-ca322de1520c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:01.820547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-154b2947-246c-4395-a779-ca322de1520c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092161 Aug 24 05:26:01.821041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1381/2652] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:02.028497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4b95719d-c67a-419e-8b90-8aa7fec48fb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:02.029109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4b95719d-c67a-419e-8b90-8aa7fec48fb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:02.035173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b95719d-c67a-419e-8b90-8aa7fec48fb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:02.035657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b95719d-c67a-419e-8b90-8aa7fec48fb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:02.036095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b95719d-c67a-419e-8b90-8aa7fec48fb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:02.037310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b95719d-c67a-419e-8b90-8aa7fec48fb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:02.037781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b95719d-c67a-419e-8b90-8aa7fec48fb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:02.038206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b95719d-c67a-419e-8b90-8aa7fec48fb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:02.101251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4b95719d-c67a-419e-8b90-8aa7fec48fb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:02.109516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4b95719d-c67a-419e-8b90-8aa7fec48fb6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085064 Aug 24 05:26:02.110079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1272/2653] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:02.668654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f5b44920-a1ab-4032-8439-a143a2c11b30 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:02.669268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f5b44920-a1ab-4032-8439-a143a2c11b30 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:02.675427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b44920-a1ab-4032-8439-a143a2c11b30 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:02.675909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b44920-a1ab-4032-8439-a143a2c11b30 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:02.676338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b44920-a1ab-4032-8439-a143a2c11b30 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:02.677029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b44920-a1ab-4032-8439-a143a2c11b30 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:02.677546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b44920-a1ab-4032-8439-a143a2c11b30 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:02.678168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f5b44920-a1ab-4032-8439-a143a2c11b30 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:02.744197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f5b44920-a1ab-4032-8439-a143a2c11b30 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:02.753099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f5b44920-a1ab-4032-8439-a143a2c11b30 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088264 Aug 24 05:26:02.753685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1382/2654] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:02.841648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e2a6d677-3d04-4980-aaf9-92e89507b6eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:02.842266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e2a6d677-3d04-4980-aaf9-92e89507b6eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:02.848804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2a6d677-3d04-4980-aaf9-92e89507b6eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:02.849606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2a6d677-3d04-4980-aaf9-92e89507b6eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:02.850203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2a6d677-3d04-4980-aaf9-92e89507b6eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:02.850993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2a6d677-3d04-4980-aaf9-92e89507b6eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:02.851446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2a6d677-3d04-4980-aaf9-92e89507b6eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:02.851866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2a6d677-3d04-4980-aaf9-92e89507b6eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:02.917739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e2a6d677-3d04-4980-aaf9-92e89507b6eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:02.926171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e2a6d677-3d04-4980-aaf9-92e89507b6eb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088325 Aug 24 05:26:02.926760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1273/2655] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:03.135021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-52ce6a8e-fd3c-411c-a82c-34c7b47a5951 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:03.135924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-52ce6a8e-fd3c-411c-a82c-34c7b47a5951 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:03.144876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52ce6a8e-fd3c-411c-a82c-34c7b47a5951 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:03.145619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52ce6a8e-fd3c-411c-a82c-34c7b47a5951 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:03.146317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52ce6a8e-fd3c-411c-a82c-34c7b47a5951 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:03.147574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52ce6a8e-fd3c-411c-a82c-34c7b47a5951 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:03.148290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52ce6a8e-fd3c-411c-a82c-34c7b47a5951 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:03.148952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52ce6a8e-fd3c-411c-a82c-34c7b47a5951 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:03.166371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:03.215091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-52ce6a8e-fd3c-411c-a82c-34c7b47a5951 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:03.223362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-52ce6a8e-fd3c-411c-a82c-34c7b47a5951 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095316 Aug 24 05:26:03.223929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1383/2656] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:03.664178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:26:03.664405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:26:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:26:03.775039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a294f7af-71f4-4158-a04c-7cfd33acba5f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:03.775654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a294f7af-71f4-4158-a04c-7cfd33acba5f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:03.781728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a294f7af-71f4-4158-a04c-7cfd33acba5f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:03.782203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a294f7af-71f4-4158-a04c-7cfd33acba5f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:03.782634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a294f7af-71f4-4158-a04c-7cfd33acba5f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:03.783347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a294f7af-71f4-4158-a04c-7cfd33acba5f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:03.783791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a294f7af-71f4-4158-a04c-7cfd33acba5f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:03.784199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a294f7af-71f4-4158-a04c-7cfd33acba5f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:03.850315 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a294f7af-71f4-4158-a04c-7cfd33acba5f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:03.859018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a294f7af-71f4-4158-a04c-7cfd33acba5f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088715 Aug 24 05:26:03.859593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1274/2657] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:03 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:03.948357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-be523400-c300-4df3-9b03-218d944d1733 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:03.948927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-be523400-c300-4df3-9b03-218d944d1733 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:03.955444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be523400-c300-4df3-9b03-218d944d1733 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:03.955932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be523400-c300-4df3-9b03-218d944d1733 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:03.956361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be523400-c300-4df3-9b03-218d944d1733 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:03.957050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be523400-c300-4df3-9b03-218d944d1733 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:03.957502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be523400-c300-4df3-9b03-218d944d1733 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:03.957919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be523400-c300-4df3-9b03-218d944d1733 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:04.023017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-be523400-c300-4df3-9b03-218d944d1733 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:04.031529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-be523400-c300-4df3-9b03-218d944d1733 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087223 Aug 24 05:26:04.032105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1384/2658] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:03 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:04.244720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-80adaf27-73eb-4dbe-97d5-e220a547f8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:04.245333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-80adaf27-73eb-4dbe-97d5-e220a547f8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:04.251485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80adaf27-73eb-4dbe-97d5-e220a547f8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:04.251963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80adaf27-73eb-4dbe-97d5-e220a547f8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:04.252392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80adaf27-73eb-4dbe-97d5-e220a547f8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:04.253080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80adaf27-73eb-4dbe-97d5-e220a547f8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:04.253526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80adaf27-73eb-4dbe-97d5-e220a547f8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:04.253944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80adaf27-73eb-4dbe-97d5-e220a547f8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:04.319446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-80adaf27-73eb-4dbe-97d5-e220a547f8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:04.328179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-80adaf27-73eb-4dbe-97d5-e220a547f8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087983 Aug 24 05:26:04.328774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1275/2659] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:04.880406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-66aa101b-fc21-4352-b145-0ba4824d5da7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:04.881792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-66aa101b-fc21-4352-b145-0ba4824d5da7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:04.887900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66aa101b-fc21-4352-b145-0ba4824d5da7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:04.888377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66aa101b-fc21-4352-b145-0ba4824d5da7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:04.888812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66aa101b-fc21-4352-b145-0ba4824d5da7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:04.889490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66aa101b-fc21-4352-b145-0ba4824d5da7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:04.889944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66aa101b-fc21-4352-b145-0ba4824d5da7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:04.890361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66aa101b-fc21-4352-b145-0ba4824d5da7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:04.953846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-66aa101b-fc21-4352-b145-0ba4824d5da7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:04.964265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-66aa101b-fc21-4352-b145-0ba4824d5da7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087659 Aug 24 05:26:04.964867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1385/2660] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:05.053288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4d15d8c7-b5c7-4ee5-b38d-4f908398fbf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:05.054217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4d15d8c7-b5c7-4ee5-b38d-4f908398fbf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:05.061306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d15d8c7-b5c7-4ee5-b38d-4f908398fbf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:05.061779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d15d8c7-b5c7-4ee5-b38d-4f908398fbf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:05.062207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d15d8c7-b5c7-4ee5-b38d-4f908398fbf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:05.062911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d15d8c7-b5c7-4ee5-b38d-4f908398fbf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:05.063423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d15d8c7-b5c7-4ee5-b38d-4f908398fbf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:05.063841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d15d8c7-b5c7-4ee5-b38d-4f908398fbf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:05.129018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4d15d8c7-b5c7-4ee5-b38d-4f908398fbf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:05.138505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4d15d8c7-b5c7-4ee5-b38d-4f908398fbf4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089839 Aug 24 05:26:05.139111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1276/2661] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:05.350575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d5a4ea70-ab04-48cf-9b62-48a6c536c960 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:05.351130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d5a4ea70-ab04-48cf-9b62-48a6c536c960 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:05.358220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea70-ab04-48cf-9b62-48a6c536c960 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:05.358761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea70-ab04-48cf-9b62-48a6c536c960 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:05.359194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea70-ab04-48cf-9b62-48a6c536c960 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:05.360180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea70-ab04-48cf-9b62-48a6c536c960 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:05.360755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea70-ab04-48cf-9b62-48a6c536c960 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:05.361207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5a4ea70-ab04-48cf-9b62-48a6c536c960 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:05.429661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d5a4ea70-ab04-48cf-9b62-48a6c536c960 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:05.438342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d5a4ea70-ab04-48cf-9b62-48a6c536c960 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092570 Aug 24 05:26:05.438938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1386/2662] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:05.986706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8b291d9c-cdcf-4132-9838-3c5f931d3b45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:05.987303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8b291d9c-cdcf-4132-9838-3c5f931d3b45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:05.994230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b291d9c-cdcf-4132-9838-3c5f931d3b45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:05.994730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b291d9c-cdcf-4132-9838-3c5f931d3b45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:05.995162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b291d9c-cdcf-4132-9838-3c5f931d3b45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:05.995840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b291d9c-cdcf-4132-9838-3c5f931d3b45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:05.996279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b291d9c-cdcf-4132-9838-3c5f931d3b45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:05.996691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b291d9c-cdcf-4132-9838-3c5f931d3b45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:06.059895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8b291d9c-cdcf-4132-9838-3c5f931d3b45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:06.069312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8b291d9c-cdcf-4132-9838-3c5f931d3b45 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086344 Aug 24 05:26:06.069890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1277/2663] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:06.160099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-26a44fb0-010a-4775-86da-44411f183240 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:06.160735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-26a44fb0-010a-4775-86da-44411f183240 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:06.168008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26a44fb0-010a-4775-86da-44411f183240 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:06.168561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26a44fb0-010a-4775-86da-44411f183240 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:06.168999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26a44fb0-010a-4775-86da-44411f183240 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:06.169739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26a44fb0-010a-4775-86da-44411f183240 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:06.170177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26a44fb0-010a-4775-86da-44411f183240 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:06.170601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-26a44fb0-010a-4775-86da-44411f183240 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:06.235729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-26a44fb0-010a-4775-86da-44411f183240 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:06.247792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-26a44fb0-010a-4775-86da-44411f183240 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091315 Aug 24 05:26:06.248344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1387/2664] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:06.464593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-48f3a7f7-05c8-4eaa-ba37-8f3148c7fc1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:06.465221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-48f3a7f7-05c8-4eaa-ba37-8f3148c7fc1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:06.471542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48f3a7f7-05c8-4eaa-ba37-8f3148c7fc1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:06.472031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48f3a7f7-05c8-4eaa-ba37-8f3148c7fc1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:06.472574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48f3a7f7-05c8-4eaa-ba37-8f3148c7fc1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:06.473271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48f3a7f7-05c8-4eaa-ba37-8f3148c7fc1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:06.473724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48f3a7f7-05c8-4eaa-ba37-8f3148c7fc1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:06.474146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48f3a7f7-05c8-4eaa-ba37-8f3148c7fc1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:06.545493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-48f3a7f7-05c8-4eaa-ba37-8f3148c7fc1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:06.555759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-48f3a7f7-05c8-4eaa-ba37-8f3148c7fc1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095046 Aug 24 05:26:06.556589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1278/2665] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:07.092664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-baacf9da-a24f-4769-bc3f-ada871d5ab0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:07.093265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-baacf9da-a24f-4769-bc3f-ada871d5ab0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:07.099901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-baacf9da-a24f-4769-bc3f-ada871d5ab0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:07.100417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-baacf9da-a24f-4769-bc3f-ada871d5ab0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:07.100939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-baacf9da-a24f-4769-bc3f-ada871d5ab0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:07.101607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-baacf9da-a24f-4769-bc3f-ada871d5ab0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:07.102049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-baacf9da-a24f-4769-bc3f-ada871d5ab0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:07.102462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-baacf9da-a24f-4769-bc3f-ada871d5ab0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:07.163388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-baacf9da-a24f-4769-bc3f-ada871d5ab0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:07.172083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-baacf9da-a24f-4769-bc3f-ada871d5ab0e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.083253 Aug 24 05:26:07.172650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1388/2666] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:07.269378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-016c0e7e-9d73-486c-9202-72993fe036d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:07.269979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-016c0e7e-9d73-486c-9202-72993fe036d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:07.276780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016c0e7e-9d73-486c-9202-72993fe036d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:07.277259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016c0e7e-9d73-486c-9202-72993fe036d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:07.277685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016c0e7e-9d73-486c-9202-72993fe036d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:07.278368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016c0e7e-9d73-486c-9202-72993fe036d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:07.278840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016c0e7e-9d73-486c-9202-72993fe036d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:07.279252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016c0e7e-9d73-486c-9202-72993fe036d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:07.342184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-016c0e7e-9d73-486c-9202-72993fe036d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:07.351198 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-016c0e7e-9d73-486c-9202-72993fe036d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085711 Aug 24 05:26:07.351708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1279/2667] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:07.579471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e7bd736f-31cb-434f-84ed-6a8476f50ee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:07.580140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e7bd736f-31cb-434f-84ed-6a8476f50ee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:07.586802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7bd736f-31cb-434f-84ed-6a8476f50ee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:07.587286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7bd736f-31cb-434f-84ed-6a8476f50ee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:07.587717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7bd736f-31cb-434f-84ed-6a8476f50ee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:07.588403 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7bd736f-31cb-434f-84ed-6a8476f50ee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:07.588846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7bd736f-31cb-434f-84ed-6a8476f50ee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:07.589261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7bd736f-31cb-434f-84ed-6a8476f50ee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:07.652569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e7bd736f-31cb-434f-84ed-6a8476f50ee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:07.660949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e7bd736f-31cb-434f-84ed-6a8476f50ee6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085350 Aug 24 05:26:07.661522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1389/2668] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:08.192501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2f26da6c-909b-4215-8282-01d1967ae1f4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:08.193116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2f26da6c-909b-4215-8282-01d1967ae1f4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:08.199348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f26da6c-909b-4215-8282-01d1967ae1f4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:08.199834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f26da6c-909b-4215-8282-01d1967ae1f4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:08.200270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f26da6c-909b-4215-8282-01d1967ae1f4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:08.200958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f26da6c-909b-4215-8282-01d1967ae1f4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:08.201413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f26da6c-909b-4215-8282-01d1967ae1f4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:08.201836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f26da6c-909b-4215-8282-01d1967ae1f4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:08.264030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2f26da6c-909b-4215-8282-01d1967ae1f4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:08.273398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2f26da6c-909b-4215-8282-01d1967ae1f4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084743 Aug 24 05:26:08.274027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1280/2669] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:08.371653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ba0e6962-cb02-4684-8e21-4ed8d4b82401 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:08.372288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ba0e6962-cb02-4684-8e21-4ed8d4b82401 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:08.378964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba0e6962-cb02-4684-8e21-4ed8d4b82401 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:08.379452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba0e6962-cb02-4684-8e21-4ed8d4b82401 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:08.379887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba0e6962-cb02-4684-8e21-4ed8d4b82401 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:08.380577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba0e6962-cb02-4684-8e21-4ed8d4b82401 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:08.381021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba0e6962-cb02-4684-8e21-4ed8d4b82401 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:08.381440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba0e6962-cb02-4684-8e21-4ed8d4b82401 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:08.449449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ba0e6962-cb02-4684-8e21-4ed8d4b82401 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:08.458042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ba0e6962-cb02-4684-8e21-4ed8d4b82401 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090175 Aug 24 05:26:08.459241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1390/2670] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:08.681872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-049f59d2-1613-48f2-a485-bc9846870d5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:08.682480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-049f59d2-1613-48f2-a485-bc9846870d5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:08.688753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-049f59d2-1613-48f2-a485-bc9846870d5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:08.689243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-049f59d2-1613-48f2-a485-bc9846870d5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:08.689679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-049f59d2-1613-48f2-a485-bc9846870d5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:08.690376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-049f59d2-1613-48f2-a485-bc9846870d5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:08.690859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-049f59d2-1613-48f2-a485-bc9846870d5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:08.691283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-049f59d2-1613-48f2-a485-bc9846870d5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:08.718432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:26:08.718681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:26:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:26:08.762006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-049f59d2-1613-48f2-a485-bc9846870d5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:08.764224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:08.772407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-049f59d2-1613-48f2-a485-bc9846870d5b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.094597 Aug 24 05:26:08.772978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1281/2671] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:09.294114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-24d56498-f33a-40a7-94c5-22674a235794 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:09.294744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-24d56498-f33a-40a7-94c5-22674a235794 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:09.300821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24d56498-f33a-40a7-94c5-22674a235794 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:09.301305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24d56498-f33a-40a7-94c5-22674a235794 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:09.301740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24d56498-f33a-40a7-94c5-22674a235794 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:09.303042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24d56498-f33a-40a7-94c5-22674a235794 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:09.303580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24d56498-f33a-40a7-94c5-22674a235794 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:09.304002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24d56498-f33a-40a7-94c5-22674a235794 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:09.369815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-24d56498-f33a-40a7-94c5-22674a235794 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:09.381072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-24d56498-f33a-40a7-94c5-22674a235794 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090253 Aug 24 05:26:09.381774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1391/2672] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:09.480988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-56d48bbf-c39a-474d-8748-751e22a256d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:09.481593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-56d48bbf-c39a-474d-8748-751e22a256d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:09.488047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56d48bbf-c39a-474d-8748-751e22a256d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:09.488521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56d48bbf-c39a-474d-8748-751e22a256d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:09.488947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56d48bbf-c39a-474d-8748-751e22a256d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:09.489625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56d48bbf-c39a-474d-8748-751e22a256d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:09.490385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56d48bbf-c39a-474d-8748-751e22a256d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:09.492193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56d48bbf-c39a-474d-8748-751e22a256d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:09.557978 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-56d48bbf-c39a-474d-8748-751e22a256d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:09.572216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-56d48bbf-c39a-474d-8748-751e22a256d6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.095176 Aug 24 05:26:09.572801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1282/2673] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:09.793555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0d1e3063-20ce-43eb-b8cd-6c308edee1dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:09.794171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0d1e3063-20ce-43eb-b8cd-6c308edee1dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:09.800367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d1e3063-20ce-43eb-b8cd-6c308edee1dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:09.800848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d1e3063-20ce-43eb-b8cd-6c308edee1dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:09.801287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d1e3063-20ce-43eb-b8cd-6c308edee1dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:09.801977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d1e3063-20ce-43eb-b8cd-6c308edee1dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:09.802999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d1e3063-20ce-43eb-b8cd-6c308edee1dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:09.803429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0d1e3063-20ce-43eb-b8cd-6c308edee1dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:09.869752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0d1e3063-20ce-43eb-b8cd-6c308edee1dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:09.878821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0d1e3063-20ce-43eb-b8cd-6c308edee1dd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089246 Aug 24 05:26:09.879412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1392/2674] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:10.401878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-15dfc80d-38bf-453d-94e0-616fe4e5e38e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:10.402491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-15dfc80d-38bf-453d-94e0-616fe4e5e38e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:10.408977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15dfc80d-38bf-453d-94e0-616fe4e5e38e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:10.409467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15dfc80d-38bf-453d-94e0-616fe4e5e38e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:10.409910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15dfc80d-38bf-453d-94e0-616fe4e5e38e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:10.410601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15dfc80d-38bf-453d-94e0-616fe4e5e38e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:10.411085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15dfc80d-38bf-453d-94e0-616fe4e5e38e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:10.411508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-15dfc80d-38bf-453d-94e0-616fe4e5e38e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:10.476104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-15dfc80d-38bf-453d-94e0-616fe4e5e38e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:10.484528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-15dfc80d-38bf-453d-94e0-616fe4e5e38e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086486 Aug 24 05:26:10.485134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1283/2675] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:10.592967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-38d527d3-dddb-4b80-8494-5cde1b0e42e0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:10.593602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-38d527d3-dddb-4b80-8494-5cde1b0e42e0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:10.600429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38d527d3-dddb-4b80-8494-5cde1b0e42e0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:10.600922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38d527d3-dddb-4b80-8494-5cde1b0e42e0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:10.601363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38d527d3-dddb-4b80-8494-5cde1b0e42e0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:10.602067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38d527d3-dddb-4b80-8494-5cde1b0e42e0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:10.602547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38d527d3-dddb-4b80-8494-5cde1b0e42e0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:10.603000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-38d527d3-dddb-4b80-8494-5cde1b0e42e0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:10.667241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-38d527d3-dddb-4b80-8494-5cde1b0e42e0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:10.676023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-38d527d3-dddb-4b80-8494-5cde1b0e42e0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086889 Aug 24 05:26:10.676590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1393/2676] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:10.900778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8d820fc1-b454-48d3-b978-5c321e6e445d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:10.901505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8d820fc1-b454-48d3-b978-5c321e6e445d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:10.908527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d820fc1-b454-48d3-b978-5c321e6e445d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:10.909010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d820fc1-b454-48d3-b978-5c321e6e445d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:10.909444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d820fc1-b454-48d3-b978-5c321e6e445d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:10.910136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d820fc1-b454-48d3-b978-5c321e6e445d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:10.910588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d820fc1-b454-48d3-b978-5c321e6e445d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:10.911035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8d820fc1-b454-48d3-b978-5c321e6e445d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:10.976967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8d820fc1-b454-48d3-b978-5c321e6e445d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:10.985650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8d820fc1-b454-48d3-b978-5c321e6e445d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088737 Aug 24 05:26:10.986224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1284/2677] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:11.506184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cba44da1-5744-425e-809d-c4c8c3bd66c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:11.506837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cba44da1-5744-425e-809d-c4c8c3bd66c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:11.512909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cba44da1-5744-425e-809d-c4c8c3bd66c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:11.513387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cba44da1-5744-425e-809d-c4c8c3bd66c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:11.513823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cba44da1-5744-425e-809d-c4c8c3bd66c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:11.514516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cba44da1-5744-425e-809d-c4c8c3bd66c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:11.514992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cba44da1-5744-425e-809d-c4c8c3bd66c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:11.515413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cba44da1-5744-425e-809d-c4c8c3bd66c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:11.581913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cba44da1-5744-425e-809d-c4c8c3bd66c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:11.590404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cba44da1-5744-425e-809d-c4c8c3bd66c7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088658 Aug 24 05:26:11.591005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1394/2678] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:11.702490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0d1cafef-7481-4405-a02e-6b6c177b0ec5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:11.703123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0d1cafef-7481-4405-a02e-6b6c177b0ec5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:11.709281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d1cafef-7481-4405-a02e-6b6c177b0ec5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:11.709757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d1cafef-7481-4405-a02e-6b6c177b0ec5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:11.710182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d1cafef-7481-4405-a02e-6b6c177b0ec5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:11.710902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d1cafef-7481-4405-a02e-6b6c177b0ec5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:11.711346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d1cafef-7481-4405-a02e-6b6c177b0ec5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:11.711758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d1cafef-7481-4405-a02e-6b6c177b0ec5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:11.775006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0d1cafef-7481-4405-a02e-6b6c177b0ec5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:11.783474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0d1cafef-7481-4405-a02e-6b6c177b0ec5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.084938 Aug 24 05:26:11.784221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1285/2679] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:12.007150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ed19ce7b-57a1-4532-a152-344338d69e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:12.007782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ed19ce7b-57a1-4532-a152-344338d69e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:12.014371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed19ce7b-57a1-4532-a152-344338d69e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:12.014905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed19ce7b-57a1-4532-a152-344338d69e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:12.015336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed19ce7b-57a1-4532-a152-344338d69e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:12.016025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed19ce7b-57a1-4532-a152-344338d69e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:12.016470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed19ce7b-57a1-4532-a152-344338d69e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:12.016886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed19ce7b-57a1-4532-a152-344338d69e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:12.084563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ed19ce7b-57a1-4532-a152-344338d69e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:12.093087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ed19ce7b-57a1-4532-a152-344338d69e5f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089773 Aug 24 05:26:12.093666 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1395/2680] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:12.611902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0f6af597-32de-4bc1-bedf-ec6996d04bfc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:12.612511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0f6af597-32de-4bc1-bedf-ec6996d04bfc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:12.619754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f6af597-32de-4bc1-bedf-ec6996d04bfc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:12.620242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f6af597-32de-4bc1-bedf-ec6996d04bfc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:12.620680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f6af597-32de-4bc1-bedf-ec6996d04bfc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:12.621370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f6af597-32de-4bc1-bedf-ec6996d04bfc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:12.621823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f6af597-32de-4bc1-bedf-ec6996d04bfc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:12.622244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0f6af597-32de-4bc1-bedf-ec6996d04bfc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:12.691115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0f6af597-32de-4bc1-bedf-ec6996d04bfc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:12.700121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0f6af597-32de-4bc1-bedf-ec6996d04bfc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.092210 Aug 24 05:26:12.700689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1286/2681] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:12.806053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6768d20f-c61c-4be1-8bee-8a7745c9bfa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:12.806715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6768d20f-c61c-4be1-8bee-8a7745c9bfa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:12.812775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6768d20f-c61c-4be1-8bee-8a7745c9bfa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:12.813255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6768d20f-c61c-4be1-8bee-8a7745c9bfa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:12.813687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6768d20f-c61c-4be1-8bee-8a7745c9bfa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:12.814370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6768d20f-c61c-4be1-8bee-8a7745c9bfa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:12.814856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6768d20f-c61c-4be1-8bee-8a7745c9bfa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:12.815274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6768d20f-c61c-4be1-8bee-8a7745c9bfa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:12.879137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6768d20f-c61c-4be1-8bee-8a7745c9bfa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:12.888114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6768d20f-c61c-4be1-8bee-8a7745c9bfa5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086812 Aug 24 05:26:12.888696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1396/2682] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:13.114167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9dbf2392-d764-4f4a-a429-59e6630882e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:13.115136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9dbf2392-d764-4f4a-a429-59e6630882e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:13.121762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbf2392-d764-4f4a-a429-59e6630882e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:13.122323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbf2392-d764-4f4a-a429-59e6630882e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:13.122809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbf2392-d764-4f4a-a429-59e6630882e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:13.123530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbf2392-d764-4f4a-a429-59e6630882e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:13.124037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbf2392-d764-4f4a-a429-59e6630882e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:13.124454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9dbf2392-d764-4f4a-a429-59e6630882e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:13.187862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9dbf2392-d764-4f4a-a429-59e6630882e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:13.196929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9dbf2392-d764-4f4a-a429-59e6630882e4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086525 Aug 24 05:26:13.197509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1287/2683] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:13.721577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ee7fd4dd-b293-4e3d-9d60-0370ead7a858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:13.722318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ee7fd4dd-b293-4e3d-9d60-0370ead7a858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:13.730076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee7fd4dd-b293-4e3d-9d60-0370ead7a858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:13.730677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee7fd4dd-b293-4e3d-9d60-0370ead7a858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:13.731020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee7fd4dd-b293-4e3d-9d60-0370ead7a858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:13.731744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee7fd4dd-b293-4e3d-9d60-0370ead7a858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:13.732184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee7fd4dd-b293-4e3d-9d60-0370ead7a858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:13.732597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee7fd4dd-b293-4e3d-9d60-0370ead7a858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:13.800481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ee7fd4dd-b293-4e3d-9d60-0370ead7a858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:13.813562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ee7fd4dd-b293-4e3d-9d60-0370ead7a858 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.095849 Aug 24 05:26:13.814146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1397/2684] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:13.908520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-774aa849-31ac-4ade-b7fe-c47127581325 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:13.909122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-774aa849-31ac-4ade-b7fe-c47127581325 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:13.916737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-774aa849-31ac-4ade-b7fe-c47127581325 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:13.917218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-774aa849-31ac-4ade-b7fe-c47127581325 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:13.917653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-774aa849-31ac-4ade-b7fe-c47127581325 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:13.918340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-774aa849-31ac-4ade-b7fe-c47127581325 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:13.918831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-774aa849-31ac-4ade-b7fe-c47127581325 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:13.919247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-774aa849-31ac-4ade-b7fe-c47127581325 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:13.983772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-774aa849-31ac-4ade-b7fe-c47127581325 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:13.992865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-774aa849-31ac-4ade-b7fe-c47127581325 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088230 Aug 24 05:26:13.993443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1288/2685] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:14.218325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9dc95df9-d585-4f67-9dcf-a43b816597cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:14.218936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9dc95df9-d585-4f67-9dcf-a43b816597cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:14.225535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dc95df9-d585-4f67-9dcf-a43b816597cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:14.226026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dc95df9-d585-4f67-9dcf-a43b816597cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:14.226466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dc95df9-d585-4f67-9dcf-a43b816597cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:14.227187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dc95df9-d585-4f67-9dcf-a43b816597cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:14.227651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dc95df9-d585-4f67-9dcf-a43b816597cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:14.228073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9dc95df9-d585-4f67-9dcf-a43b816597cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:14.294363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9dc95df9-d585-4f67-9dcf-a43b816597cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:14.310115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9dc95df9-d585-4f67-9dcf-a43b816597cf tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095553 Aug 24 05:26:14.310721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1398/2686] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:14.835745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-13768731-04f1-4b61-9477-49c9e58fac14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:14.836346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-13768731-04f1-4b61-9477-49c9e58fac14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:14.842534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13768731-04f1-4b61-9477-49c9e58fac14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:14.843091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13768731-04f1-4b61-9477-49c9e58fac14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:14.843529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13768731-04f1-4b61-9477-49c9e58fac14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:14.844231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13768731-04f1-4b61-9477-49c9e58fac14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:14.844686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13768731-04f1-4b61-9477-49c9e58fac14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:14.845105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13768731-04f1-4b61-9477-49c9e58fac14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:14.909531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-13768731-04f1-4b61-9477-49c9e58fac14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:14.918409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-13768731-04f1-4b61-9477-49c9e58fac14 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087092 Aug 24 05:26:14.919061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1289/2687] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:15.015081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6aa9da7a-cdb6-4533-a941-f667da26d19f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:15.015646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6aa9da7a-cdb6-4533-a941-f667da26d19f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:15.022284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6aa9da7a-cdb6-4533-a941-f667da26d19f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:15.022794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6aa9da7a-cdb6-4533-a941-f667da26d19f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:15.023232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6aa9da7a-cdb6-4533-a941-f667da26d19f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:15.023921 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6aa9da7a-cdb6-4533-a941-f667da26d19f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:15.024368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6aa9da7a-cdb6-4533-a941-f667da26d19f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:15.024788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6aa9da7a-cdb6-4533-a941-f667da26d19f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:15.088286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6aa9da7a-cdb6-4533-a941-f667da26d19f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:15.096725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6aa9da7a-cdb6-4533-a941-f667da26d19f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086949 Aug 24 05:26:15.097306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1399/2688] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:15.331778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f7056bd0-78b7-4621-b051-e59f2823221d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:15.332296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f7056bd0-78b7-4621-b051-e59f2823221d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:15.338335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7056bd0-78b7-4621-b051-e59f2823221d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:15.338854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7056bd0-78b7-4621-b051-e59f2823221d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:15.339287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7056bd0-78b7-4621-b051-e59f2823221d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:15.339968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7056bd0-78b7-4621-b051-e59f2823221d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:15.340413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7056bd0-78b7-4621-b051-e59f2823221d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:15.340829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f7056bd0-78b7-4621-b051-e59f2823221d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:15.651434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f7056bd0-78b7-4621-b051-e59f2823221d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:15.659775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f7056bd0-78b7-4621-b051-e59f2823221d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.332051 Aug 24 05:26:15.660348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1290/2689] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:15.939570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-015f1616-2043-46f6-844c-3fa729613868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:15.940090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-015f1616-2043-46f6-844c-3fa729613868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:15.947332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-015f1616-2043-46f6-844c-3fa729613868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:15.947815 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-015f1616-2043-46f6-844c-3fa729613868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:15.948241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-015f1616-2043-46f6-844c-3fa729613868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:15.948923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-015f1616-2043-46f6-844c-3fa729613868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:15.949366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-015f1616-2043-46f6-844c-3fa729613868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:15.949780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-015f1616-2043-46f6-844c-3fa729613868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:15.952501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:16.018750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-015f1616-2043-46f6-844c-3fa729613868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:16.027142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-015f1616-2043-46f6-844c-3fa729613868 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091427 Aug 24 05:26:16.027707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1400/2690] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:16.118868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-58344363-dc55-4b5a-82d5-d1b88cac810b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:16.119466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-58344363-dc55-4b5a-82d5-d1b88cac810b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:16.126035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58344363-dc55-4b5a-82d5-d1b88cac810b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:16.126508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58344363-dc55-4b5a-82d5-d1b88cac810b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:16.126956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58344363-dc55-4b5a-82d5-d1b88cac810b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:16.127637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58344363-dc55-4b5a-82d5-d1b88cac810b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:16.128110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58344363-dc55-4b5a-82d5-d1b88cac810b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:16.128523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58344363-dc55-4b5a-82d5-d1b88cac810b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:16.193597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-58344363-dc55-4b5a-82d5-d1b88cac810b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:16.202029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-58344363-dc55-4b5a-82d5-d1b88cac810b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088017 Aug 24 05:26:16.202611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1291/2691] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:16.681808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f975df4-5eba-4e55-aff3-91b99b086612 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:16.682406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1f975df4-5eba-4e55-aff3-91b99b086612 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:16.688489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f975df4-5eba-4e55-aff3-91b99b086612 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:16.688965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f975df4-5eba-4e55-aff3-91b99b086612 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:16.689390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f975df4-5eba-4e55-aff3-91b99b086612 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:16.690072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f975df4-5eba-4e55-aff3-91b99b086612 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:16.690513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f975df4-5eba-4e55-aff3-91b99b086612 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:16.690970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f975df4-5eba-4e55-aff3-91b99b086612 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:16.756434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1f975df4-5eba-4e55-aff3-91b99b086612 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:16.764868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1f975df4-5eba-4e55-aff3-91b99b086612 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087728 Aug 24 05:26:16.765429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1401/2692] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:16 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:17.047973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f25ddae5-272f-4edd-9fa4-6c50874dde65 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:17.048594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f25ddae5-272f-4edd-9fa4-6c50874dde65 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:17.055508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f25ddae5-272f-4edd-9fa4-6c50874dde65 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:17.056259 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f25ddae5-272f-4edd-9fa4-6c50874dde65 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:17.056700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f25ddae5-272f-4edd-9fa4-6c50874dde65 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:17.057396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f25ddae5-272f-4edd-9fa4-6c50874dde65 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:17.057847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f25ddae5-272f-4edd-9fa4-6c50874dde65 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:17.058267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f25ddae5-272f-4edd-9fa4-6c50874dde65 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:17.121525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f25ddae5-272f-4edd-9fa4-6c50874dde65 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:17.131004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f25ddae5-272f-4edd-9fa4-6c50874dde65 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086388 Aug 24 05:26:17.131570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1292/2693] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:17.223116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-729cb5cf-2fc9-4010-90ac-d33e02d91854 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:17.223741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-729cb5cf-2fc9-4010-90ac-d33e02d91854 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:17.230261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729cb5cf-2fc9-4010-90ac-d33e02d91854 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:17.230772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729cb5cf-2fc9-4010-90ac-d33e02d91854 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:17.231204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729cb5cf-2fc9-4010-90ac-d33e02d91854 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:17.231880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729cb5cf-2fc9-4010-90ac-d33e02d91854 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:17.232321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729cb5cf-2fc9-4010-90ac-d33e02d91854 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:17.232733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729cb5cf-2fc9-4010-90ac-d33e02d91854 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:17.298880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-729cb5cf-2fc9-4010-90ac-d33e02d91854 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:17.308576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-729cb5cf-2fc9-4010-90ac-d33e02d91854 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089192 Aug 24 05:26:17.309145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1402/2694] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:17 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:17.785537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2223280d-ad18-477e-8e92-205140211dd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:17.786149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2223280d-ad18-477e-8e92-205140211dd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:17.788633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=82 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:17.794175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2223280d-ad18-477e-8e92-205140211dd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:17.794659 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2223280d-ad18-477e-8e92-205140211dd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:17.795254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2223280d-ad18-477e-8e92-205140211dd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:17.795951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2223280d-ad18-477e-8e92-205140211dd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:17.796402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2223280d-ad18-477e-8e92-205140211dd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:17.796823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2223280d-ad18-477e-8e92-205140211dd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:17.859348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2223280d-ad18-477e-8e92-205140211dd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:17.868852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2223280d-ad18-477e-8e92-205140211dd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087203 Aug 24 05:26:17.869428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1293/2695] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:18.152691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0484ba27-99b1-4d2f-b16f-51331ce45d54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:18.153205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0484ba27-99b1-4d2f-b16f-51331ce45d54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:18.159348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0484ba27-99b1-4d2f-b16f-51331ce45d54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:18.159826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0484ba27-99b1-4d2f-b16f-51331ce45d54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:18.160261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0484ba27-99b1-4d2f-b16f-51331ce45d54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:18.160941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0484ba27-99b1-4d2f-b16f-51331ce45d54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:18.161395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0484ba27-99b1-4d2f-b16f-51331ce45d54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:18.161859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0484ba27-99b1-4d2f-b16f-51331ce45d54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:18.228076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0484ba27-99b1-4d2f-b16f-51331ce45d54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:18.236900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0484ba27-99b1-4d2f-b16f-51331ce45d54 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088100 Aug 24 05:26:18.237480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1403/2696] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:18.330175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-550c02e8-98a3-406a-a7e1-0a987302d476 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:18.331046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-550c02e8-98a3-406a-a7e1-0a987302d476 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:18.337852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-550c02e8-98a3-406a-a7e1-0a987302d476 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:18.338330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-550c02e8-98a3-406a-a7e1-0a987302d476 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:18.338791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-550c02e8-98a3-406a-a7e1-0a987302d476 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:18.339484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-550c02e8-98a3-406a-a7e1-0a987302d476 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:18.339932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-550c02e8-98a3-406a-a7e1-0a987302d476 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:18.340347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-550c02e8-98a3-406a-a7e1-0a987302d476 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:18.407305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-550c02e8-98a3-406a-a7e1-0a987302d476 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:18.416188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-550c02e8-98a3-406a-a7e1-0a987302d476 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089876 Aug 24 05:26:18.416758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1294/2697] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:18.889397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5121c717-e984-41e8-a8f1-67a180c0fb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:18.890036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5121c717-e984-41e8-a8f1-67a180c0fb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:18.896223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5121c717-e984-41e8-a8f1-67a180c0fb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:18.896708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5121c717-e984-41e8-a8f1-67a180c0fb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:18.897133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5121c717-e984-41e8-a8f1-67a180c0fb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:18.898528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5121c717-e984-41e8-a8f1-67a180c0fb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:18.898874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5121c717-e984-41e8-a8f1-67a180c0fb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:18.899291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5121c717-e984-41e8-a8f1-67a180c0fb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:18.962718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5121c717-e984-41e8-a8f1-67a180c0fb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:18.971159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5121c717-e984-41e8-a8f1-67a180c0fb96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085554 Aug 24 05:26:18.971732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1404/2698] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:19.258637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a3706a59-23b8-4b2c-b0cb-8fa4fbea3e77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:19.259288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a3706a59-23b8-4b2c-b0cb-8fa4fbea3e77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:19.265477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a3706a59-23b8-4b2c-b0cb-8fa4fbea3e77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:19.265950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a3706a59-23b8-4b2c-b0cb-8fa4fbea3e77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:19.266376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a3706a59-23b8-4b2c-b0cb-8fa4fbea3e77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:19.267083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a3706a59-23b8-4b2c-b0cb-8fa4fbea3e77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:19.267529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a3706a59-23b8-4b2c-b0cb-8fa4fbea3e77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:19.267939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a3706a59-23b8-4b2c-b0cb-8fa4fbea3e77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:19.339763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a3706a59-23b8-4b2c-b0cb-8fa4fbea3e77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:19.348301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a3706a59-23b8-4b2c-b0cb-8fa4fbea3e77 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.094039 Aug 24 05:26:19.348864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1295/2699] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:19.436962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-074dfbd0-ecbc-4cc2-8543-77ddb6e272f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:19.437578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-074dfbd0-ecbc-4cc2-8543-77ddb6e272f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:19.444627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074dfbd0-ecbc-4cc2-8543-77ddb6e272f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:19.445239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074dfbd0-ecbc-4cc2-8543-77ddb6e272f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:19.445672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074dfbd0-ecbc-4cc2-8543-77ddb6e272f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:19.446362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074dfbd0-ecbc-4cc2-8543-77ddb6e272f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:19.446848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074dfbd0-ecbc-4cc2-8543-77ddb6e272f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:19.447272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-074dfbd0-ecbc-4cc2-8543-77ddb6e272f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:19.513262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-074dfbd0-ecbc-4cc2-8543-77ddb6e272f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:19.521700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-074dfbd0-ecbc-4cc2-8543-77ddb6e272f1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088660 Aug 24 05:26:19.522562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1405/2700] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:19.994612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-befaff6e-70e1-4925-a0b1-86291233c402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:19.995781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-befaff6e-70e1-4925-a0b1-86291233c402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:20.002824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-befaff6e-70e1-4925-a0b1-86291233c402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:20.003304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-befaff6e-70e1-4925-a0b1-86291233c402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:20.003733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-befaff6e-70e1-4925-a0b1-86291233c402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:20.004575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-befaff6e-70e1-4925-a0b1-86291233c402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:20.005018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-befaff6e-70e1-4925-a0b1-86291233c402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:20.005432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-befaff6e-70e1-4925-a0b1-86291233c402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:20.069776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-befaff6e-70e1-4925-a0b1-86291233c402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:20.078195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-befaff6e-70e1-4925-a0b1-86291233c402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089293 Aug 24 05:26:20.078789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1296/2701] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:20.370538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f34da30c-5563-412c-a75d-b1219b098fbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:20.371109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f34da30c-5563-412c-a75d-b1219b098fbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:20.377192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f34da30c-5563-412c-a75d-b1219b098fbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:20.377667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f34da30c-5563-412c-a75d-b1219b098fbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:20.378098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f34da30c-5563-412c-a75d-b1219b098fbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:20.378811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f34da30c-5563-412c-a75d-b1219b098fbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:20.379253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f34da30c-5563-412c-a75d-b1219b098fbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:20.379688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f34da30c-5563-412c-a75d-b1219b098fbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:20.448362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f34da30c-5563-412c-a75d-b1219b098fbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:20.456758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f34da30c-5563-412c-a75d-b1219b098fbe tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091123 Aug 24 05:26:20.457334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1406/2702] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:20.543655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1315c479-d495-46c6-a6af-7b4e1f229656 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:20.545015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1315c479-d495-46c6-a6af-7b4e1f229656 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:20.551839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1315c479-d495-46c6-a6af-7b4e1f229656 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:20.552325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1315c479-d495-46c6-a6af-7b4e1f229656 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:20.552764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1315c479-d495-46c6-a6af-7b4e1f229656 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:20.554015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1315c479-d495-46c6-a6af-7b4e1f229656 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:20.554499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1315c479-d495-46c6-a6af-7b4e1f229656 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:20.554947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1315c479-d495-46c6-a6af-7b4e1f229656 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:20.621248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1315c479-d495-46c6-a6af-7b4e1f229656 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:20.629706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1315c479-d495-46c6-a6af-7b4e1f229656 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090126 Aug 24 05:26:20.630305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1297/2703] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:21.099252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-892dd994-1bea-45e8-b7fe-fe4634d59fce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:21.099860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-892dd994-1bea-45e8-b7fe-fe4634d59fce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:21.106324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-892dd994-1bea-45e8-b7fe-fe4634d59fce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:21.106906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-892dd994-1bea-45e8-b7fe-fe4634d59fce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:21.107389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-892dd994-1bea-45e8-b7fe-fe4634d59fce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:21.108128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-892dd994-1bea-45e8-b7fe-fe4634d59fce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:21.108617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-892dd994-1bea-45e8-b7fe-fe4634d59fce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:21.109076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-892dd994-1bea-45e8-b7fe-fe4634d59fce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:21.175226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-892dd994-1bea-45e8-b7fe-fe4634d59fce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:21.184101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-892dd994-1bea-45e8-b7fe-fe4634d59fce tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088745 Aug 24 05:26:21.184682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1407/2704] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:21.478523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-714db214-a36b-4457-81de-d454ca5d852f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:21.479151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-714db214-a36b-4457-81de-d454ca5d852f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:21.485308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714db214-a36b-4457-81de-d454ca5d852f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:21.485784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714db214-a36b-4457-81de-d454ca5d852f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:21.486211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714db214-a36b-4457-81de-d454ca5d852f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:21.486943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714db214-a36b-4457-81de-d454ca5d852f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:21.487385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714db214-a36b-4457-81de-d454ca5d852f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:21.487797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-714db214-a36b-4457-81de-d454ca5d852f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:21.505921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:21.559432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-714db214-a36b-4457-81de-d454ca5d852f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:21.569996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-714db214-a36b-4457-81de-d454ca5d852f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.095674 Aug 24 05:26:21.570576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1298/2705] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:21.654321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ca08d843-16b2-451a-ac10-01e37272a585 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:21.654928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ca08d843-16b2-451a-ac10-01e37272a585 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:21.657427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=82 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:21.662838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca08d843-16b2-451a-ac10-01e37272a585 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:21.663572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca08d843-16b2-451a-ac10-01e37272a585 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:21.664103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca08d843-16b2-451a-ac10-01e37272a585 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:21.664790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca08d843-16b2-451a-ac10-01e37272a585 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:21.665231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca08d843-16b2-451a-ac10-01e37272a585 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:21.665645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ca08d843-16b2-451a-ac10-01e37272a585 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:21.729630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ca08d843-16b2-451a-ac10-01e37272a585 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:21.738925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ca08d843-16b2-451a-ac10-01e37272a585 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088546 Aug 24 05:26:21.739510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1408/2706] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:22.205077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ec469de9-0234-41d9-9a42-fb2435f1b0ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:22.205600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ec469de9-0234-41d9-9a42-fb2435f1b0ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:22.212696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec469de9-0234-41d9-9a42-fb2435f1b0ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:22.213179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec469de9-0234-41d9-9a42-fb2435f1b0ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:22.213613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec469de9-0234-41d9-9a42-fb2435f1b0ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:22.214303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec469de9-0234-41d9-9a42-fb2435f1b0ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:22.214786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec469de9-0234-41d9-9a42-fb2435f1b0ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:22.215212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec469de9-0234-41d9-9a42-fb2435f1b0ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:22.279224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ec469de9-0234-41d9-9a42-fb2435f1b0ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:22.287596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ec469de9-0234-41d9-9a42-fb2435f1b0ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086535 Aug 24 05:26:22.288793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1299/2707] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:22.591483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5fd213ac-0afa-4a65-858c-1032bd08e9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:22.592008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5fd213ac-0afa-4a65-858c-1032bd08e9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:22.598204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fd213ac-0afa-4a65-858c-1032bd08e9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:22.598680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fd213ac-0afa-4a65-858c-1032bd08e9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:22.599142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fd213ac-0afa-4a65-858c-1032bd08e9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:22.599826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fd213ac-0afa-4a65-858c-1032bd08e9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:22.600974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fd213ac-0afa-4a65-858c-1032bd08e9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:22.601405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5fd213ac-0afa-4a65-858c-1032bd08e9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:22.665838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5fd213ac-0afa-4a65-858c-1032bd08e9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:22.674633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5fd213ac-0afa-4a65-858c-1032bd08e9df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087091 Aug 24 05:26:22.675234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1409/2708] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:22.761195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-596a232e-7ba2-4536-aaca-3646f635ff3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:22.761793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-596a232e-7ba2-4536-aaca-3646f635ff3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:22.768328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-596a232e-7ba2-4536-aaca-3646f635ff3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:22.768802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-596a232e-7ba2-4536-aaca-3646f635ff3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:22.769237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-596a232e-7ba2-4536-aaca-3646f635ff3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:22.769956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-596a232e-7ba2-4536-aaca-3646f635ff3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:22.770405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-596a232e-7ba2-4536-aaca-3646f635ff3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:22.770864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-596a232e-7ba2-4536-aaca-3646f635ff3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:22.836067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-596a232e-7ba2-4536-aaca-3646f635ff3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:22.844691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-596a232e-7ba2-4536-aaca-3646f635ff3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088036 Aug 24 05:26:22.845310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1300/2709] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:22 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:23.309272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f41f9f34-8dd0-44ab-8840-4550a6f922cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:23.309902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f41f9f34-8dd0-44ab-8840-4550a6f922cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:23.317930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f41f9f34-8dd0-44ab-8840-4550a6f922cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:23.318437 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f41f9f34-8dd0-44ab-8840-4550a6f922cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:23.318895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f41f9f34-8dd0-44ab-8840-4550a6f922cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:23.320177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f41f9f34-8dd0-44ab-8840-4550a6f922cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:23.320619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f41f9f34-8dd0-44ab-8840-4550a6f922cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:23.321031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f41f9f34-8dd0-44ab-8840-4550a6f922cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:23.388539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f41f9f34-8dd0-44ab-8840-4550a6f922cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:23.396942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f41f9f34-8dd0-44ab-8840-4550a6f922cd tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091716 Aug 24 05:26:23.397566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1410/2710] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:23.696181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ff5a9c0b-ec14-437c-b0ec-5e400c7dd8bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:23.696703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ff5a9c0b-ec14-437c-b0ec-5e400c7dd8bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:23.703071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff5a9c0b-ec14-437c-b0ec-5e400c7dd8bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:23.703558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff5a9c0b-ec14-437c-b0ec-5e400c7dd8bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:23.703993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff5a9c0b-ec14-437c-b0ec-5e400c7dd8bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:23.704691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff5a9c0b-ec14-437c-b0ec-5e400c7dd8bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:23.705139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff5a9c0b-ec14-437c-b0ec-5e400c7dd8bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:23.705564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff5a9c0b-ec14-437c-b0ec-5e400c7dd8bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:23.769330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ff5a9c0b-ec14-437c-b0ec-5e400c7dd8bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:23.778444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ff5a9c0b-ec14-437c-b0ec-5e400c7dd8bc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086168 Aug 24 05:26:23.779042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1301/2711] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:23.865356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-02a2a31c-44ac-439d-8b76-e5f4b7eedd17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:23.866061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-02a2a31c-44ac-439d-8b76-e5f4b7eedd17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:23.872784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02a2a31c-44ac-439d-8b76-e5f4b7eedd17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:23.873259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02a2a31c-44ac-439d-8b76-e5f4b7eedd17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:23.873685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02a2a31c-44ac-439d-8b76-e5f4b7eedd17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:23.874363 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02a2a31c-44ac-439d-8b76-e5f4b7eedd17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:23.874836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02a2a31c-44ac-439d-8b76-e5f4b7eedd17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:23.875249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02a2a31c-44ac-439d-8b76-e5f4b7eedd17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:23.940314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-02a2a31c-44ac-439d-8b76-e5f4b7eedd17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:23.949868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-02a2a31c-44ac-439d-8b76-e5f4b7eedd17 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088326 Aug 24 05:26:23.950451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1411/2712] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:24.418406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f66fec35-d8c4-4e43-b1ab-7b4fab72b045 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:24.418980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f66fec35-d8c4-4e43-b1ab-7b4fab72b045 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:24.425234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66fec35-d8c4-4e43-b1ab-7b4fab72b045 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:24.425712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66fec35-d8c4-4e43-b1ab-7b4fab72b045 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:24.426155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66fec35-d8c4-4e43-b1ab-7b4fab72b045 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:24.426892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66fec35-d8c4-4e43-b1ab-7b4fab72b045 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:24.427348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66fec35-d8c4-4e43-b1ab-7b4fab72b045 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:24.427771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f66fec35-d8c4-4e43-b1ab-7b4fab72b045 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:24.494667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f66fec35-d8c4-4e43-b1ab-7b4fab72b045 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:24.503242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f66fec35-d8c4-4e43-b1ab-7b4fab72b045 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088790 Aug 24 05:26:24.503826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1302/2713] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:24.803950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-540dd86c-4cc2-4737-b80b-e6ddd7e603cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:24.803950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-540dd86c-4cc2-4737-b80b-e6ddd7e603cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:24.806641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-540dd86c-4cc2-4737-b80b-e6ddd7e603cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:24.807148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-540dd86c-4cc2-4737-b80b-e6ddd7e603cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:24.807571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-540dd86c-4cc2-4737-b80b-e6ddd7e603cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:24.808251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-540dd86c-4cc2-4737-b80b-e6ddd7e603cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:24.808698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-540dd86c-4cc2-4737-b80b-e6ddd7e603cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:24.809113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-540dd86c-4cc2-4737-b80b-e6ddd7e603cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:24.872359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-540dd86c-4cc2-4737-b80b-e6ddd7e603cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:24.880653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-540dd86c-4cc2-4737-b80b-e6ddd7e603cf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085432 Aug 24 05:26:24.881225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1412/2714] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:24.971332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8b8b058a-249e-4fdd-8b1a-71f4e3d0d312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:24.971971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8b8b058a-249e-4fdd-8b1a-71f4e3d0d312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:24.979204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b8b058a-249e-4fdd-8b1a-71f4e3d0d312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:24.979713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b8b058a-249e-4fdd-8b1a-71f4e3d0d312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:24.980148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b8b058a-249e-4fdd-8b1a-71f4e3d0d312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:24.980845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b8b058a-249e-4fdd-8b1a-71f4e3d0d312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:24.981300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b8b058a-249e-4fdd-8b1a-71f4e3d0d312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:24.981719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b8b058a-249e-4fdd-8b1a-71f4e3d0d312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:25.045547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8b8b058a-249e-4fdd-8b1a-71f4e3d0d312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:25.054081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8b8b058a-249e-4fdd-8b1a-71f4e3d0d312 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086576 Aug 24 05:26:25.054745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1303/2715] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:24 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:25.524742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2039df0d-af1b-43ca-8f1d-d784886342ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:25.525356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2039df0d-af1b-43ca-8f1d-d784886342ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:25.531551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2039df0d-af1b-43ca-8f1d-d784886342ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:25.532031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2039df0d-af1b-43ca-8f1d-d784886342ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:25.532464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2039df0d-af1b-43ca-8f1d-d784886342ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:25.533154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2039df0d-af1b-43ca-8f1d-d784886342ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:25.533606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2039df0d-af1b-43ca-8f1d-d784886342ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:25.534031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2039df0d-af1b-43ca-8f1d-d784886342ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:25.597203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2039df0d-af1b-43ca-8f1d-d784886342ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:25.606404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2039df0d-af1b-43ca-8f1d-d784886342ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086142 Aug 24 05:26:25.607029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1413/2716] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:25.902070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b985763c-202d-40a8-b88f-ef1ef036a51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:25.902693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b985763c-202d-40a8-b88f-ef1ef036a51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:25.908876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b985763c-202d-40a8-b88f-ef1ef036a51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:25.909362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b985763c-202d-40a8-b88f-ef1ef036a51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:25.909795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b985763c-202d-40a8-b88f-ef1ef036a51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:25.910486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b985763c-202d-40a8-b88f-ef1ef036a51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:25.910963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b985763c-202d-40a8-b88f-ef1ef036a51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:25.911391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b985763c-202d-40a8-b88f-ef1ef036a51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:25.975989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b985763c-202d-40a8-b88f-ef1ef036a51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:25.984883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b985763c-202d-40a8-b88f-ef1ef036a51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086688 Aug 24 05:26:25.985519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1304/2717] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:26.075569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e0a332ba-8e55-422a-911b-2a749f3d10bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:26.076448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e0a332ba-8e55-422a-911b-2a749f3d10bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:26.083477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0a332ba-8e55-422a-911b-2a749f3d10bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:26.084074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0a332ba-8e55-422a-911b-2a749f3d10bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:26.084516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0a332ba-8e55-422a-911b-2a749f3d10bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:26.085777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0a332ba-8e55-422a-911b-2a749f3d10bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:26.086227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0a332ba-8e55-422a-911b-2a749f3d10bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:26.086731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0a332ba-8e55-422a-911b-2a749f3d10bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:26.153590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e0a332ba-8e55-422a-911b-2a749f3d10bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:26.162518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e0a332ba-8e55-422a-911b-2a749f3d10bb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090777 Aug 24 05:26:26.163644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1414/2718] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:26.628384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e491d737-ed8c-47f7-8ac8-c93d0b4adb18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:26.628991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e491d737-ed8c-47f7-8ac8-c93d0b4adb18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:26.636608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e491d737-ed8c-47f7-8ac8-c93d0b4adb18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:26.637094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e491d737-ed8c-47f7-8ac8-c93d0b4adb18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:26.637528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e491d737-ed8c-47f7-8ac8-c93d0b4adb18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:26.638218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e491d737-ed8c-47f7-8ac8-c93d0b4adb18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:26.638667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e491d737-ed8c-47f7-8ac8-c93d0b4adb18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:26.639110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e491d737-ed8c-47f7-8ac8-c93d0b4adb18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:26.717641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e491d737-ed8c-47f7-8ac8-c93d0b4adb18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:26.726977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e491d737-ed8c-47f7-8ac8-c93d0b4adb18 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.102643 Aug 24 05:26:26.728722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1305/2719] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:27.005465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4660c414-a1a6-4dee-bd9f-fb9d0a23edc6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:27.006109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4660c414-a1a6-4dee-bd9f-fb9d0a23edc6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:27.013093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4660c414-a1a6-4dee-bd9f-fb9d0a23edc6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:27.013604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4660c414-a1a6-4dee-bd9f-fb9d0a23edc6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:27.014039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4660c414-a1a6-4dee-bd9f-fb9d0a23edc6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:27.014770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4660c414-a1a6-4dee-bd9f-fb9d0a23edc6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:27.015228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4660c414-a1a6-4dee-bd9f-fb9d0a23edc6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:27.015654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4660c414-a1a6-4dee-bd9f-fb9d0a23edc6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:27.080010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4660c414-a1a6-4dee-bd9f-fb9d0a23edc6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:27.089210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4660c414-a1a6-4dee-bd9f-fb9d0a23edc6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087578 Aug 24 05:26:27.089797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1415/2720] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:27.185261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c787e2b2-bbe8-4cbb-a984-eb1797978d97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:27.185875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c787e2b2-bbe8-4cbb-a984-eb1797978d97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:27.192395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c787e2b2-bbe8-4cbb-a984-eb1797978d97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:27.192816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c787e2b2-bbe8-4cbb-a984-eb1797978d97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:27.193251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c787e2b2-bbe8-4cbb-a984-eb1797978d97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:27.193964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c787e2b2-bbe8-4cbb-a984-eb1797978d97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:27.194668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c787e2b2-bbe8-4cbb-a984-eb1797978d97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:27.195375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c787e2b2-bbe8-4cbb-a984-eb1797978d97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:27.294891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c787e2b2-bbe8-4cbb-a984-eb1797978d97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:27.303476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c787e2b2-bbe8-4cbb-a984-eb1797978d97 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.122568 Aug 24 05:26:27.304061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1306/2721] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:27 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:27.748854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-349d0755-fe93-4434-b5d1-905dd4b4b61d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:27.749468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-349d0755-fe93-4434-b5d1-905dd4b4b61d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:27.755681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349d0755-fe93-4434-b5d1-905dd4b4b61d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:27.756159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349d0755-fe93-4434-b5d1-905dd4b4b61d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:27.757280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349d0755-fe93-4434-b5d1-905dd4b4b61d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:27.757980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349d0755-fe93-4434-b5d1-905dd4b4b61d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:27.758429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349d0755-fe93-4434-b5d1-905dd4b4b61d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:27.758889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349d0755-fe93-4434-b5d1-905dd4b4b61d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:27.825206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-349d0755-fe93-4434-b5d1-905dd4b4b61d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:27.827407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:27.835476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-349d0755-fe93-4434-b5d1-905dd4b4b61d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089838 Aug 24 05:26:27.836201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1416/2722] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:27 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:28.109959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c12f110d-6c72-49af-8ae1-4a2eebde8361 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:28.110480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c12f110d-6c72-49af-8ae1-4a2eebde8361 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:28.117550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c12f110d-6c72-49af-8ae1-4a2eebde8361 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:28.118041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c12f110d-6c72-49af-8ae1-4a2eebde8361 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:28.118469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c12f110d-6c72-49af-8ae1-4a2eebde8361 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:28.119176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c12f110d-6c72-49af-8ae1-4a2eebde8361 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:28.119623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c12f110d-6c72-49af-8ae1-4a2eebde8361 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:28.120043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c12f110d-6c72-49af-8ae1-4a2eebde8361 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:28.185179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c12f110d-6c72-49af-8ae1-4a2eebde8361 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:28.194436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c12f110d-6c72-49af-8ae1-4a2eebde8361 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087998 Aug 24 05:26:28.195333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1307/2723] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:28.325265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d03e28d2-d3ad-44fa-854c-a0be63f0f61f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:28.325903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d03e28d2-d3ad-44fa-854c-a0be63f0f61f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:28.332366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d03e28d2-d3ad-44fa-854c-a0be63f0f61f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:28.332835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d03e28d2-d3ad-44fa-854c-a0be63f0f61f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:28.333260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d03e28d2-d3ad-44fa-854c-a0be63f0f61f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:28.333938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d03e28d2-d3ad-44fa-854c-a0be63f0f61f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:28.334380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d03e28d2-d3ad-44fa-854c-a0be63f0f61f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:28.335542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d03e28d2-d3ad-44fa-854c-a0be63f0f61f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:28.400607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d03e28d2-d3ad-44fa-854c-a0be63f0f61f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:28.408814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d03e28d2-d3ad-44fa-854c-a0be63f0f61f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087703 Aug 24 05:26:28.409380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1417/2724] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:28.857699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-117be878-f77d-4b78-b2de-8cd7d5d6f41f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:28.858307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-117be878-f77d-4b78-b2de-8cd7d5d6f41f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:28.864922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-117be878-f77d-4b78-b2de-8cd7d5d6f41f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:28.865400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-117be878-f77d-4b78-b2de-8cd7d5d6f41f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:28.866753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-117be878-f77d-4b78-b2de-8cd7d5d6f41f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:28.867451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-117be878-f77d-4b78-b2de-8cd7d5d6f41f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:28.867899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-117be878-f77d-4b78-b2de-8cd7d5d6f41f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:28.868312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-117be878-f77d-4b78-b2de-8cd7d5d6f41f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:28.931755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-117be878-f77d-4b78-b2de-8cd7d5d6f41f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:28.940177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-117be878-f77d-4b78-b2de-8cd7d5d6f41f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086375 Aug 24 05:26:28.940753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1308/2725] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:29.215983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9e61b51c-1edc-4627-bfc5-84a9e569914c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:29.216584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9e61b51c-1edc-4627-bfc5-84a9e569914c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:29.222565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e61b51c-1edc-4627-bfc5-84a9e569914c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:29.223070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e61b51c-1edc-4627-bfc5-84a9e569914c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:29.223493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e61b51c-1edc-4627-bfc5-84a9e569914c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:29.224166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e61b51c-1edc-4627-bfc5-84a9e569914c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:29.224613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e61b51c-1edc-4627-bfc5-84a9e569914c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:29.225028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e61b51c-1edc-4627-bfc5-84a9e569914c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:29.293803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9e61b51c-1edc-4627-bfc5-84a9e569914c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:29.302078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9e61b51c-1edc-4627-bfc5-84a9e569914c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089944 Aug 24 05:26:29.302643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1418/2726] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:29.430174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ddc173e7-5c0a-4f2a-ae0b-056c162b3b18 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:29.430817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ddc173e7-5c0a-4f2a-ae0b-056c162b3b18 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:29.437925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddc173e7-5c0a-4f2a-ae0b-056c162b3b18 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:29.438404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddc173e7-5c0a-4f2a-ae0b-056c162b3b18 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:29.438863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddc173e7-5c0a-4f2a-ae0b-056c162b3b18 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:29.439555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddc173e7-5c0a-4f2a-ae0b-056c162b3b18 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:29.440002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddc173e7-5c0a-4f2a-ae0b-056c162b3b18 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:29.440422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ddc173e7-5c0a-4f2a-ae0b-056c162b3b18 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:29.506347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ddc173e7-5c0a-4f2a-ae0b-056c162b3b18 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:29.515257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ddc173e7-5c0a-4f2a-ae0b-056c162b3b18 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089679 Aug 24 05:26:29.515819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1309/2727] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:29.961647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7a19b888-cec9-443b-be12-22d7676d91cc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:29.962256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7a19b888-cec9-443b-be12-22d7676d91cc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:29.968721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7a19b888-cec9-443b-be12-22d7676d91cc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:29.969202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7a19b888-cec9-443b-be12-22d7676d91cc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:29.969641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7a19b888-cec9-443b-be12-22d7676d91cc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:29.970318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7a19b888-cec9-443b-be12-22d7676d91cc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:29.970811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7a19b888-cec9-443b-be12-22d7676d91cc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:29.971233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7a19b888-cec9-443b-be12-22d7676d91cc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:30.033156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7a19b888-cec9-443b-be12-22d7676d91cc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:30.041647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7a19b888-cec9-443b-be12-22d7676d91cc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084436 Aug 24 05:26:30.042217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1419/2728] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:30.323629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-345f1025-096f-408a-9d21-384b5092c0d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:30.324232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-345f1025-096f-408a-9d21-384b5092c0d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:30.330134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-345f1025-096f-408a-9d21-384b5092c0d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:30.330611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-345f1025-096f-408a-9d21-384b5092c0d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:30.331080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-345f1025-096f-408a-9d21-384b5092c0d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:30.331752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-345f1025-096f-408a-9d21-384b5092c0d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:30.332197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-345f1025-096f-408a-9d21-384b5092c0d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:30.332612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-345f1025-096f-408a-9d21-384b5092c0d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:30.394218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-345f1025-096f-408a-9d21-384b5092c0d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:30.403225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-345f1025-096f-408a-9d21-384b5092c0d9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084244 Aug 24 05:26:30.403791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1310/2729] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:30.541565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-544302f9-5dee-49bf-a75a-d0d5c2f750ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:30.542170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-544302f9-5dee-49bf-a75a-d0d5c2f750ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:30.548148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-544302f9-5dee-49bf-a75a-d0d5c2f750ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:30.548613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-544302f9-5dee-49bf-a75a-d0d5c2f750ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:30.549039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-544302f9-5dee-49bf-a75a-d0d5c2f750ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:30.549704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-544302f9-5dee-49bf-a75a-d0d5c2f750ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:30.550145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-544302f9-5dee-49bf-a75a-d0d5c2f750ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:30.550554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-544302f9-5dee-49bf-a75a-d0d5c2f750ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:30.612695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-544302f9-5dee-49bf-a75a-d0d5c2f750ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:30.621460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-544302f9-5dee-49bf-a75a-d0d5c2f750ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.084610 Aug 24 05:26:30.622019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1420/2730] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:31.063073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e4e0f08d-3d06-4968-93b4-2d0bff9864c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:31.063673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e4e0f08d-3d06-4968-93b4-2d0bff9864c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:31.070807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4e0f08d-3d06-4968-93b4-2d0bff9864c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:31.071291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4e0f08d-3d06-4968-93b4-2d0bff9864c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:31.071728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4e0f08d-3d06-4968-93b4-2d0bff9864c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:31.072412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4e0f08d-3d06-4968-93b4-2d0bff9864c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:31.072865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4e0f08d-3d06-4968-93b4-2d0bff9864c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:31.073289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e4e0f08d-3d06-4968-93b4-2d0bff9864c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:31.136189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e4e0f08d-3d06-4968-93b4-2d0bff9864c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:31.144572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e4e0f08d-3d06-4968-93b4-2d0bff9864c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085387 Aug 24 05:26:31.145137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1311/2731] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:31.425987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ecbb6cac-03c7-44e7-9bac-e42faf11b229 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:31.425987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ecbb6cac-03c7-44e7-9bac-e42faf11b229 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:31.434113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecbb6cac-03c7-44e7-9bac-e42faf11b229 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:31.434614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecbb6cac-03c7-44e7-9bac-e42faf11b229 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:31.435096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecbb6cac-03c7-44e7-9bac-e42faf11b229 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:31.435812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecbb6cac-03c7-44e7-9bac-e42faf11b229 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:31.436265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecbb6cac-03c7-44e7-9bac-e42faf11b229 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:31.436715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecbb6cac-03c7-44e7-9bac-e42faf11b229 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:31.503365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ecbb6cac-03c7-44e7-9bac-e42faf11b229 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:31.512895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ecbb6cac-03c7-44e7-9bac-e42faf11b229 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.092647 Aug 24 05:26:31.513480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1421/2732] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:31.642105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-105d2499-90a4-4671-9a06-b5b461cfce42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:31.642731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-105d2499-90a4-4671-9a06-b5b461cfce42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:31.649546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-105d2499-90a4-4671-9a06-b5b461cfce42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:31.650030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-105d2499-90a4-4671-9a06-b5b461cfce42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:31.650459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-105d2499-90a4-4671-9a06-b5b461cfce42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:31.651170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-105d2499-90a4-4671-9a06-b5b461cfce42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:31.651622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-105d2499-90a4-4671-9a06-b5b461cfce42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:31.652039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-105d2499-90a4-4671-9a06-b5b461cfce42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:31.715248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-105d2499-90a4-4671-9a06-b5b461cfce42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:31.726548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-105d2499-90a4-4671-9a06-b5b461cfce42 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088284 Aug 24 05:26:31.727148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1312/2733] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:32.165971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e0cf7ae9-6a37-4dd7-a1de-23eec547fa69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:32.166488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e0cf7ae9-6a37-4dd7-a1de-23eec547fa69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:32.172509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cf7ae9-6a37-4dd7-a1de-23eec547fa69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:32.172975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cf7ae9-6a37-4dd7-a1de-23eec547fa69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:32.173400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cf7ae9-6a37-4dd7-a1de-23eec547fa69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:32.174068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cf7ae9-6a37-4dd7-a1de-23eec547fa69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:32.174507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cf7ae9-6a37-4dd7-a1de-23eec547fa69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:32.174944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0cf7ae9-6a37-4dd7-a1de-23eec547fa69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:32.240104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e0cf7ae9-6a37-4dd7-a1de-23eec547fa69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:32.248797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e0cf7ae9-6a37-4dd7-a1de-23eec547fa69 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087323 Aug 24 05:26:32.249354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1422/2734] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:32.533393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4d3ce194-1497-48eb-9b56-b1f85386d93a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:32.533985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4d3ce194-1497-48eb-9b56-b1f85386d93a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:32.541048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d3ce194-1497-48eb-9b56-b1f85386d93a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:32.541519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d3ce194-1497-48eb-9b56-b1f85386d93a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:32.541944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d3ce194-1497-48eb-9b56-b1f85386d93a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:32.542613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d3ce194-1497-48eb-9b56-b1f85386d93a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:32.543097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d3ce194-1497-48eb-9b56-b1f85386d93a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:32.543510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4d3ce194-1497-48eb-9b56-b1f85386d93a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:32.608906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4d3ce194-1497-48eb-9b56-b1f85386d93a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:32.617660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4d3ce194-1497-48eb-9b56-b1f85386d93a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088068 Aug 24 05:26:32.618244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1313/2735] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:32.749031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-89a0a3a9-e369-42b4-b001-1ac7ea1ac30a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:32.749642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-89a0a3a9-e369-42b4-b001-1ac7ea1ac30a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:32.756251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89a0a3a9-e369-42b4-b001-1ac7ea1ac30a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:32.757264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89a0a3a9-e369-42b4-b001-1ac7ea1ac30a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:32.757703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89a0a3a9-e369-42b4-b001-1ac7ea1ac30a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:32.758427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89a0a3a9-e369-42b4-b001-1ac7ea1ac30a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:32.758908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89a0a3a9-e369-42b4-b001-1ac7ea1ac30a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:32.759331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89a0a3a9-e369-42b4-b001-1ac7ea1ac30a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:32.822652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-89a0a3a9-e369-42b4-b001-1ac7ea1ac30a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:32.830799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-89a0a3a9-e369-42b4-b001-1ac7ea1ac30a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085625 Aug 24 05:26:32.831365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1423/2736] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:33.269759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b2b14c65-e1ca-41a8-a47b-a8f2d42819e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:33.270359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b2b14c65-e1ca-41a8-a47b-a8f2d42819e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:33.277324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b14c65-e1ca-41a8-a47b-a8f2d42819e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:33.277800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b14c65-e1ca-41a8-a47b-a8f2d42819e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:33.278373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b14c65-e1ca-41a8-a47b-a8f2d42819e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:33.279192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b14c65-e1ca-41a8-a47b-a8f2d42819e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:33.279703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b14c65-e1ca-41a8-a47b-a8f2d42819e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:33.280173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b14c65-e1ca-41a8-a47b-a8f2d42819e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:33.343246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b2b14c65-e1ca-41a8-a47b-a8f2d42819e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:33.352167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b2b14c65-e1ca-41a8-a47b-a8f2d42819e0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086404 Aug 24 05:26:33.352743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1314/2737] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:33 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:33.638655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8b83d657-768d-4dea-8fc3-c5cda93b53d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:33.639340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8b83d657-768d-4dea-8fc3-c5cda93b53d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:33.645296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b83d657-768d-4dea-8fc3-c5cda93b53d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:33.645780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b83d657-768d-4dea-8fc3-c5cda93b53d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:33.646216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b83d657-768d-4dea-8fc3-c5cda93b53d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:33.647570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b83d657-768d-4dea-8fc3-c5cda93b53d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:33.648113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b83d657-768d-4dea-8fc3-c5cda93b53d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:33.648540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8b83d657-768d-4dea-8fc3-c5cda93b53d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:33.711541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8b83d657-768d-4dea-8fc3-c5cda93b53d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:33.719752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8b83d657-768d-4dea-8fc3-c5cda93b53d0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085132 Aug 24 05:26:33.720318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1424/2738] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:33.851291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2546cce6-a3aa-49ab-9892-532decd594e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:33.851905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2546cce6-a3aa-49ab-9892-532decd594e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:33.858309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2546cce6-a3aa-49ab-9892-532decd594e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:33.858822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2546cce6-a3aa-49ab-9892-532decd594e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:33.859262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2546cce6-a3aa-49ab-9892-532decd594e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:33.859947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2546cce6-a3aa-49ab-9892-532decd594e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:33.860398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2546cce6-a3aa-49ab-9892-532decd594e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:33.860818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2546cce6-a3aa-49ab-9892-532decd594e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:33.864710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:33.925979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2546cce6-a3aa-49ab-9892-532decd594e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:33.934964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2546cce6-a3aa-49ab-9892-532decd594e4 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088314 Aug 24 05:26:33.935521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1315/2739] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:33 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:34.378879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d9b707e3-5418-40e9-90aa-1baeeb02e39c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:34.379593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d9b707e3-5418-40e9-90aa-1baeeb02e39c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:34.386826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9b707e3-5418-40e9-90aa-1baeeb02e39c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:34.387311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9b707e3-5418-40e9-90aa-1baeeb02e39c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:34.387747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9b707e3-5418-40e9-90aa-1baeeb02e39c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:34.388442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9b707e3-5418-40e9-90aa-1baeeb02e39c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:34.388895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9b707e3-5418-40e9-90aa-1baeeb02e39c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:34.389317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d9b707e3-5418-40e9-90aa-1baeeb02e39c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:34.469389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d9b707e3-5418-40e9-90aa-1baeeb02e39c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:34.480077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d9b707e3-5418-40e9-90aa-1baeeb02e39c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.105333 Aug 24 05:26:34.480667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1425/2740] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:34 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:34.743100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b3394a45-9685-463e-b9ea-84762d3a2242 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:34.744363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b3394a45-9685-463e-b9ea-84762d3a2242 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:34.751371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3394a45-9685-463e-b9ea-84762d3a2242 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:34.751849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3394a45-9685-463e-b9ea-84762d3a2242 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:34.752276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3394a45-9685-463e-b9ea-84762d3a2242 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:34.752960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3394a45-9685-463e-b9ea-84762d3a2242 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:34.753405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3394a45-9685-463e-b9ea-84762d3a2242 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:34.753818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b3394a45-9685-463e-b9ea-84762d3a2242 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:34.826240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b3394a45-9685-463e-b9ea-84762d3a2242 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:34.835120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b3394a45-9685-463e-b9ea-84762d3a2242 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.097264 Aug 24 05:26:34.835699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1316/2741] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:34.954828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0a290635-7303-4030-a34a-2bf12c0c4c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:34.955595 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0a290635-7303-4030-a34a-2bf12c0c4c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:34.963449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a290635-7303-4030-a34a-2bf12c0c4c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:34.964048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a290635-7303-4030-a34a-2bf12c0c4c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:34.964733 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a290635-7303-4030-a34a-2bf12c0c4c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:34.965513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a290635-7303-4030-a34a-2bf12c0c4c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:34.966331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a290635-7303-4030-a34a-2bf12c0c4c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:34.967116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a290635-7303-4030-a34a-2bf12c0c4c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:35.044276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0a290635-7303-4030-a34a-2bf12c0c4c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:35.052477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0a290635-7303-4030-a34a-2bf12c0c4c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.101635 Aug 24 05:26:35.053191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1426/2742] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:35.547316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0eaf57d1-c014-434b-af82-44e2409d7774 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:35.547926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0eaf57d1-c014-434b-af82-44e2409d7774 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:35.554266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0eaf57d1-c014-434b-af82-44e2409d7774 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:35.554767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0eaf57d1-c014-434b-af82-44e2409d7774 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:35.555199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0eaf57d1-c014-434b-af82-44e2409d7774 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:35.555875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0eaf57d1-c014-434b-af82-44e2409d7774 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:35.556582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0eaf57d1-c014-434b-af82-44e2409d7774 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:35.557001 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0eaf57d1-c014-434b-af82-44e2409d7774 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:35.622547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0eaf57d1-c014-434b-af82-44e2409d7774 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:35.631027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0eaf57d1-c014-434b-af82-44e2409d7774 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.132853 Aug 24 05:26:35.632241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1317/2743] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:35.857094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3e2a39f6-0436-4504-a478-3e5b7cad1960 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:35.857763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3e2a39f6-0436-4504-a478-3e5b7cad1960 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:35.864314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e2a39f6-0436-4504-a478-3e5b7cad1960 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:35.864796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e2a39f6-0436-4504-a478-3e5b7cad1960 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:35.865230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e2a39f6-0436-4504-a478-3e5b7cad1960 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:35.866649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e2a39f6-0436-4504-a478-3e5b7cad1960 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:35.867323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e2a39f6-0436-4504-a478-3e5b7cad1960 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:35.867754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e2a39f6-0436-4504-a478-3e5b7cad1960 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:35.929771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3e2a39f6-0436-4504-a478-3e5b7cad1960 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:35.938308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3e2a39f6-0436-4504-a478-3e5b7cad1960 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085060 Aug 24 05:26:35.938913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1427/2744] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:36.083191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-99cfcbe7-1b49-46f8-9356-e45a29272a2c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:36.083804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-99cfcbe7-1b49-46f8-9356-e45a29272a2c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:36.089942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99cfcbe7-1b49-46f8-9356-e45a29272a2c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:36.090422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99cfcbe7-1b49-46f8-9356-e45a29272a2c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:36.090891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99cfcbe7-1b49-46f8-9356-e45a29272a2c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:36.091588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99cfcbe7-1b49-46f8-9356-e45a29272a2c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:36.092040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99cfcbe7-1b49-46f8-9356-e45a29272a2c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:36.092462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-99cfcbe7-1b49-46f8-9356-e45a29272a2c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:36.160953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-99cfcbe7-1b49-46f8-9356-e45a29272a2c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:36.169872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-99cfcbe7-1b49-46f8-9356-e45a29272a2c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090598 Aug 24 05:26:36.170449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1318/2745] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:36 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:36.654224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-70510e71-1b39-434e-a7fb-58b76608689d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:36.654883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-70510e71-1b39-434e-a7fb-58b76608689d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:36.660969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-70510e71-1b39-434e-a7fb-58b76608689d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:36.661473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-70510e71-1b39-434e-a7fb-58b76608689d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:36.661909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-70510e71-1b39-434e-a7fb-58b76608689d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:36.663150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-70510e71-1b39-434e-a7fb-58b76608689d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:36.663950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-70510e71-1b39-434e-a7fb-58b76608689d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:36.664378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-70510e71-1b39-434e-a7fb-58b76608689d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:36.728003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-70510e71-1b39-434e-a7fb-58b76608689d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:36.736418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-70510e71-1b39-434e-a7fb-58b76608689d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086049 Aug 24 05:26:36.736980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1428/2746] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:37.026455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8481ae08-2534-46b3-a2aa-0f9fcf20480b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:37.027111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8481ae08-2534-46b3-a2aa-0f9fcf20480b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:37.033083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8481ae08-2534-46b3-a2aa-0f9fcf20480b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:37.033563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8481ae08-2534-46b3-a2aa-0f9fcf20480b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:37.033999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8481ae08-2534-46b3-a2aa-0f9fcf20480b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:37.034715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8481ae08-2534-46b3-a2aa-0f9fcf20480b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:37.035171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8481ae08-2534-46b3-a2aa-0f9fcf20480b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:37.035596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8481ae08-2534-46b3-a2aa-0f9fcf20480b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:37.098184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8481ae08-2534-46b3-a2aa-0f9fcf20480b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:37.107031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8481ae08-2534-46b3-a2aa-0f9fcf20480b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.151404 Aug 24 05:26:37.107598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1319/2747] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:37.191832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fe5e70b4-a2bd-4ffa-94ff-485cc3b41e2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:37.192439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fe5e70b4-a2bd-4ffa-94ff-485cc3b41e2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:37.198883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe5e70b4-a2bd-4ffa-94ff-485cc3b41e2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:37.199358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe5e70b4-a2bd-4ffa-94ff-485cc3b41e2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:37.199788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe5e70b4-a2bd-4ffa-94ff-485cc3b41e2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:37.200461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe5e70b4-a2bd-4ffa-94ff-485cc3b41e2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:37.200909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe5e70b4-a2bd-4ffa-94ff-485cc3b41e2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:37.201325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fe5e70b4-a2bd-4ffa-94ff-485cc3b41e2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:37.262905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fe5e70b4-a2bd-4ffa-94ff-485cc3b41e2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:37.271104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fe5e70b4-a2bd-4ffa-94ff-485cc3b41e2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.083050 Aug 24 05:26:37.271664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1429/2748] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:37.758058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-11e0f975-b205-4e5d-909b-31a5657a579c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:37.758666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-11e0f975-b205-4e5d-909b-31a5657a579c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:37.764743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11e0f975-b205-4e5d-909b-31a5657a579c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:37.765221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11e0f975-b205-4e5d-909b-31a5657a579c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:37.765656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11e0f975-b205-4e5d-909b-31a5657a579c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:37.766331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11e0f975-b205-4e5d-909b-31a5657a579c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:37.766809 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11e0f975-b205-4e5d-909b-31a5657a579c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:37.767237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-11e0f975-b205-4e5d-909b-31a5657a579c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:37.832630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-11e0f975-b205-4e5d-909b-31a5657a579c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:37.840932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-11e0f975-b205-4e5d-909b-31a5657a579c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086940 Aug 24 05:26:37.841496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1320/2749] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:38.129269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f9fbfc2f-0f96-4309-9617-e797a2ddcd1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:38.129789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f9fbfc2f-0f96-4309-9617-e797a2ddcd1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:38.136428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9fbfc2f-0f96-4309-9617-e797a2ddcd1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:38.136886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9fbfc2f-0f96-4309-9617-e797a2ddcd1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:38.137318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9fbfc2f-0f96-4309-9617-e797a2ddcd1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:38.138002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9fbfc2f-0f96-4309-9617-e797a2ddcd1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:38.138446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9fbfc2f-0f96-4309-9617-e797a2ddcd1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:38.138911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f9fbfc2f-0f96-4309-9617-e797a2ddcd1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:38.203600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f9fbfc2f-0f96-4309-9617-e797a2ddcd1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:38.212501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f9fbfc2f-0f96-4309-9617-e797a2ddcd1b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087671 Aug 24 05:26:38.213070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1430/2750] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:38.291926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bf7ba180-50a9-4f09-8900-9d434b8c202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:38.292511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bf7ba180-50a9-4f09-8900-9d434b8c202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:38.299009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf7ba180-50a9-4f09-8900-9d434b8c202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:38.299488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf7ba180-50a9-4f09-8900-9d434b8c202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:38.299925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf7ba180-50a9-4f09-8900-9d434b8c202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:38.300602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf7ba180-50a9-4f09-8900-9d434b8c202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:38.301052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf7ba180-50a9-4f09-8900-9d434b8c202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:38.301470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf7ba180-50a9-4f09-8900-9d434b8c202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:38.369796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bf7ba180-50a9-4f09-8900-9d434b8c202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:38.378270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bf7ba180-50a9-4f09-8900-9d434b8c202e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090130 Aug 24 05:26:38.378855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1321/2751] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:38.861043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-715f2677-712b-4453-8855-f57a8078e34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:38.861651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-715f2677-712b-4453-8855-f57a8078e34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:38.868557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715f2677-712b-4453-8855-f57a8078e34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:38.869040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715f2677-712b-4453-8855-f57a8078e34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:38.869481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715f2677-712b-4453-8855-f57a8078e34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:38.870726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715f2677-712b-4453-8855-f57a8078e34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:38.871177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715f2677-712b-4453-8855-f57a8078e34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:38.871597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-715f2677-712b-4453-8855-f57a8078e34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:38.934486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-715f2677-712b-4453-8855-f57a8078e34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:38.942680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-715f2677-712b-4453-8855-f57a8078e34f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085485 Aug 24 05:26:38.943259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1431/2752] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:39.233550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-750386c4-8976-41d9-9c7e-61c8e7485e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:39.234216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-750386c4-8976-41d9-9c7e-61c8e7485e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:39.240126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-750386c4-8976-41d9-9c7e-61c8e7485e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:39.241180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-750386c4-8976-41d9-9c7e-61c8e7485e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:39.241766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-750386c4-8976-41d9-9c7e-61c8e7485e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:39.242442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-750386c4-8976-41d9-9c7e-61c8e7485e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:39.242909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-750386c4-8976-41d9-9c7e-61c8e7485e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:39.243321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-750386c4-8976-41d9-9c7e-61c8e7485e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:39.358539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-750386c4-8976-41d9-9c7e-61c8e7485e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:39.368004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-750386c4-8976-41d9-9c7e-61c8e7485e76 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.138216 Aug 24 05:26:39.368581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1322/2753] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:39.399952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5eb118c0-d5d3-411d-b7de-ee96a0f47e4d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:39.400545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5eb118c0-d5d3-411d-b7de-ee96a0f47e4d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:39.407304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eb118c0-d5d3-411d-b7de-ee96a0f47e4d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:39.407901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eb118c0-d5d3-411d-b7de-ee96a0f47e4d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:39.408468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eb118c0-d5d3-411d-b7de-ee96a0f47e4d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:39.409251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eb118c0-d5d3-411d-b7de-ee96a0f47e4d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:39.409796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eb118c0-d5d3-411d-b7de-ee96a0f47e4d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:39.410357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eb118c0-d5d3-411d-b7de-ee96a0f47e4d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:39.530113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5eb118c0-d5d3-411d-b7de-ee96a0f47e4d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:39.538727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5eb118c0-d5d3-411d-b7de-ee96a0f47e4d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.142605 Aug 24 05:26:39.539303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1432/2754] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:39.964614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-97286365-25ad-4307-8626-f8b6049633fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:39.965224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-97286365-25ad-4307-8626-f8b6049633fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:39.971447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97286365-25ad-4307-8626-f8b6049633fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:39.971931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97286365-25ad-4307-8626-f8b6049633fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:39.972367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97286365-25ad-4307-8626-f8b6049633fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:39.973079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97286365-25ad-4307-8626-f8b6049633fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:39.973531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97286365-25ad-4307-8626-f8b6049633fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:39.973985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97286365-25ad-4307-8626-f8b6049633fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:40.037140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-97286365-25ad-4307-8626-f8b6049633fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:40.046536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-97286365-25ad-4307-8626-f8b6049633fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085798 Aug 24 05:26:40.047139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1323/2755] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:40.389208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1cf326b8-a94f-4b56-bd82-0c91ee06c79c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:40.389730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1cf326b8-a94f-4b56-bd82-0c91ee06c79c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:40.395890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cf326b8-a94f-4b56-bd82-0c91ee06c79c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:40.396366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cf326b8-a94f-4b56-bd82-0c91ee06c79c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:40.397410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cf326b8-a94f-4b56-bd82-0c91ee06c79c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:40.398104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cf326b8-a94f-4b56-bd82-0c91ee06c79c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:40.398558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cf326b8-a94f-4b56-bd82-0c91ee06c79c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:40.399016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cf326b8-a94f-4b56-bd82-0c91ee06c79c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:40.560119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-23bc0873-8c48-47bf-809a-2c40c6798ed3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:40.560814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-23bc0873-8c48-47bf-809a-2c40c6798ed3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:40.566344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:40.567624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23bc0873-8c48-47bf-809a-2c40c6798ed3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:40.568320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23bc0873-8c48-47bf-809a-2c40c6798ed3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:40.568874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23bc0873-8c48-47bf-809a-2c40c6798ed3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:40.569977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23bc0873-8c48-47bf-809a-2c40c6798ed3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:40.570495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23bc0873-8c48-47bf-809a-2c40c6798ed3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:40.570944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23bc0873-8c48-47bf-809a-2c40c6798ed3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:40.618242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1cf326b8-a94f-4b56-bd82-0c91ee06c79c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:40.626799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1cf326b8-a94f-4b56-bd82-0c91ee06c79c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.241463 Aug 24 05:26:40.627390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1433/2756] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:40.639616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-23bc0873-8c48-47bf-809a-2c40c6798ed3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:40.648907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-23bc0873-8c48-47bf-809a-2c40c6798ed3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092875 Aug 24 05:26:40.649483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1324/2757] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:41.067773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-513f13ea-2ef8-48b5-a53b-5a168252b197 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:41.068378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-513f13ea-2ef8-48b5-a53b-5a168252b197 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:41.075196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-513f13ea-2ef8-48b5-a53b-5a168252b197 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:41.075684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-513f13ea-2ef8-48b5-a53b-5a168252b197 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:41.076115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-513f13ea-2ef8-48b5-a53b-5a168252b197 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:41.076800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-513f13ea-2ef8-48b5-a53b-5a168252b197 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:41.077246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-513f13ea-2ef8-48b5-a53b-5a168252b197 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:41.077663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-513f13ea-2ef8-48b5-a53b-5a168252b197 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:41.149905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-513f13ea-2ef8-48b5-a53b-5a168252b197 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:41.158820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-513f13ea-2ef8-48b5-a53b-5a168252b197 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.094825 Aug 24 05:26:41.159389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1434/2758] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:41 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:41.649767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4b19e291-59f2-46d7-808a-1410257f7f46 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:41.650383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4b19e291-59f2-46d7-808a-1410257f7f46 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:41.656941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b19e291-59f2-46d7-808a-1410257f7f46 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:41.657420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b19e291-59f2-46d7-808a-1410257f7f46 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:41.657846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b19e291-59f2-46d7-808a-1410257f7f46 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:41.658522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b19e291-59f2-46d7-808a-1410257f7f46 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:41.658991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b19e291-59f2-46d7-808a-1410257f7f46 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:41.659406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b19e291-59f2-46d7-808a-1410257f7f46 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:41.669288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fbf83002-45b5-48bf-9534-310d2decc3fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:41.669814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fbf83002-45b5-48bf-9534-310d2decc3fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:41.676543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbf83002-45b5-48bf-9534-310d2decc3fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:41.677061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbf83002-45b5-48bf-9534-310d2decc3fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:41.677500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbf83002-45b5-48bf-9534-310d2decc3fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:41.678246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbf83002-45b5-48bf-9534-310d2decc3fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:41.678833 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbf83002-45b5-48bf-9534-310d2decc3fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:41.679299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbf83002-45b5-48bf-9534-310d2decc3fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:41.726412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4b19e291-59f2-46d7-808a-1410257f7f46 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:41.735132 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4b19e291-59f2-46d7-808a-1410257f7f46 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090097 Aug 24 05:26:41.736043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1325/2759] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:41.746302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fbf83002-45b5-48bf-9534-310d2decc3fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:41.754763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fbf83002-45b5-48bf-9534-310d2decc3fb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089311 Aug 24 05:26:41.755343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1435/2760] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:42.180511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ea45caa9-be9f-499c-a923-bc49239c3cbb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:42.181391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ea45caa9-be9f-499c-a923-bc49239c3cbb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:42.187465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea45caa9-be9f-499c-a923-bc49239c3cbb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:42.187942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea45caa9-be9f-499c-a923-bc49239c3cbb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:42.188375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea45caa9-be9f-499c-a923-bc49239c3cbb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:42.189071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea45caa9-be9f-499c-a923-bc49239c3cbb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:42.189607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea45caa9-be9f-499c-a923-bc49239c3cbb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:42.190032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea45caa9-be9f-499c-a923-bc49239c3cbb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:42.253608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ea45caa9-be9f-499c-a923-bc49239c3cbb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:42.263090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ea45caa9-be9f-499c-a923-bc49239c3cbb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086506 Aug 24 05:26:42.263842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1326/2761] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:42.755634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3ffcacc4-5b5f-414c-a296-ffa5cc4d2a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:42.756273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3ffcacc4-5b5f-414c-a296-ffa5cc4d2a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:42.765664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffcacc4-5b5f-414c-a296-ffa5cc4d2a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:42.766145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffcacc4-5b5f-414c-a296-ffa5cc4d2a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:42.766578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffcacc4-5b5f-414c-a296-ffa5cc4d2a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:42.767300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffcacc4-5b5f-414c-a296-ffa5cc4d2a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:42.767757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffcacc4-5b5f-414c-a296-ffa5cc4d2a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:42.768176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ffcacc4-5b5f-414c-a296-ffa5cc4d2a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:42.776178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-43f81e22-cdc9-4bdc-9c71-122642072f0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:42.776766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-43f81e22-cdc9-4bdc-9c71-122642072f0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:42.783265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43f81e22-cdc9-4bdc-9c71-122642072f0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:42.783745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43f81e22-cdc9-4bdc-9c71-122642072f0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:42.784170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43f81e22-cdc9-4bdc-9c71-122642072f0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:42.784855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43f81e22-cdc9-4bdc-9c71-122642072f0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:42.785299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43f81e22-cdc9-4bdc-9c71-122642072f0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:42.785715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-43f81e22-cdc9-4bdc-9c71-122642072f0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:42.834601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3ffcacc4-5b5f-414c-a296-ffa5cc4d2a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:42.843068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3ffcacc4-5b5f-414c-a296-ffa5cc4d2a34 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091398 Aug 24 05:26:42.843845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1436/2762] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:42.852272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-43f81e22-cdc9-4bdc-9c71-122642072f0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:42.860741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-43f81e22-cdc9-4bdc-9c71-122642072f0e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088443 Aug 24 05:26:42.861324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1327/2763] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:43.284211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e15c33a5-836d-446c-97fe-426eb8ca3009 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:43.284843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e15c33a5-836d-446c-97fe-426eb8ca3009 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:43.291607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e15c33a5-836d-446c-97fe-426eb8ca3009 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:43.292074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e15c33a5-836d-446c-97fe-426eb8ca3009 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:43.292505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e15c33a5-836d-446c-97fe-426eb8ca3009 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:43.293182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e15c33a5-836d-446c-97fe-426eb8ca3009 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:43.293628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e15c33a5-836d-446c-97fe-426eb8ca3009 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:43.294036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e15c33a5-836d-446c-97fe-426eb8ca3009 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:43.358359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e15c33a5-836d-446c-97fe-426eb8ca3009 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:43.367538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e15c33a5-836d-446c-97fe-426eb8ca3009 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087120 Aug 24 05:26:43.368105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1437/2764] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:43 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:43.876584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2595335a-17f3-4170-a000-436e73dd06f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:43.877201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2595335a-17f3-4170-a000-436e73dd06f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:43.881802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3152675e-c19f-4635-ad0b-df37361c419e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:43.882449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3152675e-c19f-4635-ad0b-df37361c419e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:43.884339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2595335a-17f3-4170-a000-436e73dd06f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:43.884819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2595335a-17f3-4170-a000-436e73dd06f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:43.885243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2595335a-17f3-4170-a000-436e73dd06f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:43.885924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2595335a-17f3-4170-a000-436e73dd06f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:43.886369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2595335a-17f3-4170-a000-436e73dd06f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:43.886805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2595335a-17f3-4170-a000-436e73dd06f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:43.888895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3152675e-c19f-4635-ad0b-df37361c419e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:43.889378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3152675e-c19f-4635-ad0b-df37361c419e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:43.889814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3152675e-c19f-4635-ad0b-df37361c419e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:43.890618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3152675e-c19f-4635-ad0b-df37361c419e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:43.891001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3152675e-c19f-4635-ad0b-df37361c419e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:43.891430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3152675e-c19f-4635-ad0b-df37361c419e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:43.949453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2595335a-17f3-4170-a000-436e73dd06f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:43.957194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3152675e-c19f-4635-ad0b-df37361c419e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:43.957835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2595335a-17f3-4170-a000-436e73dd06f1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085328 Aug 24 05:26:43.958405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1328/2765] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:43.966333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3152675e-c19f-4635-ad0b-df37361c419e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088992 Aug 24 05:26:43.966923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1438/2766] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:43 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:44.388789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ba654ff0-8c36-4cae-9dff-d7507e9450a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:44.389405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ba654ff0-8c36-4cae-9dff-d7507e9450a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:44.395454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba654ff0-8c36-4cae-9dff-d7507e9450a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:44.395936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba654ff0-8c36-4cae-9dff-d7507e9450a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:44.396370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba654ff0-8c36-4cae-9dff-d7507e9450a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:44.397053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba654ff0-8c36-4cae-9dff-d7507e9450a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:44.397507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba654ff0-8c36-4cae-9dff-d7507e9450a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:44.397933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba654ff0-8c36-4cae-9dff-d7507e9450a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:44.465935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ba654ff0-8c36-4cae-9dff-d7507e9450a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:44.474331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ba654ff0-8c36-4cae-9dff-d7507e9450a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089420 Aug 24 05:26:44.474936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1329/2767] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:44.979780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-66e198ac-3eb3-4401-98c3-a882ef9785d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:44.980424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-66e198ac-3eb3-4401-98c3-a882ef9785d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:44.986011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5a47a30a-3840-42e9-905d-651a53cbd788 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:44.986553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5a47a30a-3840-42e9-905d-651a53cbd788 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:44.987366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e198ac-3eb3-4401-98c3-a882ef9785d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:44.987852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e198ac-3eb3-4401-98c3-a882ef9785d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:44.988339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e198ac-3eb3-4401-98c3-a882ef9785d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:44.988987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e198ac-3eb3-4401-98c3-a882ef9785d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:44.989435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e198ac-3eb3-4401-98c3-a882ef9785d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:44.989858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-66e198ac-3eb3-4401-98c3-a882ef9785d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:44.993379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a47a30a-3840-42e9-905d-651a53cbd788 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:44.993865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a47a30a-3840-42e9-905d-651a53cbd788 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:44.994308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a47a30a-3840-42e9-905d-651a53cbd788 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:44.995066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a47a30a-3840-42e9-905d-651a53cbd788 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:44.996991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a47a30a-3840-42e9-905d-651a53cbd788 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:44.996991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a47a30a-3840-42e9-905d-651a53cbd788 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:45.057629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-66e198ac-3eb3-4401-98c3-a882ef9785d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:45.059729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5a47a30a-3840-42e9-905d-651a53cbd788 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:45.065845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-66e198ac-3eb3-4401-98c3-a882ef9785d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090717 Aug 24 05:26:45.066423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1439/2768] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:45.068077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5a47a30a-3840-42e9-905d-651a53cbd788 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085959 Aug 24 05:26:45.068643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1330/2769] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:45.496810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cd585770-8a21-49e7-9951-c11335c39779 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:45.497410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cd585770-8a21-49e7-9951-c11335c39779 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:45.503448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd585770-8a21-49e7-9951-c11335c39779 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:45.503919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd585770-8a21-49e7-9951-c11335c39779 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:45.504343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd585770-8a21-49e7-9951-c11335c39779 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:45.505009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd585770-8a21-49e7-9951-c11335c39779 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:45.505452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd585770-8a21-49e7-9951-c11335c39779 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:45.505863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd585770-8a21-49e7-9951-c11335c39779 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:45.570582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cd585770-8a21-49e7-9951-c11335c39779 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:45.578969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cd585770-8a21-49e7-9951-c11335c39779 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085922 Aug 24 05:26:45.579547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1440/2770] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:46.087971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-323a5e8a-a197-4fd5-8d32-69e8ad9af64c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:46.088523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-323a5e8a-a197-4fd5-8d32-69e8ad9af64c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:46.088853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dc64b884-185b-4b4c-8cc3-28e0eb2df74e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:46.089386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dc64b884-185b-4b4c-8cc3-28e0eb2df74e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:46.095044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-323a5e8a-a197-4fd5-8d32-69e8ad9af64c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:46.095529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-323a5e8a-a197-4fd5-8d32-69e8ad9af64c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:46.095648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc64b884-185b-4b4c-8cc3-28e0eb2df74e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:46.095966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-323a5e8a-a197-4fd5-8d32-69e8ad9af64c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:46.096117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc64b884-185b-4b4c-8cc3-28e0eb2df74e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:46.096547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc64b884-185b-4b4c-8cc3-28e0eb2df74e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:46.096689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-323a5e8a-a197-4fd5-8d32-69e8ad9af64c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:46.097143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-323a5e8a-a197-4fd5-8d32-69e8ad9af64c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:46.097276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc64b884-185b-4b4c-8cc3-28e0eb2df74e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:46.097565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-323a5e8a-a197-4fd5-8d32-69e8ad9af64c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:46.097705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc64b884-185b-4b4c-8cc3-28e0eb2df74e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:46.098079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dc64b884-185b-4b4c-8cc3-28e0eb2df74e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:46.161076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dc64b884-185b-4b4c-8cc3-28e0eb2df74e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:46.161285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-323a5e8a-a197-4fd5-8d32-69e8ad9af64c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:46.163533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:46.169672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dc64b884-185b-4b4c-8cc3-28e0eb2df74e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085123 Aug 24 05:26:46.170241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1441/2771] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:46.171145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-323a5e8a-a197-4fd5-8d32-69e8ad9af64c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087700 Aug 24 05:26:46.171716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1331/2772] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:46.600832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7081698d-239b-49cd-998f-1814365351c6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:46.601546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7081698d-239b-49cd-998f-1814365351c6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:46.607457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7081698d-239b-49cd-998f-1814365351c6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:46.607937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7081698d-239b-49cd-998f-1814365351c6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:46.608364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7081698d-239b-49cd-998f-1814365351c6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:46.609033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7081698d-239b-49cd-998f-1814365351c6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:46.609473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7081698d-239b-49cd-998f-1814365351c6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:46.609885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7081698d-239b-49cd-998f-1814365351c6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:46.674303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7081698d-239b-49cd-998f-1814365351c6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:46.683006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7081698d-239b-49cd-998f-1814365351c6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086592 Aug 24 05:26:46.683568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1442/2773] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:47.192663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2dd9ab28-a2ff-466d-b943-0c658cf6822b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:47.193562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2dd9ab28-a2ff-466d-b943-0c658cf6822b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:47.195203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d7a51098-02c5-471c-b8e3-113b1298b617 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:47.196364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d7a51098-02c5-471c-b8e3-113b1298b617 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:47.204490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2dd9ab28-a2ff-466d-b943-0c658cf6822b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:47.205295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2dd9ab28-a2ff-466d-b943-0c658cf6822b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:47.205998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2dd9ab28-a2ff-466d-b943-0c658cf6822b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:47.206546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7a51098-02c5-471c-b8e3-113b1298b617 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:47.207228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2dd9ab28-a2ff-466d-b943-0c658cf6822b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:47.207419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7a51098-02c5-471c-b8e3-113b1298b617 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:47.207979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7a51098-02c5-471c-b8e3-113b1298b617 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:47.208196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2dd9ab28-a2ff-466d-b943-0c658cf6822b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:47.208660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2dd9ab28-a2ff-466d-b943-0c658cf6822b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:47.209085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7a51098-02c5-471c-b8e3-113b1298b617 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:47.211132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7a51098-02c5-471c-b8e3-113b1298b617 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:47.211839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7a51098-02c5-471c-b8e3-113b1298b617 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:47.277850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d7a51098-02c5-471c-b8e3-113b1298b617 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:47.279194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2dd9ab28-a2ff-466d-b943-0c658cf6822b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:47.286664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d7a51098-02c5-471c-b8e3-113b1298b617 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.098499 Aug 24 05:26:47.287491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1443/2774] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:47 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:47.288029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2dd9ab28-a2ff-466d-b943-0c658cf6822b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.101588 Aug 24 05:26:47.288601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1332/2775] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:47.704180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5efeb00b-0807-4eef-aa09-ef1ce6915733 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:47.704801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5efeb00b-0807-4eef-aa09-ef1ce6915733 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:47.711117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5efeb00b-0807-4eef-aa09-ef1ce6915733 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:47.711599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5efeb00b-0807-4eef-aa09-ef1ce6915733 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:47.712029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5efeb00b-0807-4eef-aa09-ef1ce6915733 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:47.712713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5efeb00b-0807-4eef-aa09-ef1ce6915733 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:47.713163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5efeb00b-0807-4eef-aa09-ef1ce6915733 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:47.713581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5efeb00b-0807-4eef-aa09-ef1ce6915733 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:47.776472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5efeb00b-0807-4eef-aa09-ef1ce6915733 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:47.785055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5efeb00b-0807-4eef-aa09-ef1ce6915733 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084781 Aug 24 05:26:47.785639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1444/2776] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:48.307565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f6eddd74-3aad-4bb4-8838-2cf03b707412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:48.308180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f6eddd74-3aad-4bb4-8838-2cf03b707412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:48.308422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-24a68b48-9fa3-403c-b07f-e299d30ddd09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:48.309046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-24a68b48-9fa3-403c-b07f-e299d30ddd09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:48.310696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=80 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:48.315950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a68b48-9fa3-403c-b07f-e299d30ddd09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:48.316474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a68b48-9fa3-403c-b07f-e299d30ddd09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:48.316707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6eddd74-3aad-4bb4-8838-2cf03b707412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:48.316915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a68b48-9fa3-403c-b07f-e299d30ddd09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:48.317188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6eddd74-3aad-4bb4-8838-2cf03b707412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:48.317619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a68b48-9fa3-403c-b07f-e299d30ddd09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:48.317733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6eddd74-3aad-4bb4-8838-2cf03b707412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:48.318074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a68b48-9fa3-403c-b07f-e299d30ddd09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:48.318309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6eddd74-3aad-4bb4-8838-2cf03b707412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:48.318499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-24a68b48-9fa3-403c-b07f-e299d30ddd09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:48.318864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6eddd74-3aad-4bb4-8838-2cf03b707412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:48.319564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6eddd74-3aad-4bb4-8838-2cf03b707412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:48.384987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-24a68b48-9fa3-403c-b07f-e299d30ddd09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:48.388077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f6eddd74-3aad-4bb4-8838-2cf03b707412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:48.393904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-24a68b48-9fa3-403c-b07f-e299d30ddd09 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089628 Aug 24 05:26:48.394824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1445/2777] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:48.397849 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f6eddd74-3aad-4bb4-8838-2cf03b707412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.094347 Aug 24 05:26:48.398425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1333/2778] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:48.809719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2106febb-cfe8-46a8-91b0-2d46ab70cdc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:48.810368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2106febb-cfe8-46a8-91b0-2d46ab70cdc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:48.816842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2106febb-cfe8-46a8-91b0-2d46ab70cdc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:48.817326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2106febb-cfe8-46a8-91b0-2d46ab70cdc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:48.817763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2106febb-cfe8-46a8-91b0-2d46ab70cdc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:48.818444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2106febb-cfe8-46a8-91b0-2d46ab70cdc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:48.819604 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2106febb-cfe8-46a8-91b0-2d46ab70cdc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:48.820032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2106febb-cfe8-46a8-91b0-2d46ab70cdc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:48.884538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2106febb-cfe8-46a8-91b0-2d46ab70cdc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:48.893601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2106febb-cfe8-46a8-91b0-2d46ab70cdc6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089812 Aug 24 05:26:48.893601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1446/2779] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:49.419212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-57f18b0a-e298-488e-be7d-6211b80779db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:49.419866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-57f18b0a-e298-488e-be7d-6211b80779db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:49.422609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6607a7e6-2518-4994-92d4-7f5345910fe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:49.423853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6607a7e6-2518-4994-92d4-7f5345910fe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:49.426312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57f18b0a-e298-488e-be7d-6211b80779db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:49.426846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57f18b0a-e298-488e-be7d-6211b80779db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:49.427342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57f18b0a-e298-488e-be7d-6211b80779db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:49.427973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57f18b0a-e298-488e-be7d-6211b80779db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:49.428513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57f18b0a-e298-488e-be7d-6211b80779db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:49.429040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57f18b0a-e298-488e-be7d-6211b80779db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:49.431477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6607a7e6-2518-4994-92d4-7f5345910fe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:49.432223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6607a7e6-2518-4994-92d4-7f5345910fe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:49.432867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6607a7e6-2518-4994-92d4-7f5345910fe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:49.434983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6607a7e6-2518-4994-92d4-7f5345910fe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:49.434983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6607a7e6-2518-4994-92d4-7f5345910fe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:49.434983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6607a7e6-2518-4994-92d4-7f5345910fe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:49.494091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-57f18b0a-e298-488e-be7d-6211b80779db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:49.498991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6607a7e6-2518-4994-92d4-7f5345910fe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:49.502547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-57f18b0a-e298-488e-be7d-6211b80779db tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087431 Aug 24 05:26:49.503159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1334/2780] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:49.508139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6607a7e6-2518-4994-92d4-7f5345910fe9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092000 Aug 24 05:26:49.508707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1447/2781] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:49.915720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-681df924-335d-46fc-9ded-35e8063a88ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:49.916242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-681df924-335d-46fc-9ded-35e8063a88ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:49.922240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-681df924-335d-46fc-9ded-35e8063a88ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:49.922749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-681df924-335d-46fc-9ded-35e8063a88ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:49.923183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-681df924-335d-46fc-9ded-35e8063a88ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:49.923862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-681df924-335d-46fc-9ded-35e8063a88ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:49.924311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-681df924-335d-46fc-9ded-35e8063a88ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:49.924726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-681df924-335d-46fc-9ded-35e8063a88ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:49.988503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-681df924-335d-46fc-9ded-35e8063a88ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:49.997835 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-681df924-335d-46fc-9ded-35e8063a88ed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087194 Aug 24 05:26:49.998413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1335/2782] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:50.526586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bf33e664-ad5c-4b74-b1eb-336ee0ef9bb4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:50.527605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bf33e664-ad5c-4b74-b1eb-336ee0ef9bb4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:50.540298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf33e664-ad5c-4b74-b1eb-336ee0ef9bb4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:50.541064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf33e664-ad5c-4b74-b1eb-336ee0ef9bb4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:50.541757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf33e664-ad5c-4b74-b1eb-336ee0ef9bb4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:50.542862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf33e664-ad5c-4b74-b1eb-336ee0ef9bb4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:50.543009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-609be0cb-6612-476d-8406-26ecb54518b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:50.543609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf33e664-ad5c-4b74-b1eb-336ee0ef9bb4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:50.543942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-609be0cb-6612-476d-8406-26ecb54518b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:50.544289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bf33e664-ad5c-4b74-b1eb-336ee0ef9bb4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:50.553827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-609be0cb-6612-476d-8406-26ecb54518b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:50.554406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-609be0cb-6612-476d-8406-26ecb54518b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:50.554953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-609be0cb-6612-476d-8406-26ecb54518b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:50.555706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-609be0cb-6612-476d-8406-26ecb54518b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:50.556515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-609be0cb-6612-476d-8406-26ecb54518b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:50.556998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-609be0cb-6612-476d-8406-26ecb54518b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:50.614710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bf33e664-ad5c-4b74-b1eb-336ee0ef9bb4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:50.623411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-609be0cb-6612-476d-8406-26ecb54518b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:50.624995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bf33e664-ad5c-4b74-b1eb-336ee0ef9bb4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.104665 Aug 24 05:26:50.625785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1448/2783] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:50.632830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-609be0cb-6612-476d-8406-26ecb54518b0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.106985 Aug 24 05:26:50.633441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1336/2784] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:51.018806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9faaac71-6e14-4804-b58a-627300e69da2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:51.019409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9faaac71-6e14-4804-b58a-627300e69da2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:51.025943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9faaac71-6e14-4804-b58a-627300e69da2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:51.026419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9faaac71-6e14-4804-b58a-627300e69da2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:51.026896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9faaac71-6e14-4804-b58a-627300e69da2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:51.027578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9faaac71-6e14-4804-b58a-627300e69da2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:51.028025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9faaac71-6e14-4804-b58a-627300e69da2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:51.028443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9faaac71-6e14-4804-b58a-627300e69da2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:51.089754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9faaac71-6e14-4804-b58a-627300e69da2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:51.097918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9faaac71-6e14-4804-b58a-627300e69da2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.083018 Aug 24 05:26:51.098483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1449/2785] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:51.647991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d93f1552-8a95-4f06-bb32-2436e65f347a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:51.648771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d93f1552-8a95-4f06-bb32-2436e65f347a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:51.653609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b9e33e50-2155-4e7f-b11a-e52a031dfa56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:51.654347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b9e33e50-2155-4e7f-b11a-e52a031dfa56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:51.655833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d93f1552-8a95-4f06-bb32-2436e65f347a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:51.656451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d93f1552-8a95-4f06-bb32-2436e65f347a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:51.657061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d93f1552-8a95-4f06-bb32-2436e65f347a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:51.657762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d93f1552-8a95-4f06-bb32-2436e65f347a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:51.658216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d93f1552-8a95-4f06-bb32-2436e65f347a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:51.658636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d93f1552-8a95-4f06-bb32-2436e65f347a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:51.661000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9e33e50-2155-4e7f-b11a-e52a031dfa56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:51.661472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9e33e50-2155-4e7f-b11a-e52a031dfa56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:51.661896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9e33e50-2155-4e7f-b11a-e52a031dfa56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:51.663120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9e33e50-2155-4e7f-b11a-e52a031dfa56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:51.663924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9e33e50-2155-4e7f-b11a-e52a031dfa56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:51.664508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9e33e50-2155-4e7f-b11a-e52a031dfa56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:51.668602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:51.727309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d93f1552-8a95-4f06-bb32-2436e65f347a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:51.731362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b9e33e50-2155-4e7f-b11a-e52a031dfa56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:51.737591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d93f1552-8a95-4f06-bb32-2436e65f347a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.094022 Aug 24 05:26:51.738314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1337/2786] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:51.739953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b9e33e50-2155-4e7f-b11a-e52a031dfa56 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090170 Aug 24 05:26:51.740607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1450/2787] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:52.119955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ee139c61-4ef1-493b-afce-d36b1bc2432c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:52.120489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ee139c61-4ef1-493b-afce-d36b1bc2432c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:52.126475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee139c61-4ef1-493b-afce-d36b1bc2432c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:52.126987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee139c61-4ef1-493b-afce-d36b1bc2432c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:52.127448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee139c61-4ef1-493b-afce-d36b1bc2432c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:52.128124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee139c61-4ef1-493b-afce-d36b1bc2432c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:52.128573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee139c61-4ef1-493b-afce-d36b1bc2432c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:52.128992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ee139c61-4ef1-493b-afce-d36b1bc2432c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:52.190052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ee139c61-4ef1-493b-afce-d36b1bc2432c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:52.198263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ee139c61-4ef1-493b-afce-d36b1bc2432c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.082922 Aug 24 05:26:52.198870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1338/2788] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:52.759720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ed5a0f9c-1f83-4f43-be79-d95e8e7d3631 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:52.760265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ed5a0f9c-1f83-4f43-be79-d95e8e7d3631 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:52.760394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-47ee8beb-d9f1-40c3-af8d-96da3616944e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:52.761011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-47ee8beb-d9f1-40c3-af8d-96da3616944e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:52.762540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=86 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:52.767902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed5a0f9c-1f83-4f43-be79-d95e8e7d3631 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:52.768099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47ee8beb-d9f1-40c3-af8d-96da3616944e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:52.768379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47ee8beb-d9f1-40c3-af8d-96da3616944e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:52.768532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed5a0f9c-1f83-4f43-be79-d95e8e7d3631 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:52.768810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed5a0f9c-1f83-4f43-be79-d95e8e7d3631 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:52.768926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47ee8beb-d9f1-40c3-af8d-96da3616944e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:52.769486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed5a0f9c-1f83-4f43-be79-d95e8e7d3631 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:52.769619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47ee8beb-d9f1-40c3-af8d-96da3616944e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:52.769928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed5a0f9c-1f83-4f43-be79-d95e8e7d3631 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:52.770042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47ee8beb-d9f1-40c3-af8d-96da3616944e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:52.770340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ed5a0f9c-1f83-4f43-be79-d95e8e7d3631 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:52.770469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47ee8beb-d9f1-40c3-af8d-96da3616944e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:52.838568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-47ee8beb-d9f1-40c3-af8d-96da3616944e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:52.840656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ed5a0f9c-1f83-4f43-be79-d95e8e7d3631 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:52.847826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-47ee8beb-d9f1-40c3-af8d-96da3616944e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091255 Aug 24 05:26:52.848406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1339/2789] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:52.848895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ed5a0f9c-1f83-4f43-be79-d95e8e7d3631 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093980 Aug 24 05:26:52.849460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1451/2790] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:53.218932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f95e6d3e-74a3-4aeb-b894-6a5428fcfdb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:53.219537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f95e6d3e-74a3-4aeb-b894-6a5428fcfdb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:53.225854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95e6d3e-74a3-4aeb-b894-6a5428fcfdb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:53.226329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95e6d3e-74a3-4aeb-b894-6a5428fcfdb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:53.226780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95e6d3e-74a3-4aeb-b894-6a5428fcfdb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:53.227454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95e6d3e-74a3-4aeb-b894-6a5428fcfdb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:53.227898 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95e6d3e-74a3-4aeb-b894-6a5428fcfdb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:53.228310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f95e6d3e-74a3-4aeb-b894-6a5428fcfdb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:53.289836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f95e6d3e-74a3-4aeb-b894-6a5428fcfdb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:53.298003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f95e6d3e-74a3-4aeb-b894-6a5428fcfdb4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.082922 Aug 24 05:26:53.298566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1340/2791] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:53 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:53.870242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-219436db-eb7b-4b54-b9ef-39e6b26a2d72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:53.871130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82226580-00f5-43b8-a201-197bae7bd4a1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:53.871741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-219436db-eb7b-4b54-b9ef-39e6b26a2d72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:53.871909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-82226580-00f5-43b8-a201-197bae7bd4a1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:53.877913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82226580-00f5-43b8-a201-197bae7bd4a1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:53.878116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-219436db-eb7b-4b54-b9ef-39e6b26a2d72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:53.878407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82226580-00f5-43b8-a201-197bae7bd4a1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:53.878542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-219436db-eb7b-4b54-b9ef-39e6b26a2d72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:53.878881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82226580-00f5-43b8-a201-197bae7bd4a1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:53.879023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-219436db-eb7b-4b54-b9ef-39e6b26a2d72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:53.879571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82226580-00f5-43b8-a201-197bae7bd4a1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:53.879700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-219436db-eb7b-4b54-b9ef-39e6b26a2d72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:53.880019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82226580-00f5-43b8-a201-197bae7bd4a1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:53.880151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-219436db-eb7b-4b54-b9ef-39e6b26a2d72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:53.880433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-219436db-eb7b-4b54-b9ef-39e6b26a2d72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:53.880542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82226580-00f5-43b8-a201-197bae7bd4a1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:53.944268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-82226580-00f5-43b8-a201-197bae7bd4a1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:53.950860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-219436db-eb7b-4b54-b9ef-39e6b26a2d72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:53.952972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-82226580-00f5-43b8-a201-197bae7bd4a1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087321 Aug 24 05:26:53.953523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1452/2792] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:53 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:53.960137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-219436db-eb7b-4b54-b9ef-39e6b26a2d72 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093966 Aug 24 05:26:53.960788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1341/2793] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:54.320421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6edff9a4-7ee4-4a7d-8ffc-dfba374b58d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:54.321031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6edff9a4-7ee4-4a7d-8ffc-dfba374b58d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:54.327053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6edff9a4-7ee4-4a7d-8ffc-dfba374b58d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:54.327535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6edff9a4-7ee4-4a7d-8ffc-dfba374b58d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:54.327968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6edff9a4-7ee4-4a7d-8ffc-dfba374b58d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:54.328651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6edff9a4-7ee4-4a7d-8ffc-dfba374b58d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:54.329102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6edff9a4-7ee4-4a7d-8ffc-dfba374b58d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:54.329598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6edff9a4-7ee4-4a7d-8ffc-dfba374b58d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:54.392310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6edff9a4-7ee4-4a7d-8ffc-dfba374b58d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:54.401220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6edff9a4-7ee4-4a7d-8ffc-dfba374b58d5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084870 Aug 24 05:26:54.401793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1453/2794] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:54.973690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d5dfdace-3e54-41bc-b9f5-22cd78dd7cf0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:54.974331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d5dfdace-3e54-41bc-b9f5-22cd78dd7cf0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:54.981717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3513a6d9-1f5a-4373-9b6e-08f6b61a8e92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:54.982317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dfdace-3e54-41bc-b9f5-22cd78dd7cf0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:54.982435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3513a6d9-1f5a-4373-9b6e-08f6b61a8e92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:54.982538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dfdace-3e54-41bc-b9f5-22cd78dd7cf0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:54.982862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dfdace-3e54-41bc-b9f5-22cd78dd7cf0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:54.983559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dfdace-3e54-41bc-b9f5-22cd78dd7cf0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:54.984013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dfdace-3e54-41bc-b9f5-22cd78dd7cf0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:54.984434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d5dfdace-3e54-41bc-b9f5-22cd78dd7cf0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:54.990137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3513a6d9-1f5a-4373-9b6e-08f6b61a8e92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:54.991457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3513a6d9-1f5a-4373-9b6e-08f6b61a8e92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:54.992258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3513a6d9-1f5a-4373-9b6e-08f6b61a8e92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:54.998563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3513a6d9-1f5a-4373-9b6e-08f6b61a8e92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:54.999092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3513a6d9-1f5a-4373-9b6e-08f6b61a8e92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:54.999531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3513a6d9-1f5a-4373-9b6e-08f6b61a8e92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:55.052496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d5dfdace-3e54-41bc-b9f5-22cd78dd7cf0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:55.062747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d5dfdace-3e54-41bc-b9f5-22cd78dd7cf0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092818 Aug 24 05:26:55.063328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1342/2795] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:55.067845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3513a6d9-1f5a-4373-9b6e-08f6b61a8e92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:55.076997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3513a6d9-1f5a-4373-9b6e-08f6b61a8e92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.099079 Aug 24 05:26:55.077576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1454/2796] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:55.425834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-47646678-9020-4469-b219-1c99f2df2342 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:55.426989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-47646678-9020-4469-b219-1c99f2df2342 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:55.436165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47646678-9020-4469-b219-1c99f2df2342 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:55.436640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47646678-9020-4469-b219-1c99f2df2342 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:55.437066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47646678-9020-4469-b219-1c99f2df2342 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:55.437748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47646678-9020-4469-b219-1c99f2df2342 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:55.438193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47646678-9020-4469-b219-1c99f2df2342 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:55.438607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-47646678-9020-4469-b219-1c99f2df2342 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:55.506679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-47646678-9020-4469-b219-1c99f2df2342 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:55.515117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-47646678-9020-4469-b219-1c99f2df2342 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.096185 Aug 24 05:26:55.515702 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1343/2797] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:56.086961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5d5d5944-b058-432a-a003-7aef43176171 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:56.087512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5d5d5944-b058-432a-a003-7aef43176171 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:56.093979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d5d5944-b058-432a-a003-7aef43176171 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:56.094462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d5d5944-b058-432a-a003-7aef43176171 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:56.094922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d5d5944-b058-432a-a003-7aef43176171 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:56.095612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d5d5944-b058-432a-a003-7aef43176171 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:56.096063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d5d5944-b058-432a-a003-7aef43176171 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:56.096481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d5d5944-b058-432a-a003-7aef43176171 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:56.098300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2b546ead-cfb0-491c-8158-e3bd5b14213f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:56.098960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2b546ead-cfb0-491c-8158-e3bd5b14213f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:56.105704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b546ead-cfb0-491c-8158-e3bd5b14213f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:56.106197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b546ead-cfb0-491c-8158-e3bd5b14213f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:56.106635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b546ead-cfb0-491c-8158-e3bd5b14213f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:56.107361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b546ead-cfb0-491c-8158-e3bd5b14213f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:56.107817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b546ead-cfb0-491c-8158-e3bd5b14213f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:56.108244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2b546ead-cfb0-491c-8158-e3bd5b14213f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:56.160387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5d5d5944-b058-432a-a003-7aef43176171 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:56.169064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5d5d5944-b058-432a-a003-7aef43176171 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088176 Aug 24 05:26:56.169846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1455/2798] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:56.172804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2b546ead-cfb0-491c-8158-e3bd5b14213f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:56.181476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2b546ead-cfb0-491c-8158-e3bd5b14213f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086894 Aug 24 05:26:56.182041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1344/2799] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:26:56.536772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-35fb785a-678c-4383-99f2-d2f0df1b28d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:56.538042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-35fb785a-678c-4383-99f2-d2f0df1b28d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:56.544020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35fb785a-678c-4383-99f2-d2f0df1b28d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:56.544498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35fb785a-678c-4383-99f2-d2f0df1b28d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:56.544933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35fb785a-678c-4383-99f2-d2f0df1b28d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:56.545613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35fb785a-678c-4383-99f2-d2f0df1b28d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:56.546062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35fb785a-678c-4383-99f2-d2f0df1b28d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:56.546487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35fb785a-678c-4383-99f2-d2f0df1b28d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:56.607644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-35fb785a-678c-4383-99f2-d2f0df1b28d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:56.616189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-35fb785a-678c-4383-99f2-d2f0df1b28d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.083206 Aug 24 05:26:56.616817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1456/2800] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:57.189484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5cd2793c-8d9f-4e20-be80-a120da71c974 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:57.190088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5cd2793c-8d9f-4e20-be80-a120da71c974 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:57.196791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cd2793c-8d9f-4e20-be80-a120da71c974 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:57.197269 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cd2793c-8d9f-4e20-be80-a120da71c974 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:57.197706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cd2793c-8d9f-4e20-be80-a120da71c974 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:57.198401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cd2793c-8d9f-4e20-be80-a120da71c974 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:57.198884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cd2793c-8d9f-4e20-be80-a120da71c974 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:57.199319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cd2793c-8d9f-4e20-be80-a120da71c974 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:57.203614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5d2f23de-bcdc-4cb2-b429-71084f6858c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:57.204310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5d2f23de-bcdc-4cb2-b429-71084f6858c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:57.211493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2f23de-bcdc-4cb2-b429-71084f6858c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:57.211989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2f23de-bcdc-4cb2-b429-71084f6858c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:57.212429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2f23de-bcdc-4cb2-b429-71084f6858c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:57.213219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2f23de-bcdc-4cb2-b429-71084f6858c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:57.213681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2f23de-bcdc-4cb2-b429-71084f6858c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:57.214112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2f23de-bcdc-4cb2-b429-71084f6858c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:57.280799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5d2f23de-bcdc-4cb2-b429-71084f6858c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:57.290299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5d2f23de-bcdc-4cb2-b429-71084f6858c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090464 Aug 24 05:26:57.291176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1457/2801] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:57 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:57.417636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5cd2793c-8d9f-4e20-be80-a120da71c974 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:57.426082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5cd2793c-8d9f-4e20-be80-a120da71c974 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.240315 Aug 24 05:26:57.426419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1345/2802] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:57.640835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-90647558-bc2c-4383-9695-3160c3752cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:57.641454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-90647558-bc2c-4383-9695-3160c3752cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:57.648100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90647558-bc2c-4383-9695-3160c3752cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:57.648603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90647558-bc2c-4383-9695-3160c3752cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:57.649033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90647558-bc2c-4383-9695-3160c3752cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:57.649705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90647558-bc2c-4383-9695-3160c3752cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:57.650148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90647558-bc2c-4383-9695-3160c3752cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:57.650563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-90647558-bc2c-4383-9695-3160c3752cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:57.714676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-90647558-bc2c-4383-9695-3160c3752cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:57.722866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-90647558-bc2c-4383-9695-3160c3752cd7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085897 Aug 24 05:26:57.723421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1458/2803] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:58.311421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f0acd37f-3bf7-4a5b-9f3d-cce2222f6c1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:58.312095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f0acd37f-3bf7-4a5b-9f3d-cce2222f6c1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:58.318298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0acd37f-3bf7-4a5b-9f3d-cce2222f6c1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:58.318961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0acd37f-3bf7-4a5b-9f3d-cce2222f6c1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:58.319404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0acd37f-3bf7-4a5b-9f3d-cce2222f6c1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:58.320079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0acd37f-3bf7-4a5b-9f3d-cce2222f6c1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:58.320522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0acd37f-3bf7-4a5b-9f3d-cce2222f6c1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:58.320933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0acd37f-3bf7-4a5b-9f3d-cce2222f6c1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:58.382459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f0acd37f-3bf7-4a5b-9f3d-cce2222f6c1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:58.390550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f0acd37f-3bf7-4a5b-9f3d-cce2222f6c1c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.082959 Aug 24 05:26:58.391121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1346/2804] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:58.445949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-55fff08f-81a9-4c60-863c-edb75dbb42a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:58.446559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-55fff08f-81a9-4c60-863c-edb75dbb42a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:58.453037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55fff08f-81a9-4c60-863c-edb75dbb42a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:58.453521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55fff08f-81a9-4c60-863c-edb75dbb42a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:58.453955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55fff08f-81a9-4c60-863c-edb75dbb42a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:58.454663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55fff08f-81a9-4c60-863c-edb75dbb42a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:58.455141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55fff08f-81a9-4c60-863c-edb75dbb42a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:58.455563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-55fff08f-81a9-4c60-863c-edb75dbb42a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:58.517070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-55fff08f-81a9-4c60-863c-edb75dbb42a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:58.526152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-55fff08f-81a9-4c60-863c-edb75dbb42a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.084209 Aug 24 05:26:58.526740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1459/2805] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:58.745801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-503dba55-1607-41ce-8a79-3f03208841e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:58.746419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-503dba55-1607-41ce-8a79-3f03208841e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:58.752675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-503dba55-1607-41ce-8a79-3f03208841e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:58.753162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-503dba55-1607-41ce-8a79-3f03208841e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:58.753596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-503dba55-1607-41ce-8a79-3f03208841e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:58.754291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-503dba55-1607-41ce-8a79-3f03208841e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:58.754774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-503dba55-1607-41ce-8a79-3f03208841e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:58.755207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-503dba55-1607-41ce-8a79-3f03208841e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:58.817568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-503dba55-1607-41ce-8a79-3f03208841e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:58.826820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-503dba55-1607-41ce-8a79-3f03208841e3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086456 Aug 24 05:26:58.827391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1347/2806] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:59.410922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-528f607f-56b7-475c-a5ec-459450e7dd66 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:59.411535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-528f607f-56b7-475c-a5ec-459450e7dd66 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:59.418083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-528f607f-56b7-475c-a5ec-459450e7dd66 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:59.418569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-528f607f-56b7-475c-a5ec-459450e7dd66 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:59.419033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-528f607f-56b7-475c-a5ec-459450e7dd66 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:59.419723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-528f607f-56b7-475c-a5ec-459450e7dd66 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:59.420174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-528f607f-56b7-475c-a5ec-459450e7dd66 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:59.420597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-528f607f-56b7-475c-a5ec-459450e7dd66 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:59.482826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-528f607f-56b7-475c-a5ec-459450e7dd66 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:59.491443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-528f607f-56b7-475c-a5ec-459450e7dd66 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084345 Aug 24 05:26:59.492017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1460/2807] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:59.547029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-960293bb-c109-4319-bcd3-775d4e80c087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:59.547630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-960293bb-c109-4319-bcd3-775d4e80c087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:59.554135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-960293bb-c109-4319-bcd3-775d4e80c087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:59.554612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-960293bb-c109-4319-bcd3-775d4e80c087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:59.555082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-960293bb-c109-4319-bcd3-775d4e80c087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:59.555770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-960293bb-c109-4319-bcd3-775d4e80c087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:59.556487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-960293bb-c109-4319-bcd3-775d4e80c087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:59.556902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-960293bb-c109-4319-bcd3-775d4e80c087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:59.571908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:26:59.619866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-960293bb-c109-4319-bcd3-775d4e80c087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:59.628422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-960293bb-c109-4319-bcd3-775d4e80c087 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085323 Aug 24 05:26:59.628974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1348/2808] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:59 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:26:59.847620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0e4f6fde-e766-4765-a37c-87af95ad643c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:26:59.848222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0e4f6fde-e766-4765-a37c-87af95ad643c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:26:59.854698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e4f6fde-e766-4765-a37c-87af95ad643c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:59.855181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e4f6fde-e766-4765-a37c-87af95ad643c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:59.855605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e4f6fde-e766-4765-a37c-87af95ad643c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:59.856276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e4f6fde-e766-4765-a37c-87af95ad643c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:26:59.856717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e4f6fde-e766-4765-a37c-87af95ad643c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:26:59.857132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e4f6fde-e766-4765-a37c-87af95ad643c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:26:59.919267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0e4f6fde-e766-4765-a37c-87af95ad643c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:26:59.927562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0e4f6fde-e766-4765-a37c-87af95ad643c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.083758 Aug 24 05:26:59.928949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1461/2809] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:26:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:00.512867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ca1f00fc-0989-43cf-b9f6-012a89a88c89 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:00.513435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ca1f00fc-0989-43cf-b9f6-012a89a88c89 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:00.520938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca1f00fc-0989-43cf-b9f6-012a89a88c89 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:00.522257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca1f00fc-0989-43cf-b9f6-012a89a88c89 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:00.523034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca1f00fc-0989-43cf-b9f6-012a89a88c89 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:00.523878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca1f00fc-0989-43cf-b9f6-012a89a88c89 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:00.524488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca1f00fc-0989-43cf-b9f6-012a89a88c89 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:00.524973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca1f00fc-0989-43cf-b9f6-012a89a88c89 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:00.601296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ca1f00fc-0989-43cf-b9f6-012a89a88c89 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:00.609973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ca1f00fc-0989-43cf-b9f6-012a89a88c89 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.101177 Aug 24 05:27:00.610557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1349/2810] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:00.650599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-75fb3429-c931-4ebf-a1ca-2496b7175e83 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:00.651244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-75fb3429-c931-4ebf-a1ca-2496b7175e83 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:00.657640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75fb3429-c931-4ebf-a1ca-2496b7175e83 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:00.658116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75fb3429-c931-4ebf-a1ca-2496b7175e83 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:00.658545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75fb3429-c931-4ebf-a1ca-2496b7175e83 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:00.659280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75fb3429-c931-4ebf-a1ca-2496b7175e83 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:00.659723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75fb3429-c931-4ebf-a1ca-2496b7175e83 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:00.660141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75fb3429-c931-4ebf-a1ca-2496b7175e83 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:00.725410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-75fb3429-c931-4ebf-a1ca-2496b7175e83 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:00.734071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-75fb3429-c931-4ebf-a1ca-2496b7175e83 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088248 Aug 24 05:27:00.734649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1462/2811] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:00.950104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c129802f-0fe2-4f95-9a61-f642d4973db9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:00.950735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c129802f-0fe2-4f95-9a61-f642d4973db9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:00.956685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c129802f-0fe2-4f95-9a61-f642d4973db9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:00.957158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c129802f-0fe2-4f95-9a61-f642d4973db9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:00.957583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c129802f-0fe2-4f95-9a61-f642d4973db9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:00.958278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c129802f-0fe2-4f95-9a61-f642d4973db9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:00.958748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c129802f-0fe2-4f95-9a61-f642d4973db9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:00.959192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c129802f-0fe2-4f95-9a61-f642d4973db9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:01.022866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c129802f-0fe2-4f95-9a61-f642d4973db9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:01.031056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c129802f-0fe2-4f95-9a61-f642d4973db9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084786 Aug 24 05:27:01.031869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1350/2812] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:01.631690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-291def41-cf3e-423f-a21b-5db245997b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:01.632806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-291def41-cf3e-423f-a21b-5db245997b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:01.638935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-291def41-cf3e-423f-a21b-5db245997b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:01.639416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-291def41-cf3e-423f-a21b-5db245997b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:01.639844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-291def41-cf3e-423f-a21b-5db245997b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:01.640524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-291def41-cf3e-423f-a21b-5db245997b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:01.640969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-291def41-cf3e-423f-a21b-5db245997b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:01.641392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-291def41-cf3e-423f-a21b-5db245997b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:01.707101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-291def41-cf3e-423f-a21b-5db245997b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:01.715781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-291def41-cf3e-423f-a21b-5db245997b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088664 Aug 24 05:27:01.716356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1463/2813] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:01.755091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3eb76d37-d4cd-4edb-8bba-9ed280fff03d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:01.755697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3eb76d37-d4cd-4edb-8bba-9ed280fff03d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:01.763211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3eb76d37-d4cd-4edb-8bba-9ed280fff03d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:01.763692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3eb76d37-d4cd-4edb-8bba-9ed280fff03d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:01.764126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3eb76d37-d4cd-4edb-8bba-9ed280fff03d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:01.764811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3eb76d37-d4cd-4edb-8bba-9ed280fff03d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:01.765261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3eb76d37-d4cd-4edb-8bba-9ed280fff03d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:01.765677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3eb76d37-d4cd-4edb-8bba-9ed280fff03d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:01.828000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3eb76d37-d4cd-4edb-8bba-9ed280fff03d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:01.836795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3eb76d37-d4cd-4edb-8bba-9ed280fff03d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085436 Aug 24 05:27:01.837376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1351/2814] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:02.052038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6ff857d3-b64d-435b-abbb-a73dce6f6c83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:02.052535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6ff857d3-b64d-435b-abbb-a73dce6f6c83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:02.060106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff857d3-b64d-435b-abbb-a73dce6f6c83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:02.060582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff857d3-b64d-435b-abbb-a73dce6f6c83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:02.065764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff857d3-b64d-435b-abbb-a73dce6f6c83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:02.065764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff857d3-b64d-435b-abbb-a73dce6f6c83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:02.065764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff857d3-b64d-435b-abbb-a73dce6f6c83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:02.065764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff857d3-b64d-435b-abbb-a73dce6f6c83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:02.130096 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6ff857d3-b64d-435b-abbb-a73dce6f6c83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:02.138868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6ff857d3-b64d-435b-abbb-a73dce6f6c83 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090753 Aug 24 05:27:02.139415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1464/2815] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:02.737341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fd168571-fa36-40a3-b9b5-ad2abae57412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:02.737953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fd168571-fa36-40a3-b9b5-ad2abae57412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:02.745042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd168571-fa36-40a3-b9b5-ad2abae57412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:02.745523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd168571-fa36-40a3-b9b5-ad2abae57412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:02.745958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd168571-fa36-40a3-b9b5-ad2abae57412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:02.746798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd168571-fa36-40a3-b9b5-ad2abae57412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:02.747258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd168571-fa36-40a3-b9b5-ad2abae57412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:02.747677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd168571-fa36-40a3-b9b5-ad2abae57412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:02.812833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fd168571-fa36-40a3-b9b5-ad2abae57412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:02.821450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fd168571-fa36-40a3-b9b5-ad2abae57412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088124 Aug 24 05:27:02.822045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1352/2816] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:02.857457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-350fcbe2-8bb3-4873-b980-6c4bceaa72f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:02.858048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-350fcbe2-8bb3-4873-b980-6c4bceaa72f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:02.865015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-350fcbe2-8bb3-4873-b980-6c4bceaa72f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:02.866154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-350fcbe2-8bb3-4873-b980-6c4bceaa72f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:02.866601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-350fcbe2-8bb3-4873-b980-6c4bceaa72f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:02.867328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-350fcbe2-8bb3-4873-b980-6c4bceaa72f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:02.867779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-350fcbe2-8bb3-4873-b980-6c4bceaa72f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:02.868202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-350fcbe2-8bb3-4873-b980-6c4bceaa72f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:02.937254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-350fcbe2-8bb3-4873-b980-6c4bceaa72f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:02.946219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-350fcbe2-8bb3-4873-b980-6c4bceaa72f9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092776 Aug 24 05:27:02.946829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1465/2817] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:03.160549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5bcc8242-66b1-412b-bfe1-342680b8541e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:03.161079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5bcc8242-66b1-412b-bfe1-342680b8541e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:03.167703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcc8242-66b1-412b-bfe1-342680b8541e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:03.168189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcc8242-66b1-412b-bfe1-342680b8541e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:03.168625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcc8242-66b1-412b-bfe1-342680b8541e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:03.169309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcc8242-66b1-412b-bfe1-342680b8541e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:03.169761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcc8242-66b1-412b-bfe1-342680b8541e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:03.170183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5bcc8242-66b1-412b-bfe1-342680b8541e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:03.234457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5bcc8242-66b1-412b-bfe1-342680b8541e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:03.243688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5bcc8242-66b1-412b-bfe1-342680b8541e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087127 Aug 24 05:27:03.244262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1353/2818] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:03 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:03.842315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5f5737f8-3db3-495e-9d44-00eabe14757e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:03.843032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5f5737f8-3db3-495e-9d44-00eabe14757e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:03.849045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5737f8-3db3-495e-9d44-00eabe14757e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:03.849538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5737f8-3db3-495e-9d44-00eabe14757e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:03.849979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5737f8-3db3-495e-9d44-00eabe14757e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:03.850786 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5737f8-3db3-495e-9d44-00eabe14757e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:03.851240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5737f8-3db3-495e-9d44-00eabe14757e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:03.851668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5f5737f8-3db3-495e-9d44-00eabe14757e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:03.916108 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5f5737f8-3db3-495e-9d44-00eabe14757e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:03.918323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:03.925439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5f5737f8-3db3-495e-9d44-00eabe14757e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087009 Aug 24 05:27:03.926002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1466/2819] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:03 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:03.967615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e12ef8a6-0788-442e-8760-1ffcd06205db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:03.968236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e12ef8a6-0788-442e-8760-1ffcd06205db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:03.975333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e12ef8a6-0788-442e-8760-1ffcd06205db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:03.975897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e12ef8a6-0788-442e-8760-1ffcd06205db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:03.976337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e12ef8a6-0788-442e-8760-1ffcd06205db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:03.977045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e12ef8a6-0788-442e-8760-1ffcd06205db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:03.977500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e12ef8a6-0788-442e-8760-1ffcd06205db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:03.977923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e12ef8a6-0788-442e-8760-1ffcd06205db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:04.044561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e12ef8a6-0788-442e-8760-1ffcd06205db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:04.053675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e12ef8a6-0788-442e-8760-1ffcd06205db tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089394 Aug 24 05:27:04.054265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1354/2820] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:03 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:04.264913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-61e45022-b27e-40e4-bae9-34686b884115 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:04.265524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-61e45022-b27e-40e4-bae9-34686b884115 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:04.271489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61e45022-b27e-40e4-bae9-34686b884115 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:04.271976 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61e45022-b27e-40e4-bae9-34686b884115 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:04.272418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61e45022-b27e-40e4-bae9-34686b884115 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:04.273111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61e45022-b27e-40e4-bae9-34686b884115 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:04.273562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61e45022-b27e-40e4-bae9-34686b884115 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:04.273985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-61e45022-b27e-40e4-bae9-34686b884115 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:04.338748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-61e45022-b27e-40e4-bae9-34686b884115 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:04.347882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-61e45022-b27e-40e4-bae9-34686b884115 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086813 Aug 24 05:27:04.348460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1467/2821] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:04.947631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f2656b35-3144-4db9-8fe9-477a81f4a373 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:04.948242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f2656b35-3144-4db9-8fe9-477a81f4a373 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:04.954392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2656b35-3144-4db9-8fe9-477a81f4a373 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:04.954927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2656b35-3144-4db9-8fe9-477a81f4a373 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:04.955366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2656b35-3144-4db9-8fe9-477a81f4a373 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:04.956054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2656b35-3144-4db9-8fe9-477a81f4a373 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:04.956506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2656b35-3144-4db9-8fe9-477a81f4a373 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:04.956929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f2656b35-3144-4db9-8fe9-477a81f4a373 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:05.023503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f2656b35-3144-4db9-8fe9-477a81f4a373 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:05.032044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f2656b35-3144-4db9-8fe9-477a81f4a373 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088387 Aug 24 05:27:05.032613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1355/2822] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:05.075378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9877d800-9165-4279-b943-9edf720fdede tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:05.075980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9877d800-9165-4279-b943-9edf720fdede tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:05.082781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9877d800-9165-4279-b943-9edf720fdede tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:05.083272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9877d800-9165-4279-b943-9edf720fdede tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:05.083708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9877d800-9165-4279-b943-9edf720fdede tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:05.084423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9877d800-9165-4279-b943-9edf720fdede tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:05.084956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9877d800-9165-4279-b943-9edf720fdede tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:05.085412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9877d800-9165-4279-b943-9edf720fdede tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:05.148631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9877d800-9165-4279-b943-9edf720fdede tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:05.157147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9877d800-9165-4279-b943-9edf720fdede tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085634 Aug 24 05:27:05.157786 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1468/2823] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:05.370219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9bb787e8-8426-4006-96e4-c4df71401679 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:05.370765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9bb787e8-8426-4006-96e4-c4df71401679 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:05.376966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bb787e8-8426-4006-96e4-c4df71401679 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:05.377451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bb787e8-8426-4006-96e4-c4df71401679 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:05.377889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bb787e8-8426-4006-96e4-c4df71401679 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:05.378580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bb787e8-8426-4006-96e4-c4df71401679 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:05.379066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bb787e8-8426-4006-96e4-c4df71401679 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:05.379491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bb787e8-8426-4006-96e4-c4df71401679 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:05.442811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9bb787e8-8426-4006-96e4-c4df71401679 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:05.451899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9bb787e8-8426-4006-96e4-c4df71401679 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086395 Aug 24 05:27:05.452474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1356/2824] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:06.054537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-49c6b978-d83b-487a-b5c8-51d0f39ce053 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:06.055182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-49c6b978-d83b-487a-b5c8-51d0f39ce053 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:06.061582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49c6b978-d83b-487a-b5c8-51d0f39ce053 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:06.062062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49c6b978-d83b-487a-b5c8-51d0f39ce053 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:06.062492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49c6b978-d83b-487a-b5c8-51d0f39ce053 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:06.063201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49c6b978-d83b-487a-b5c8-51d0f39ce053 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:06.063647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49c6b978-d83b-487a-b5c8-51d0f39ce053 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:06.064062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49c6b978-d83b-487a-b5c8-51d0f39ce053 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:06.127660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-49c6b978-d83b-487a-b5c8-51d0f39ce053 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:06.136608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-49c6b978-d83b-487a-b5c8-51d0f39ce053 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086904 Aug 24 05:27:06.137189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1469/2825] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:06.179890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ec4ab16e-0c20-496a-9678-8dddd3127437 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:06.180531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ec4ab16e-0c20-496a-9678-8dddd3127437 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:06.188090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec4ab16e-0c20-496a-9678-8dddd3127437 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:06.188570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec4ab16e-0c20-496a-9678-8dddd3127437 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:06.189006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec4ab16e-0c20-496a-9678-8dddd3127437 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:06.189694 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec4ab16e-0c20-496a-9678-8dddd3127437 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:06.190137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec4ab16e-0c20-496a-9678-8dddd3127437 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:06.190554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec4ab16e-0c20-496a-9678-8dddd3127437 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:06.264191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ec4ab16e-0c20-496a-9678-8dddd3127437 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:06.272852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ec4ab16e-0c20-496a-9678-8dddd3127437 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.097794 Aug 24 05:27:06.273430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1357/2826] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:06.473223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f21220cd-0600-4cbe-88d6-be05483cd842 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:06.473835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f21220cd-0600-4cbe-88d6-be05483cd842 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:06.480513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21220cd-0600-4cbe-88d6-be05483cd842 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:06.480995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21220cd-0600-4cbe-88d6-be05483cd842 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:06.481431 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21220cd-0600-4cbe-88d6-be05483cd842 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:06.482130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21220cd-0600-4cbe-88d6-be05483cd842 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:06.482574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21220cd-0600-4cbe-88d6-be05483cd842 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:06.483021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f21220cd-0600-4cbe-88d6-be05483cd842 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:06.550216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f21220cd-0600-4cbe-88d6-be05483cd842 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:06.559621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f21220cd-0600-4cbe-88d6-be05483cd842 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090207 Aug 24 05:27:06.560419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1470/2827] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:07.157740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6406851c-1569-4102-b1ca-ee8015ff9365 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:07.158269 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6406851c-1569-4102-b1ca-ee8015ff9365 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:07.164586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6406851c-1569-4102-b1ca-ee8015ff9365 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:07.165065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6406851c-1569-4102-b1ca-ee8015ff9365 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:07.165500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6406851c-1569-4102-b1ca-ee8015ff9365 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:07.166194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6406851c-1569-4102-b1ca-ee8015ff9365 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:07.166649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6406851c-1569-4102-b1ca-ee8015ff9365 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:07.167105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6406851c-1569-4102-b1ca-ee8015ff9365 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:07.233118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6406851c-1569-4102-b1ca-ee8015ff9365 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:07.242177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6406851c-1569-4102-b1ca-ee8015ff9365 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088475 Aug 24 05:27:07.242756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1358/2828] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:07.306318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e5fff5bc-65ad-43c1-9edc-b03e4e4e4773 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:07.307000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e5fff5bc-65ad-43c1-9edc-b03e4e4e4773 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:07.313692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5fff5bc-65ad-43c1-9edc-b03e4e4e4773 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:07.314172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5fff5bc-65ad-43c1-9edc-b03e4e4e4773 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:07.314608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5fff5bc-65ad-43c1-9edc-b03e4e4e4773 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:07.315325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5fff5bc-65ad-43c1-9edc-b03e4e4e4773 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:07.315779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5fff5bc-65ad-43c1-9edc-b03e4e4e4773 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:07.316203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5fff5bc-65ad-43c1-9edc-b03e4e4e4773 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:07.381880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e5fff5bc-65ad-43c1-9edc-b03e4e4e4773 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:07.390500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e5fff5bc-65ad-43c1-9edc-b03e4e4e4773 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089010 Aug 24 05:27:07.391107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1471/2829] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:07.580806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-225baa99-fdd9-42d2-af18-fe712ce46355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:07.581443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-225baa99-fdd9-42d2-af18-fe712ce46355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:07.588013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-225baa99-fdd9-42d2-af18-fe712ce46355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:07.588491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-225baa99-fdd9-42d2-af18-fe712ce46355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:07.588925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-225baa99-fdd9-42d2-af18-fe712ce46355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:07.589606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-225baa99-fdd9-42d2-af18-fe712ce46355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:07.590054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-225baa99-fdd9-42d2-af18-fe712ce46355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:07.590471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-225baa99-fdd9-42d2-af18-fe712ce46355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:07.652947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-225baa99-fdd9-42d2-af18-fe712ce46355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:07.661296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-225baa99-fdd9-42d2-af18-fe712ce46355 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084378 Aug 24 05:27:07.662059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1359/2830] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:08.263300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f636a328-217f-4dcc-8915-aa863ea51025 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:08.263912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f636a328-217f-4dcc-8915-aa863ea51025 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:08.269871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f636a328-217f-4dcc-8915-aa863ea51025 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:08.270345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f636a328-217f-4dcc-8915-aa863ea51025 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:08.270801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f636a328-217f-4dcc-8915-aa863ea51025 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:08.271521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f636a328-217f-4dcc-8915-aa863ea51025 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:08.272085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f636a328-217f-4dcc-8915-aa863ea51025 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:08.272508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f636a328-217f-4dcc-8915-aa863ea51025 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:08.337829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f636a328-217f-4dcc-8915-aa863ea51025 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:08.346274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f636a328-217f-4dcc-8915-aa863ea51025 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086819 Aug 24 05:27:08.346866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1472/2831] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:08 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:08.412806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f63f2b33-9c3a-4c89-89b0-0ce08cb0c3f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:08.413413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f63f2b33-9c3a-4c89-89b0-0ce08cb0c3f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:08.419983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f63f2b33-9c3a-4c89-89b0-0ce08cb0c3f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:08.420465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f63f2b33-9c3a-4c89-89b0-0ce08cb0c3f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:08.420969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f63f2b33-9c3a-4c89-89b0-0ce08cb0c3f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:08.421706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f63f2b33-9c3a-4c89-89b0-0ce08cb0c3f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:08.422159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f63f2b33-9c3a-4c89-89b0-0ce08cb0c3f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:08.422579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f63f2b33-9c3a-4c89-89b0-0ce08cb0c3f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:08.488240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f63f2b33-9c3a-4c89-89b0-0ce08cb0c3f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:08.503563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f63f2b33-9c3a-4c89-89b0-0ce08cb0c3f8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094368 Aug 24 05:27:08.504561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1360/2832] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:08.684202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-068168a8-2ac0-4b66-96d9-46866659a51f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:08.684727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-068168a8-2ac0-4b66-96d9-46866659a51f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:08.690801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068168a8-2ac0-4b66-96d9-46866659a51f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:08.691291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068168a8-2ac0-4b66-96d9-46866659a51f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:08.691726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068168a8-2ac0-4b66-96d9-46866659a51f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:08.692426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068168a8-2ac0-4b66-96d9-46866659a51f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:08.692878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068168a8-2ac0-4b66-96d9-46866659a51f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:08.693361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-068168a8-2ac0-4b66-96d9-46866659a51f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:08.756713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-068168a8-2ac0-4b66-96d9-46866659a51f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:08.765007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-068168a8-2ac0-4b66-96d9-46866659a51f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084990 Aug 24 05:27:08.765584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1473/2833] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:09.367447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-96f8985e-2f96-4aac-91d4-1024c27e4d94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:09.368057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-96f8985e-2f96-4aac-91d4-1024c27e4d94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:09.374004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-96f8985e-2f96-4aac-91d4-1024c27e4d94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:09.374485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-96f8985e-2f96-4aac-91d4-1024c27e4d94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:09.374959 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-96f8985e-2f96-4aac-91d4-1024c27e4d94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:09.375639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-96f8985e-2f96-4aac-91d4-1024c27e4d94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:09.376090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-96f8985e-2f96-4aac-91d4-1024c27e4d94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:09.376513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-96f8985e-2f96-4aac-91d4-1024c27e4d94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:09.440667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-96f8985e-2f96-4aac-91d4-1024c27e4d94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:09.449519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-96f8985e-2f96-4aac-91d4-1024c27e4d94 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086149 Aug 24 05:27:09.450096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1361/2834] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:09.532008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-acd1b8a5-d825-488c-9090-62af1564b538 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:09.532915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-acd1b8a5-d825-488c-9090-62af1564b538 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:09.539888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-acd1b8a5-d825-488c-9090-62af1564b538 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:09.540360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-acd1b8a5-d825-488c-9090-62af1564b538 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:09.540814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-acd1b8a5-d825-488c-9090-62af1564b538 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:09.541495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-acd1b8a5-d825-488c-9090-62af1564b538 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:09.541935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-acd1b8a5-d825-488c-9090-62af1564b538 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:09.542344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-acd1b8a5-d825-488c-9090-62af1564b538 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:09.609558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-acd1b8a5-d825-488c-9090-62af1564b538 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:09.618299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-acd1b8a5-d825-488c-9090-62af1564b538 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092564 Aug 24 05:27:09.618778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1474/2835] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:09.785834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-643d9f75-e290-46cd-9462-17cd762859f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:09.786449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-643d9f75-e290-46cd-9462-17cd762859f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:09.792934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643d9f75-e290-46cd-9462-17cd762859f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:09.793419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643d9f75-e290-46cd-9462-17cd762859f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:09.793866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643d9f75-e290-46cd-9462-17cd762859f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:09.794557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643d9f75-e290-46cd-9462-17cd762859f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:09.795037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643d9f75-e290-46cd-9462-17cd762859f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:09.795466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-643d9f75-e290-46cd-9462-17cd762859f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:09.858733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-643d9f75-e290-46cd-9462-17cd762859f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:09.867601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-643d9f75-e290-46cd-9462-17cd762859f7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085796 Aug 24 05:27:09.868163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1362/2836] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:10.471324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-545122ed-4a1e-498b-9fc8-11e151fa3909 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:10.471928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-545122ed-4a1e-498b-9fc8-11e151fa3909 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:10.478816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-545122ed-4a1e-498b-9fc8-11e151fa3909 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:10.479298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-545122ed-4a1e-498b-9fc8-11e151fa3909 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:10.479768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-545122ed-4a1e-498b-9fc8-11e151fa3909 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:10.480488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-545122ed-4a1e-498b-9fc8-11e151fa3909 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:10.480942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-545122ed-4a1e-498b-9fc8-11e151fa3909 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:10.481368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-545122ed-4a1e-498b-9fc8-11e151fa3909 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:10.545184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-545122ed-4a1e-498b-9fc8-11e151fa3909 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:10.553542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-545122ed-4a1e-498b-9fc8-11e151fa3909 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086156 Aug 24 05:27:10.554112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1475/2837] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:10.639424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ae19f757-776c-42be-81f8-ed5de41a83df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:10.640027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ae19f757-776c-42be-81f8-ed5de41a83df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:10.647126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae19f757-776c-42be-81f8-ed5de41a83df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:10.647632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae19f757-776c-42be-81f8-ed5de41a83df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:10.648062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae19f757-776c-42be-81f8-ed5de41a83df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:10.648737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae19f757-776c-42be-81f8-ed5de41a83df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:10.649188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae19f757-776c-42be-81f8-ed5de41a83df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:10.649608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae19f757-776c-42be-81f8-ed5de41a83df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:10.711916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ae19f757-776c-42be-81f8-ed5de41a83df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:10.720232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ae19f757-776c-42be-81f8-ed5de41a83df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.084663 Aug 24 05:27:10.720800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1363/2838] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:10.889273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e940702b-2d1d-4322-a0c6-1afc413d0603 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:10.889886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e940702b-2d1d-4322-a0c6-1afc413d0603 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:10.896025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e940702b-2d1d-4322-a0c6-1afc413d0603 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:10.897090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e940702b-2d1d-4322-a0c6-1afc413d0603 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:10.897626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e940702b-2d1d-4322-a0c6-1afc413d0603 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:10.898322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e940702b-2d1d-4322-a0c6-1afc413d0603 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:10.898818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e940702b-2d1d-4322-a0c6-1afc413d0603 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:10.899244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e940702b-2d1d-4322-a0c6-1afc413d0603 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:10.965352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e940702b-2d1d-4322-a0c6-1afc413d0603 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:10.973915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e940702b-2d1d-4322-a0c6-1afc413d0603 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088531 Aug 24 05:27:10.974519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1476/2839] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:11.575473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c3c0edd0-3b45-428f-8859-43e2d3e8cf07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:11.576080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c3c0edd0-3b45-428f-8859-43e2d3e8cf07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:11.582150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3c0edd0-3b45-428f-8859-43e2d3e8cf07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:11.582633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3c0edd0-3b45-428f-8859-43e2d3e8cf07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:11.583092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3c0edd0-3b45-428f-8859-43e2d3e8cf07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:11.583839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3c0edd0-3b45-428f-8859-43e2d3e8cf07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:11.584440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3c0edd0-3b45-428f-8859-43e2d3e8cf07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:11.584876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c3c0edd0-3b45-428f-8859-43e2d3e8cf07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:11.647709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c3c0edd0-3b45-428f-8859-43e2d3e8cf07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:11.655884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c3c0edd0-3b45-428f-8859-43e2d3e8cf07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084304 Aug 24 05:27:11.656447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1364/2840] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:11.742111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-69e4e07e-de2d-4391-8c07-bd9dfe1ca44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:11.742756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-69e4e07e-de2d-4391-8c07-bd9dfe1ca44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:11.749227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e4e07e-de2d-4391-8c07-bd9dfe1ca44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:11.749710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e4e07e-de2d-4391-8c07-bd9dfe1ca44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:11.750147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e4e07e-de2d-4391-8c07-bd9dfe1ca44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:11.750868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e4e07e-de2d-4391-8c07-bd9dfe1ca44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:11.751323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e4e07e-de2d-4391-8c07-bd9dfe1ca44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:11.751746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-69e4e07e-de2d-4391-8c07-bd9dfe1ca44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:11.815567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-69e4e07e-de2d-4391-8c07-bd9dfe1ca44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:11.824034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-69e4e07e-de2d-4391-8c07-bd9dfe1ca44c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086418 Aug 24 05:27:11.824644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1477/2841] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:11.994987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ec9a31e3-edd7-4820-a6ed-b3168471a0b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:11.995503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ec9a31e3-edd7-4820-a6ed-b3168471a0b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:12.001487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec9a31e3-edd7-4820-a6ed-b3168471a0b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:12.001961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec9a31e3-edd7-4820-a6ed-b3168471a0b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:12.002384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec9a31e3-edd7-4820-a6ed-b3168471a0b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:12.003081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec9a31e3-edd7-4820-a6ed-b3168471a0b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:12.003526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec9a31e3-edd7-4820-a6ed-b3168471a0b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:12.003941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ec9a31e3-edd7-4820-a6ed-b3168471a0b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:12.010089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:12.077737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ec9a31e3-edd7-4820-a6ed-b3168471a0b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:12.086559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ec9a31e3-edd7-4820-a6ed-b3168471a0b6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095729 Aug 24 05:27:12.087209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1365/2842] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:12.677265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1ab7eb99-8ebc-4b9e-9fa7-963e970475af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:12.678059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1ab7eb99-8ebc-4b9e-9fa7-963e970475af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:12.684518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab7eb99-8ebc-4b9e-9fa7-963e970475af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:12.684996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab7eb99-8ebc-4b9e-9fa7-963e970475af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:12.685427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab7eb99-8ebc-4b9e-9fa7-963e970475af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:12.686111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab7eb99-8ebc-4b9e-9fa7-963e970475af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:12.686554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab7eb99-8ebc-4b9e-9fa7-963e970475af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:12.687000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1ab7eb99-8ebc-4b9e-9fa7-963e970475af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:12.753490 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1ab7eb99-8ebc-4b9e-9fa7-963e970475af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:12.762586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1ab7eb99-8ebc-4b9e-9fa7-963e970475af tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089249 Aug 24 05:27:12.763208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1478/2843] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:12.843981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0bdc3fc3-bf00-4410-bcea-00cca88ccc3e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:12.844577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0bdc3fc3-bf00-4410-bcea-00cca88ccc3e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:12.851375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bdc3fc3-bf00-4410-bcea-00cca88ccc3e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:12.851862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bdc3fc3-bf00-4410-bcea-00cca88ccc3e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:12.852298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bdc3fc3-bf00-4410-bcea-00cca88ccc3e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:12.852994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bdc3fc3-bf00-4410-bcea-00cca88ccc3e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:12.853447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bdc3fc3-bf00-4410-bcea-00cca88ccc3e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:12.853869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0bdc3fc3-bf00-4410-bcea-00cca88ccc3e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:12.918504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0bdc3fc3-bf00-4410-bcea-00cca88ccc3e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:12.927081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0bdc3fc3-bf00-4410-bcea-00cca88ccc3e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086916 Aug 24 05:27:12.927792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1366/2844] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:13.107646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-212b1789-6ea5-4a5a-8521-0186c3d98175 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:13.108253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-212b1789-6ea5-4a5a-8521-0186c3d98175 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:13.114281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-212b1789-6ea5-4a5a-8521-0186c3d98175 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:13.114794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-212b1789-6ea5-4a5a-8521-0186c3d98175 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:13.115325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-212b1789-6ea5-4a5a-8521-0186c3d98175 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:13.116020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-212b1789-6ea5-4a5a-8521-0186c3d98175 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:13.116478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-212b1789-6ea5-4a5a-8521-0186c3d98175 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:13.116898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-212b1789-6ea5-4a5a-8521-0186c3d98175 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:13.179888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-212b1789-6ea5-4a5a-8521-0186c3d98175 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:13.188484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-212b1789-6ea5-4a5a-8521-0186c3d98175 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084702 Aug 24 05:27:13.189054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1479/2845] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:13 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:13.783921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-699902f9-e9e6-4ee0-8294-829589c53fb7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:13.784550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-699902f9-e9e6-4ee0-8294-829589c53fb7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:13.791027 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-699902f9-e9e6-4ee0-8294-829589c53fb7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:13.791512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-699902f9-e9e6-4ee0-8294-829589c53fb7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:13.791948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-699902f9-e9e6-4ee0-8294-829589c53fb7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:13.792630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-699902f9-e9e6-4ee0-8294-829589c53fb7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:13.793083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-699902f9-e9e6-4ee0-8294-829589c53fb7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:13.793558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-699902f9-e9e6-4ee0-8294-829589c53fb7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:13.857654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-699902f9-e9e6-4ee0-8294-829589c53fb7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:13.866716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-699902f9-e9e6-4ee0-8294-829589c53fb7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086463 Aug 24 05:27:13.867281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1367/2846] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:13.947961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-28e8d3e5-c37b-46fa-ad5c-c5e03470ddea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:13.948570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-28e8d3e5-c37b-46fa-ad5c-c5e03470ddea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:13.955177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28e8d3e5-c37b-46fa-ad5c-c5e03470ddea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:13.955650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28e8d3e5-c37b-46fa-ad5c-c5e03470ddea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:13.956075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28e8d3e5-c37b-46fa-ad5c-c5e03470ddea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:13.956744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28e8d3e5-c37b-46fa-ad5c-c5e03470ddea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:13.957183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28e8d3e5-c37b-46fa-ad5c-c5e03470ddea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:13.957594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28e8d3e5-c37b-46fa-ad5c-c5e03470ddea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:14.020479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-28e8d3e5-c37b-46fa-ad5c-c5e03470ddea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:14.028636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-28e8d3e5-c37b-46fa-ad5c-c5e03470ddea tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.084578 Aug 24 05:27:14.029194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1480/2847] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:14.210785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f190b10c-79fd-4556-b5b0-4ed494e0df7a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:14.211386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f190b10c-79fd-4556-b5b0-4ed494e0df7a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:14.217429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f190b10c-79fd-4556-b5b0-4ed494e0df7a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:14.217900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f190b10c-79fd-4556-b5b0-4ed494e0df7a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:14.218328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f190b10c-79fd-4556-b5b0-4ed494e0df7a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:14.219039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f190b10c-79fd-4556-b5b0-4ed494e0df7a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:14.219482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f190b10c-79fd-4556-b5b0-4ed494e0df7a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:14.219895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f190b10c-79fd-4556-b5b0-4ed494e0df7a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:14.283960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f190b10c-79fd-4556-b5b0-4ed494e0df7a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:14.292571 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f190b10c-79fd-4556-b5b0-4ed494e0df7a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086528 Aug 24 05:27:14.293137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1368/2848] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:14.889170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-99f60be0-32ac-4b17-a4b5-4d39523e952a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:14.889784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-99f60be0-32ac-4b17-a4b5-4d39523e952a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:14.895869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-99f60be0-32ac-4b17-a4b5-4d39523e952a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:14.896981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-99f60be0-32ac-4b17-a4b5-4d39523e952a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:14.897423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-99f60be0-32ac-4b17-a4b5-4d39523e952a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:14.898111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-99f60be0-32ac-4b17-a4b5-4d39523e952a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:14.898567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-99f60be0-32ac-4b17-a4b5-4d39523e952a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:14.899017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-99f60be0-32ac-4b17-a4b5-4d39523e952a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:14.962641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-99f60be0-32ac-4b17-a4b5-4d39523e952a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:14.971890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-99f60be0-32ac-4b17-a4b5-4d39523e952a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086576 Aug 24 05:27:14.972460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1481/2849] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:15.049562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0a8dafd5-72f9-4e48-a63c-133b28fdce20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:15.050135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0a8dafd5-72f9-4e48-a63c-133b28fdce20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:15.057490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a8dafd5-72f9-4e48-a63c-133b28fdce20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:15.057977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a8dafd5-72f9-4e48-a63c-133b28fdce20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:15.058423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a8dafd5-72f9-4e48-a63c-133b28fdce20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:15.059147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a8dafd5-72f9-4e48-a63c-133b28fdce20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:15.059600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a8dafd5-72f9-4e48-a63c-133b28fdce20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:15.060020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a8dafd5-72f9-4e48-a63c-133b28fdce20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:15.129567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0a8dafd5-72f9-4e48-a63c-133b28fdce20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:15.138890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0a8dafd5-72f9-4e48-a63c-133b28fdce20 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093417 Aug 24 05:27:15.139461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1369/2850] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:15.314527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-53921fec-3693-42f9-879c-544c3822f87d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:15.315087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-53921fec-3693-42f9-879c-544c3822f87d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:15.321894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53921fec-3693-42f9-879c-544c3822f87d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:15.322381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53921fec-3693-42f9-879c-544c3822f87d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:15.322865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53921fec-3693-42f9-879c-544c3822f87d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:15.323556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53921fec-3693-42f9-879c-544c3822f87d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:15.324008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53921fec-3693-42f9-879c-544c3822f87d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:15.324432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53921fec-3693-42f9-879c-544c3822f87d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:15.388737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-53921fec-3693-42f9-879c-544c3822f87d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:15.397357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-53921fec-3693-42f9-879c-544c3822f87d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086877 Aug 24 05:27:15.397941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1482/2851] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:15.992016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d4ff5c52-4650-4da3-a59e-8538e95220f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:15.992544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d4ff5c52-4650-4da3-a59e-8538e95220f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:15.998667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4ff5c52-4650-4da3-a59e-8538e95220f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:15.999172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4ff5c52-4650-4da3-a59e-8538e95220f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:15.999736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4ff5c52-4650-4da3-a59e-8538e95220f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:16.000459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4ff5c52-4650-4da3-a59e-8538e95220f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:16.000930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4ff5c52-4650-4da3-a59e-8538e95220f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:16.001362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d4ff5c52-4650-4da3-a59e-8538e95220f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:16.065691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d4ff5c52-4650-4da3-a59e-8538e95220f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:16.074192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d4ff5c52-4650-4da3-a59e-8538e95220f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086149 Aug 24 05:27:16.074778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1370/2852] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:16.159361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-482cd0fe-a27c-4147-b559-b21e98ab0c8a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:16.159960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-482cd0fe-a27c-4147-b559-b21e98ab0c8a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:16.166786 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-482cd0fe-a27c-4147-b559-b21e98ab0c8a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:16.167271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-482cd0fe-a27c-4147-b559-b21e98ab0c8a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:16.167708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-482cd0fe-a27c-4147-b559-b21e98ab0c8a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:16.168393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-482cd0fe-a27c-4147-b559-b21e98ab0c8a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:16.168843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-482cd0fe-a27c-4147-b559-b21e98ab0c8a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:16.169264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-482cd0fe-a27c-4147-b559-b21e98ab0c8a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:16.184830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:16.232542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-482cd0fe-a27c-4147-b559-b21e98ab0c8a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:16.241066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-482cd0fe-a27c-4147-b559-b21e98ab0c8a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085557 Aug 24 05:27:16.241634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1483/2853] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:16.422629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e626c040-2915-4b59-859d-8c02eb57893e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:16.423692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e626c040-2915-4b59-859d-8c02eb57893e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:16.435104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e626c040-2915-4b59-859d-8c02eb57893e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:16.435961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e626c040-2915-4b59-859d-8c02eb57893e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:16.436747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e626c040-2915-4b59-859d-8c02eb57893e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:16.437972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e626c040-2915-4b59-859d-8c02eb57893e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:16.438841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e626c040-2915-4b59-859d-8c02eb57893e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:16.439612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e626c040-2915-4b59-859d-8c02eb57893e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:16.504776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e626c040-2915-4b59-859d-8c02eb57893e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:16.513710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e626c040-2915-4b59-859d-8c02eb57893e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.098696 Aug 24 05:27:16.514279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1371/2854] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:16 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:17.095192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4e9170fe-2675-4951-8c3a-9f7e7a4a9aca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:17.095708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4e9170fe-2675-4951-8c3a-9f7e7a4a9aca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:17.102470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e9170fe-2675-4951-8c3a-9f7e7a4a9aca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.102980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e9170fe-2675-4951-8c3a-9f7e7a4a9aca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.103418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e9170fe-2675-4951-8c3a-9f7e7a4a9aca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.104107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e9170fe-2675-4951-8c3a-9f7e7a4a9aca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.104564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e9170fe-2675-4951-8c3a-9f7e7a4a9aca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.104991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4e9170fe-2675-4951-8c3a-9f7e7a4a9aca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.168376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4e9170fe-2675-4951-8c3a-9f7e7a4a9aca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:17.176547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4e9170fe-2675-4951-8c3a-9f7e7a4a9aca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085569 Aug 24 05:27:17.177113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1484/2855] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:17.262333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-17c0cf53-4bce-4157-8cdf-076a200b9fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:17.262966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-17c0cf53-4bce-4157-8cdf-076a200b9fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:17.269429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17c0cf53-4bce-4157-8cdf-076a200b9fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.269905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17c0cf53-4bce-4157-8cdf-076a200b9fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.270333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17c0cf53-4bce-4157-8cdf-076a200b9fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.271301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17c0cf53-4bce-4157-8cdf-076a200b9fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.271776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17c0cf53-4bce-4157-8cdf-076a200b9fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.272197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-17c0cf53-4bce-4157-8cdf-076a200b9fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.336016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-17c0cf53-4bce-4157-8cdf-076a200b9fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:17.343995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-17c0cf53-4bce-4157-8cdf-076a200b9fb5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085502 Aug 24 05:27:17.344559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1372/2856] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:17 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:17.534796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4b3aeaf9-2d24-4910-9c0a-c35e3b4b8b33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:17.535416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4b3aeaf9-2d24-4910-9c0a-c35e3b4b8b33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:17.541990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b3aeaf9-2d24-4910-9c0a-c35e3b4b8b33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.542469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b3aeaf9-2d24-4910-9c0a-c35e3b4b8b33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.542943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b3aeaf9-2d24-4910-9c0a-c35e3b4b8b33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.543627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b3aeaf9-2d24-4910-9c0a-c35e3b4b8b33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:17.544082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b3aeaf9-2d24-4910-9c0a-c35e3b4b8b33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:17.544504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4b3aeaf9-2d24-4910-9c0a-c35e3b4b8b33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:17.605482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4b3aeaf9-2d24-4910-9c0a-c35e3b4b8b33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:17.613630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4b3aeaf9-2d24-4910-9c0a-c35e3b4b8b33 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.082782 Aug 24 05:27:17.614193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1485/2857] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:18.198510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-97b89c1c-ee82-423e-a51a-fd237c7f32a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:18.199061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-97b89c1c-ee82-423e-a51a-fd237c7f32a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:18.205107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b89c1c-ee82-423e-a51a-fd237c7f32a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:18.205585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b89c1c-ee82-423e-a51a-fd237c7f32a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:18.206018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b89c1c-ee82-423e-a51a-fd237c7f32a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:18.206719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b89c1c-ee82-423e-a51a-fd237c7f32a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:18.207170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b89c1c-ee82-423e-a51a-fd237c7f32a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:18.207590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b89c1c-ee82-423e-a51a-fd237c7f32a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:18.272232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-97b89c1c-ee82-423e-a51a-fd237c7f32a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:18.280507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-97b89c1c-ee82-423e-a51a-fd237c7f32a9 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086105 Aug 24 05:27:18.281127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1373/2858] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:18 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:18.365218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dd9d1418-db9e-49a2-9c30-a3ac85e0e0b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:18.365980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dd9d1418-db9e-49a2-9c30-a3ac85e0e0b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:18.372601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9d1418-db9e-49a2-9c30-a3ac85e0e0b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:18.373078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9d1418-db9e-49a2-9c30-a3ac85e0e0b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:18.373506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9d1418-db9e-49a2-9c30-a3ac85e0e0b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:18.374211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9d1418-db9e-49a2-9c30-a3ac85e0e0b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:18.374646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9d1418-db9e-49a2-9c30-a3ac85e0e0b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:18.375092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dd9d1418-db9e-49a2-9c30-a3ac85e0e0b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:18.439736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dd9d1418-db9e-49a2-9c30-a3ac85e0e0b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:18.448822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dd9d1418-db9e-49a2-9c30-a3ac85e0e0b3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087400 Aug 24 05:27:18.449327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1486/2859] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:18.635184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fa194285-a599-4f05-a79c-190f75537688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:18.635798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fa194285-a599-4f05-a79c-190f75537688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:18.637664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=82 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:18.643021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa194285-a599-4f05-a79c-190f75537688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:18.643505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa194285-a599-4f05-a79c-190f75537688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:18.643941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa194285-a599-4f05-a79c-190f75537688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:18.644647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa194285-a599-4f05-a79c-190f75537688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:18.645086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa194285-a599-4f05-a79c-190f75537688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:18.645513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa194285-a599-4f05-a79c-190f75537688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:18.710922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fa194285-a599-4f05-a79c-190f75537688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:18.719092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fa194285-a599-4f05-a79c-190f75537688 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087969 Aug 24 05:27:18.722969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1374/2860] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:19.301732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-973a43c7-583c-4d76-bac1-8e3716608346 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:19.303042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-973a43c7-583c-4d76-bac1-8e3716608346 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:19.309734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-973a43c7-583c-4d76-bac1-8e3716608346 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:19.310210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-973a43c7-583c-4d76-bac1-8e3716608346 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:19.310645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-973a43c7-583c-4d76-bac1-8e3716608346 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:19.311348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-973a43c7-583c-4d76-bac1-8e3716608346 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:19.311839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-973a43c7-583c-4d76-bac1-8e3716608346 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:19.312259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-973a43c7-583c-4d76-bac1-8e3716608346 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:19.377237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-973a43c7-583c-4d76-bac1-8e3716608346 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:19.386375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-973a43c7-583c-4d76-bac1-8e3716608346 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088666 Aug 24 05:27:19.386999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1487/2861] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:19.469514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-440e5bae-e660-48b9-b1ca-c0beffdba784 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:19.470206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-440e5bae-e660-48b9-b1ca-c0beffdba784 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:19.476731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-440e5bae-e660-48b9-b1ca-c0beffdba784 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:19.477210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-440e5bae-e660-48b9-b1ca-c0beffdba784 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:19.477642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-440e5bae-e660-48b9-b1ca-c0beffdba784 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:19.478335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-440e5bae-e660-48b9-b1ca-c0beffdba784 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:19.478789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-440e5bae-e660-48b9-b1ca-c0beffdba784 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:19.479203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-440e5bae-e660-48b9-b1ca-c0beffdba784 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:19.544657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-440e5bae-e660-48b9-b1ca-c0beffdba784 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:19.553642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-440e5bae-e660-48b9-b1ca-c0beffdba784 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087977 Aug 24 05:27:19.554145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1375/2862] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:19.743883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8cfc8857-9da9-45cd-815e-fb9f7b410a39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:19.744498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8cfc8857-9da9-45cd-815e-fb9f7b410a39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:19.750513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cfc8857-9da9-45cd-815e-fb9f7b410a39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:19.751413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cfc8857-9da9-45cd-815e-fb9f7b410a39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:19.752020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cfc8857-9da9-45cd-815e-fb9f7b410a39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:19.752719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cfc8857-9da9-45cd-815e-fb9f7b410a39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:19.753170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cfc8857-9da9-45cd-815e-fb9f7b410a39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:19.753592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8cfc8857-9da9-45cd-815e-fb9f7b410a39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:19.816732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8cfc8857-9da9-45cd-815e-fb9f7b410a39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:19.825632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8cfc8857-9da9-45cd-815e-fb9f7b410a39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086550 Aug 24 05:27:19.826197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1488/2863] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:20.406497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c15dfaa9-040d-4282-9cf6-58ea7529a9b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:20.407134 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c15dfaa9-040d-4282-9cf6-58ea7529a9b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:20.413501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c15dfaa9-040d-4282-9cf6-58ea7529a9b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:20.413984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c15dfaa9-040d-4282-9cf6-58ea7529a9b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:20.414427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c15dfaa9-040d-4282-9cf6-58ea7529a9b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:20.415167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c15dfaa9-040d-4282-9cf6-58ea7529a9b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:20.415623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c15dfaa9-040d-4282-9cf6-58ea7529a9b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:20.416063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c15dfaa9-040d-4282-9cf6-58ea7529a9b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:20.482972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c15dfaa9-040d-4282-9cf6-58ea7529a9b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:20.491517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c15dfaa9-040d-4282-9cf6-58ea7529a9b1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088926 Aug 24 05:27:20.492088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1376/2864] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:20.574199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8c246cc2-0538-438f-9321-1a9eb81231af tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:20.574859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8c246cc2-0538-438f-9321-1a9eb81231af tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:20.581276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c246cc2-0538-438f-9321-1a9eb81231af tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:20.581752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c246cc2-0538-438f-9321-1a9eb81231af tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:20.582186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c246cc2-0538-438f-9321-1a9eb81231af tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:20.582908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c246cc2-0538-438f-9321-1a9eb81231af tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:20.583357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c246cc2-0538-438f-9321-1a9eb81231af tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:20.584370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c246cc2-0538-438f-9321-1a9eb81231af tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:20.648009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8c246cc2-0538-438f-9321-1a9eb81231af tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:20.656304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8c246cc2-0538-438f-9321-1a9eb81231af tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085978 Aug 24 05:27:20.656935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1489/2865] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:20.847394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ea7dfcb1-2b3e-4aea-a8e0-017706855d51 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:20.847995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ea7dfcb1-2b3e-4aea-a8e0-017706855d51 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:20.855055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea7dfcb1-2b3e-4aea-a8e0-017706855d51 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:20.855537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea7dfcb1-2b3e-4aea-a8e0-017706855d51 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:20.855968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea7dfcb1-2b3e-4aea-a8e0-017706855d51 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:20.856650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea7dfcb1-2b3e-4aea-a8e0-017706855d51 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:20.857096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea7dfcb1-2b3e-4aea-a8e0-017706855d51 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:20.857511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea7dfcb1-2b3e-4aea-a8e0-017706855d51 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:20.922647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ea7dfcb1-2b3e-4aea-a8e0-017706855d51 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:20.931623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ea7dfcb1-2b3e-4aea-a8e0-017706855d51 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087824 Aug 24 05:27:20.932185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1377/2866] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:21.512873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b4009868-64c2-4f87-9cf1-1746371e2c3b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:21.513472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b4009868-64c2-4f87-9cf1-1746371e2c3b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:21.519435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b4009868-64c2-4f87-9cf1-1746371e2c3b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:21.519964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b4009868-64c2-4f87-9cf1-1746371e2c3b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:21.520395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b4009868-64c2-4f87-9cf1-1746371e2c3b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:21.521109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b4009868-64c2-4f87-9cf1-1746371e2c3b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:21.521862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b4009868-64c2-4f87-9cf1-1746371e2c3b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:21.522284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b4009868-64c2-4f87-9cf1-1746371e2c3b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:21.594492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b4009868-64c2-4f87-9cf1-1746371e2c3b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:21.602905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b4009868-64c2-4f87-9cf1-1746371e2c3b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093785 Aug 24 05:27:21.603493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1490/2867] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:21.676993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fdb2c5e4-ec5b-47b9-bd16-5a50ffad9afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:21.678140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fdb2c5e4-ec5b-47b9-bd16-5a50ffad9afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:21.685112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdb2c5e4-ec5b-47b9-bd16-5a50ffad9afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:21.685583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdb2c5e4-ec5b-47b9-bd16-5a50ffad9afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:21.686018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdb2c5e4-ec5b-47b9-bd16-5a50ffad9afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:21.686699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdb2c5e4-ec5b-47b9-bd16-5a50ffad9afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:21.687149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdb2c5e4-ec5b-47b9-bd16-5a50ffad9afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:21.687608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fdb2c5e4-ec5b-47b9-bd16-5a50ffad9afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:21.751428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fdb2c5e4-ec5b-47b9-bd16-5a50ffad9afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:21.760677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fdb2c5e4-ec5b-47b9-bd16-5a50ffad9afe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087542 Aug 24 05:27:21.761258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1378/2868] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:21.952514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c5d0a26a-b6db-41ca-b224-1783f0873a7b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:21.953115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c5d0a26a-b6db-41ca-b224-1783f0873a7b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:21.959537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5d0a26a-b6db-41ca-b224-1783f0873a7b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:21.960022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5d0a26a-b6db-41ca-b224-1783f0873a7b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:21.960451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5d0a26a-b6db-41ca-b224-1783f0873a7b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:21.961132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5d0a26a-b6db-41ca-b224-1783f0873a7b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:21.961577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5d0a26a-b6db-41ca-b224-1783f0873a7b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:21.961993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5d0a26a-b6db-41ca-b224-1783f0873a7b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:22.030781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c5d0a26a-b6db-41ca-b224-1783f0873a7b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:22.040028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c5d0a26a-b6db-41ca-b224-1783f0873a7b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091457 Aug 24 05:27:22.040608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1491/2869] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:22.624016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c99d564c-46c7-41b0-89aa-34711d14484e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:22.624628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c99d564c-46c7-41b0-89aa-34711d14484e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:22.631282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c99d564c-46c7-41b0-89aa-34711d14484e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:22.631790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c99d564c-46c7-41b0-89aa-34711d14484e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:22.632229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c99d564c-46c7-41b0-89aa-34711d14484e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:22.632925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c99d564c-46c7-41b0-89aa-34711d14484e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:22.633407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c99d564c-46c7-41b0-89aa-34711d14484e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:22.633804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c99d564c-46c7-41b0-89aa-34711d14484e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:22.696977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c99d564c-46c7-41b0-89aa-34711d14484e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:22.705153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c99d564c-46c7-41b0-89aa-34711d14484e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085026 Aug 24 05:27:22.705710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1379/2870] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:22.780841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e393c97f-916a-4e94-be96-efc272cae3ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:22.781642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e393c97f-916a-4e94-be96-efc272cae3ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:22.784129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=82 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:22.790050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e393c97f-916a-4e94-be96-efc272cae3ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:22.790531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e393c97f-916a-4e94-be96-efc272cae3ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:22.790996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e393c97f-916a-4e94-be96-efc272cae3ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:22.791683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e393c97f-916a-4e94-be96-efc272cae3ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:22.792125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e393c97f-916a-4e94-be96-efc272cae3ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:22.792539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e393c97f-916a-4e94-be96-efc272cae3ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:22.856017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e393c97f-916a-4e94-be96-efc272cae3ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:22.864272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e393c97f-916a-4e94-be96-efc272cae3ac tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087501 Aug 24 05:27:22.865465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1492/2871] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:22 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:23.061762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4947bb7f-2fe6-4e25-9871-1b20eb9d9e56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:23.062370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4947bb7f-2fe6-4e25-9871-1b20eb9d9e56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:23.069151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4947bb7f-2fe6-4e25-9871-1b20eb9d9e56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:23.069632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4947bb7f-2fe6-4e25-9871-1b20eb9d9e56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:23.070064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4947bb7f-2fe6-4e25-9871-1b20eb9d9e56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:23.070772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4947bb7f-2fe6-4e25-9871-1b20eb9d9e56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:23.071224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4947bb7f-2fe6-4e25-9871-1b20eb9d9e56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:23.071644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4947bb7f-2fe6-4e25-9871-1b20eb9d9e56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:23.136876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4947bb7f-2fe6-4e25-9871-1b20eb9d9e56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:23.145345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4947bb7f-2fe6-4e25-9871-1b20eb9d9e56 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087497 Aug 24 05:27:23.145948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1380/2872] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:23 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:23.726078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9358a51b-bd16-4347-bdb6-ff8b4ec42b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:23.726737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9358a51b-bd16-4347-bdb6-ff8b4ec42b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:23.732819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9358a51b-bd16-4347-bdb6-ff8b4ec42b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:23.733299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9358a51b-bd16-4347-bdb6-ff8b4ec42b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:23.733730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9358a51b-bd16-4347-bdb6-ff8b4ec42b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:23.734425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9358a51b-bd16-4347-bdb6-ff8b4ec42b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:23.735506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9358a51b-bd16-4347-bdb6-ff8b4ec42b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:23.735946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9358a51b-bd16-4347-bdb6-ff8b4ec42b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:23.798960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9358a51b-bd16-4347-bdb6-ff8b4ec42b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:23.807646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9358a51b-bd16-4347-bdb6-ff8b4ec42b01 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086081 Aug 24 05:27:23.808227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1493/2873] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:23.885650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e2799895-c37e-4267-aada-a00209e35a1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:23.886241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e2799895-c37e-4267-aada-a00209e35a1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:23.893037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2799895-c37e-4267-aada-a00209e35a1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:23.893491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2799895-c37e-4267-aada-a00209e35a1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:23.893918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2799895-c37e-4267-aada-a00209e35a1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:23.894723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2799895-c37e-4267-aada-a00209e35a1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:23.895179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2799895-c37e-4267-aada-a00209e35a1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:23.895592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e2799895-c37e-4267-aada-a00209e35a1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:23.976755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e2799895-c37e-4267-aada-a00209e35a1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:23.978915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:23.986054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e2799895-c37e-4267-aada-a00209e35a1c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.104344 Aug 24 05:27:23.986609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1381/2874] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:23 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:24.167947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-98ea5cae-f859-467a-88d5-63f868f83a9f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:24.168557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-98ea5cae-f859-467a-88d5-63f868f83a9f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:24.174516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98ea5cae-f859-467a-88d5-63f868f83a9f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:24.175025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98ea5cae-f859-467a-88d5-63f868f83a9f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:24.175463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98ea5cae-f859-467a-88d5-63f868f83a9f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:24.176144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98ea5cae-f859-467a-88d5-63f868f83a9f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:24.176601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98ea5cae-f859-467a-88d5-63f868f83a9f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:24.177025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-98ea5cae-f859-467a-88d5-63f868f83a9f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:24.242841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-98ea5cae-f859-467a-88d5-63f868f83a9f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:24.251163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-98ea5cae-f859-467a-88d5-63f868f83a9f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087146 Aug 24 05:27:24.251731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1494/2875] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:24.828641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dd67875e-9534-4f65-8936-cf57eb30105b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:24.829240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dd67875e-9534-4f65-8936-cf57eb30105b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:24.835734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd67875e-9534-4f65-8936-cf57eb30105b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:24.836212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd67875e-9534-4f65-8936-cf57eb30105b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:24.836643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd67875e-9534-4f65-8936-cf57eb30105b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:24.837326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd67875e-9534-4f65-8936-cf57eb30105b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:24.837772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd67875e-9534-4f65-8936-cf57eb30105b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:24.838196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dd67875e-9534-4f65-8936-cf57eb30105b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:24.900095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dd67875e-9534-4f65-8936-cf57eb30105b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:24.908426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dd67875e-9534-4f65-8936-cf57eb30105b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.083700 Aug 24 05:27:24.908988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1382/2876] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:25.008337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-708d8481-ea0a-4c94-82dd-5e5d5a3d2b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:25.009226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-708d8481-ea0a-4c94-82dd-5e5d5a3d2b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:25.017376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708d8481-ea0a-4c94-82dd-5e5d5a3d2b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:25.017863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708d8481-ea0a-4c94-82dd-5e5d5a3d2b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:25.018301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708d8481-ea0a-4c94-82dd-5e5d5a3d2b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:25.019032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708d8481-ea0a-4c94-82dd-5e5d5a3d2b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:25.019483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708d8481-ea0a-4c94-82dd-5e5d5a3d2b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:25.019909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708d8481-ea0a-4c94-82dd-5e5d5a3d2b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:25.082186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-708d8481-ea0a-4c94-82dd-5e5d5a3d2b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:25.090465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-708d8481-ea0a-4c94-82dd-5e5d5a3d2b05 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087088 Aug 24 05:27:25.091073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1495/2877] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:25.273211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6beef9d7-17f1-456b-9647-450895399f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:25.273730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6beef9d7-17f1-456b-9647-450895399f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:25.279770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6beef9d7-17f1-456b-9647-450895399f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:25.280290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6beef9d7-17f1-456b-9647-450895399f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:25.280684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6beef9d7-17f1-456b-9647-450895399f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:25.281367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6beef9d7-17f1-456b-9647-450895399f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:25.281814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6beef9d7-17f1-456b-9647-450895399f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:25.282230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6beef9d7-17f1-456b-9647-450895399f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:25.343999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6beef9d7-17f1-456b-9647-450895399f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:25.352963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6beef9d7-17f1-456b-9647-450895399f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084347 Aug 24 05:27:25.353532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1383/2878] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:25.929023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-405dfb14-2d2b-4c71-8dd4-9ed6e4891422 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:25.929630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-405dfb14-2d2b-4c71-8dd4-9ed6e4891422 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:25.935970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-405dfb14-2d2b-4c71-8dd4-9ed6e4891422 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:25.936447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-405dfb14-2d2b-4c71-8dd4-9ed6e4891422 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:25.936882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-405dfb14-2d2b-4c71-8dd4-9ed6e4891422 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:25.937560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-405dfb14-2d2b-4c71-8dd4-9ed6e4891422 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:25.938008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-405dfb14-2d2b-4c71-8dd4-9ed6e4891422 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:25.938427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-405dfb14-2d2b-4c71-8dd4-9ed6e4891422 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:25.999653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-405dfb14-2d2b-4c71-8dd4-9ed6e4891422 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:26.008028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-405dfb14-2d2b-4c71-8dd4-9ed6e4891422 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.082866 Aug 24 05:27:26.008599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1496/2879] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:26.111620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ea9c3abc-de34-4bcc-b375-331751775487 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:26.112222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ea9c3abc-de34-4bcc-b375-331751775487 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:26.118878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea9c3abc-de34-4bcc-b375-331751775487 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:26.119362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea9c3abc-de34-4bcc-b375-331751775487 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:26.119797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea9c3abc-de34-4bcc-b375-331751775487 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:26.120483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea9c3abc-de34-4bcc-b375-331751775487 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:26.120940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea9c3abc-de34-4bcc-b375-331751775487 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:26.121378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ea9c3abc-de34-4bcc-b375-331751775487 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:26.183182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ea9c3abc-de34-4bcc-b375-331751775487 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:26.191405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ea9c3abc-de34-4bcc-b375-331751775487 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.083715 Aug 24 05:27:26.191968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1384/2880] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:26.373466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3cb10707-dec7-4cc6-87b2-13c63f62f82c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:26.373998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3cb10707-dec7-4cc6-87b2-13c63f62f82c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:26.381070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cb10707-dec7-4cc6-87b2-13c63f62f82c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:26.381696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cb10707-dec7-4cc6-87b2-13c63f62f82c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:26.382133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cb10707-dec7-4cc6-87b2-13c63f62f82c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:26.382846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cb10707-dec7-4cc6-87b2-13c63f62f82c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:26.383301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cb10707-dec7-4cc6-87b2-13c63f62f82c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:26.383722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3cb10707-dec7-4cc6-87b2-13c63f62f82c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:26.446250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3cb10707-dec7-4cc6-87b2-13c63f62f82c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:26.454512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3cb10707-dec7-4cc6-87b2-13c63f62f82c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.085007 Aug 24 05:27:26.455107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1497/2881] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:26.761656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:27:26.761885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:27:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:27:27.029307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a8839d75-f10e-4761-bc2a-a384630c5022 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:27.029863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a8839d75-f10e-4761-bc2a-a384630c5022 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:27.035838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8839d75-f10e-4761-bc2a-a384630c5022 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:27.036312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8839d75-f10e-4761-bc2a-a384630c5022 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:27.037446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8839d75-f10e-4761-bc2a-a384630c5022 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:27.038365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8839d75-f10e-4761-bc2a-a384630c5022 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:27.038845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8839d75-f10e-4761-bc2a-a384630c5022 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:27.039269 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8839d75-f10e-4761-bc2a-a384630c5022 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:27.106414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a8839d75-f10e-4761-bc2a-a384630c5022 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:27.115606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a8839d75-f10e-4761-bc2a-a384630c5022 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089491 Aug 24 05:27:27.116357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1385/2882] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:27.213285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e08db47b-0cd6-449c-bd18-ce9de0460f51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:27.213898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e08db47b-0cd6-449c-bd18-ce9de0460f51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:27.219941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e08db47b-0cd6-449c-bd18-ce9de0460f51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:27.220420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e08db47b-0cd6-449c-bd18-ce9de0460f51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:27.220853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e08db47b-0cd6-449c-bd18-ce9de0460f51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:27.221533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e08db47b-0cd6-449c-bd18-ce9de0460f51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:27.221982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e08db47b-0cd6-449c-bd18-ce9de0460f51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:27.222409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e08db47b-0cd6-449c-bd18-ce9de0460f51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:27.287482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e08db47b-0cd6-449c-bd18-ce9de0460f51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:27.295781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e08db47b-0cd6-449c-bd18-ce9de0460f51 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087113 Aug 24 05:27:27.296343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1498/2883] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:27 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:27.476190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0a624a0a-ffee-4e16-8eaa-913d040aa35e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:27.476797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0a624a0a-ffee-4e16-8eaa-913d040aa35e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:27.483417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a624a0a-ffee-4e16-8eaa-913d040aa35e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:27.483921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a624a0a-ffee-4e16-8eaa-913d040aa35e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:27.484348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a624a0a-ffee-4e16-8eaa-913d040aa35e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:27.485023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a624a0a-ffee-4e16-8eaa-913d040aa35e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:27.485466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a624a0a-ffee-4e16-8eaa-913d040aa35e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:27.485882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a624a0a-ffee-4e16-8eaa-913d040aa35e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:27.546817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0a624a0a-ffee-4e16-8eaa-913d040aa35e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:27.555688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0a624a0a-ffee-4e16-8eaa-913d040aa35e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.083470 Aug 24 05:27:27.556500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1386/2884] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:27 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:28.140430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-033130a7-adf2-4373-a1ff-2331c374df03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:28.141428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-033130a7-adf2-4373-a1ff-2331c374df03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:28.153131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033130a7-adf2-4373-a1ff-2331c374df03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:28.153628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033130a7-adf2-4373-a1ff-2331c374df03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:28.154069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033130a7-adf2-4373-a1ff-2331c374df03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:28.155031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033130a7-adf2-4373-a1ff-2331c374df03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:28.155577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033130a7-adf2-4373-a1ff-2331c374df03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:28.155997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-033130a7-adf2-4373-a1ff-2331c374df03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:28.234519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-033130a7-adf2-4373-a1ff-2331c374df03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:28.244186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-033130a7-adf2-4373-a1ff-2331c374df03 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.110838 Aug 24 05:27:28.244809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1499/2885] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:28 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:28.316497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a800490d-d8ef-407d-bf2f-e79319614852 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:28.317100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a800490d-d8ef-407d-bf2f-e79319614852 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:28.324797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a800490d-d8ef-407d-bf2f-e79319614852 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:28.325285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a800490d-d8ef-407d-bf2f-e79319614852 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:28.325711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a800490d-d8ef-407d-bf2f-e79319614852 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:28.326391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a800490d-d8ef-407d-bf2f-e79319614852 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:28.326875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a800490d-d8ef-407d-bf2f-e79319614852 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:28.327292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a800490d-d8ef-407d-bf2f-e79319614852 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:28.392589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a800490d-d8ef-407d-bf2f-e79319614852 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:28.401052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a800490d-d8ef-407d-bf2f-e79319614852 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088414 Aug 24 05:27:28.401614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1387/2886] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:28.576659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8474a47b-5b1e-4126-a05f-12bb69c5df96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:28.577267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8474a47b-5b1e-4126-a05f-12bb69c5df96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:28.583350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8474a47b-5b1e-4126-a05f-12bb69c5df96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:28.583843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8474a47b-5b1e-4126-a05f-12bb69c5df96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:28.584385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8474a47b-5b1e-4126-a05f-12bb69c5df96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:28.585073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8474a47b-5b1e-4126-a05f-12bb69c5df96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:28.585521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8474a47b-5b1e-4126-a05f-12bb69c5df96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:28.585937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8474a47b-5b1e-4126-a05f-12bb69c5df96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:28.589829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:28.648817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8474a47b-5b1e-4126-a05f-12bb69c5df96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:28.656994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8474a47b-5b1e-4126-a05f-12bb69c5df96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084263 Aug 24 05:27:28.657560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1500/2887] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:29.266156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e322324c-2f54-4503-8c87-a0188edf9d31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:29.266802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e322324c-2f54-4503-8c87-a0188edf9d31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:29.273454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e322324c-2f54-4503-8c87-a0188edf9d31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:29.273938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e322324c-2f54-4503-8c87-a0188edf9d31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:29.274376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e322324c-2f54-4503-8c87-a0188edf9d31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:29.275089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e322324c-2f54-4503-8c87-a0188edf9d31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:29.275545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e322324c-2f54-4503-8c87-a0188edf9d31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:29.275969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e322324c-2f54-4503-8c87-a0188edf9d31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:29.340254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e322324c-2f54-4503-8c87-a0188edf9d31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:29.348811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e322324c-2f54-4503-8c87-a0188edf9d31 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086569 Aug 24 05:27:29.349993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1388/2888] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:29.421361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5c5688e4-cb53-4e0b-8b0f-e031173dd696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:29.422005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5c5688e4-cb53-4e0b-8b0f-e031173dd696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:29.430393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5688e4-cb53-4e0b-8b0f-e031173dd696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:29.430917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5688e4-cb53-4e0b-8b0f-e031173dd696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:29.431614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5688e4-cb53-4e0b-8b0f-e031173dd696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:29.432308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5688e4-cb53-4e0b-8b0f-e031173dd696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:29.432766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5688e4-cb53-4e0b-8b0f-e031173dd696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:29.433189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c5688e4-cb53-4e0b-8b0f-e031173dd696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:29.495090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5c5688e4-cb53-4e0b-8b0f-e031173dd696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:29.503304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5c5688e4-cb53-4e0b-8b0f-e031173dd696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085797 Aug 24 05:27:29.503880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1501/2889] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:29.678119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-846682a1-f6c6-45ea-ae1b-08b5e6f1da96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:29.678643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-846682a1-f6c6-45ea-ae1b-08b5e6f1da96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:29.684929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-846682a1-f6c6-45ea-ae1b-08b5e6f1da96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:29.685415 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-846682a1-f6c6-45ea-ae1b-08b5e6f1da96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:29.685853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-846682a1-f6c6-45ea-ae1b-08b5e6f1da96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:29.686540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-846682a1-f6c6-45ea-ae1b-08b5e6f1da96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:29.687028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-846682a1-f6c6-45ea-ae1b-08b5e6f1da96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:29.687452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-846682a1-f6c6-45ea-ae1b-08b5e6f1da96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:29.751293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-846682a1-f6c6-45ea-ae1b-08b5e6f1da96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:29.760648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-846682a1-f6c6-45ea-ae1b-08b5e6f1da96 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087047 Aug 24 05:27:29.761233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1389/2890] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:30.371710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f249b2f7-0fb4-4f98-a45e-02f782295d87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:30.372320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f249b2f7-0fb4-4f98-a45e-02f782295d87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:30.378312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f249b2f7-0fb4-4f98-a45e-02f782295d87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:30.378821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f249b2f7-0fb4-4f98-a45e-02f782295d87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:30.379254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f249b2f7-0fb4-4f98-a45e-02f782295d87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:30.379950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f249b2f7-0fb4-4f98-a45e-02f782295d87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:30.380670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f249b2f7-0fb4-4f98-a45e-02f782295d87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:30.381093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f249b2f7-0fb4-4f98-a45e-02f782295d87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:30.444835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f249b2f7-0fb4-4f98-a45e-02f782295d87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:30.453036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f249b2f7-0fb4-4f98-a45e-02f782295d87 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085582 Aug 24 05:27:30.453849 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1502/2891] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:30.524774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-52edb86b-aec7-4cc3-894b-7fedd9d8688e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:30.525535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-52edb86b-aec7-4cc3-894b-7fedd9d8688e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:30.532544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52edb86b-aec7-4cc3-894b-7fedd9d8688e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:30.533314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52edb86b-aec7-4cc3-894b-7fedd9d8688e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:30.533753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52edb86b-aec7-4cc3-894b-7fedd9d8688e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:30.534455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52edb86b-aec7-4cc3-894b-7fedd9d8688e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:30.534935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52edb86b-aec7-4cc3-894b-7fedd9d8688e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:30.535354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-52edb86b-aec7-4cc3-894b-7fedd9d8688e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:30.598184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-52edb86b-aec7-4cc3-894b-7fedd9d8688e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:30.607049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-52edb86b-aec7-4cc3-894b-7fedd9d8688e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086674 Aug 24 05:27:30.607611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1390/2892] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:30.781776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-07566eed-cb2a-448c-86c7-967e97cbdd19 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:30.782417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-07566eed-cb2a-448c-86c7-967e97cbdd19 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:30.788975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07566eed-cb2a-448c-86c7-967e97cbdd19 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:30.789453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07566eed-cb2a-448c-86c7-967e97cbdd19 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:30.789889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07566eed-cb2a-448c-86c7-967e97cbdd19 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:30.790566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07566eed-cb2a-448c-86c7-967e97cbdd19 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:30.791053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07566eed-cb2a-448c-86c7-967e97cbdd19 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:30.791473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07566eed-cb2a-448c-86c7-967e97cbdd19 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:30.854191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-07566eed-cb2a-448c-86c7-967e97cbdd19 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:30.862496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-07566eed-cb2a-448c-86c7-967e97cbdd19 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084582 Aug 24 05:27:30.863100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1503/2893] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:31.474208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-711e9c42-3976-4d64-a744-db2d4e49ae91 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:31.474843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-711e9c42-3976-4d64-a744-db2d4e49ae91 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:31.481009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-711e9c42-3976-4d64-a744-db2d4e49ae91 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:31.481486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-711e9c42-3976-4d64-a744-db2d4e49ae91 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:31.481918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-711e9c42-3976-4d64-a744-db2d4e49ae91 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:31.482596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-711e9c42-3976-4d64-a744-db2d4e49ae91 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:31.483071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-711e9c42-3976-4d64-a744-db2d4e49ae91 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:31.483490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-711e9c42-3976-4d64-a744-db2d4e49ae91 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:31.544229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-711e9c42-3976-4d64-a744-db2d4e49ae91 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:31.553080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-711e9c42-3976-4d64-a744-db2d4e49ae91 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.082796 Aug 24 05:27:31.553651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1391/2894] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:31.627450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e7dd886c-4c10-47ca-8734-cd8e62e61c9a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:31.628207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e7dd886c-4c10-47ca-8734-cd8e62e61c9a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:31.634799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7dd886c-4c10-47ca-8734-cd8e62e61c9a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:31.635282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7dd886c-4c10-47ca-8734-cd8e62e61c9a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:31.635722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7dd886c-4c10-47ca-8734-cd8e62e61c9a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:31.636408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7dd886c-4c10-47ca-8734-cd8e62e61c9a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:31.636861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7dd886c-4c10-47ca-8734-cd8e62e61c9a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:31.637286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7dd886c-4c10-47ca-8734-cd8e62e61c9a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:31.702805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e7dd886c-4c10-47ca-8734-cd8e62e61c9a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:31.708337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e7dd886c-4c10-47ca-8734-cd8e62e61c9a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.084739 Aug 24 05:27:31.709074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1504/2895] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:31.883162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-18bf08e9-82f9-488c-b806-19594686570e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:31.883768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-18bf08e9-82f9-488c-b806-19594686570e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:31.889764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bf08e9-82f9-488c-b806-19594686570e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:31.890234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bf08e9-82f9-488c-b806-19594686570e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:31.890701 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bf08e9-82f9-488c-b806-19594686570e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:31.891364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bf08e9-82f9-488c-b806-19594686570e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:31.891813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bf08e9-82f9-488c-b806-19594686570e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:31.892225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-18bf08e9-82f9-488c-b806-19594686570e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:31.956224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-18bf08e9-82f9-488c-b806-19594686570e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:31.965239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-18bf08e9-82f9-488c-b806-19594686570e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086017 Aug 24 05:27:31.965801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1392/2896] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:32.573888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-41bfc97f-5f72-4c7f-ab2a-2f14048bd3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:32.574494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-41bfc97f-5f72-4c7f-ab2a-2f14048bd3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:32.580830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41bfc97f-5f72-4c7f-ab2a-2f14048bd3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:32.581318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41bfc97f-5f72-4c7f-ab2a-2f14048bd3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:32.581754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41bfc97f-5f72-4c7f-ab2a-2f14048bd3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:32.582456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41bfc97f-5f72-4c7f-ab2a-2f14048bd3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:32.582937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41bfc97f-5f72-4c7f-ab2a-2f14048bd3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:32.583357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41bfc97f-5f72-4c7f-ab2a-2f14048bd3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:32.645942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-41bfc97f-5f72-4c7f-ab2a-2f14048bd3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:32.654991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-41bfc97f-5f72-4c7f-ab2a-2f14048bd3e1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084975 Aug 24 05:27:32.655565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1505/2897] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:32.730011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3df26b40-dbc2-45a4-8f48-1c52640bef2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:32.730753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3df26b40-dbc2-45a4-8f48-1c52640bef2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:32.737383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df26b40-dbc2-45a4-8f48-1c52640bef2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:32.737884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df26b40-dbc2-45a4-8f48-1c52640bef2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:32.738323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df26b40-dbc2-45a4-8f48-1c52640bef2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:32.739043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df26b40-dbc2-45a4-8f48-1c52640bef2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:32.739499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df26b40-dbc2-45a4-8f48-1c52640bef2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:32.739920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3df26b40-dbc2-45a4-8f48-1c52640bef2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:32.803894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3df26b40-dbc2-45a4-8f48-1c52640bef2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:32.812642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3df26b40-dbc2-45a4-8f48-1c52640bef2d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087255 Aug 24 05:27:32.813218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1393/2898] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:32.988228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6a7eac8b-d064-41e6-86d4-6addefba0402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:32.988830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6a7eac8b-d064-41e6-86d4-6addefba0402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:32.995012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a7eac8b-d064-41e6-86d4-6addefba0402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:32.995496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a7eac8b-d064-41e6-86d4-6addefba0402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:32.995930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a7eac8b-d064-41e6-86d4-6addefba0402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:32.996619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a7eac8b-d064-41e6-86d4-6addefba0402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:32.997086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a7eac8b-d064-41e6-86d4-6addefba0402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:32.997483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6a7eac8b-d064-41e6-86d4-6addefba0402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:33.067535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6a7eac8b-d064-41e6-86d4-6addefba0402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:33.076675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6a7eac8b-d064-41e6-86d4-6addefba0402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092269 Aug 24 05:27:33.077254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1506/2899] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:33.676492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5d344437-d068-46b1-9635-80a7669367ab tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:33.677104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5d344437-d068-46b1-9635-80a7669367ab tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:33.684307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d344437-d068-46b1-9635-80a7669367ab tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:33.684794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d344437-d068-46b1-9635-80a7669367ab tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:33.685234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d344437-d068-46b1-9635-80a7669367ab tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:33.685927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d344437-d068-46b1-9635-80a7669367ab tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:33.686377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d344437-d068-46b1-9635-80a7669367ab tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:33.686937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5d344437-d068-46b1-9635-80a7669367ab tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:33.750775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5d344437-d068-46b1-9635-80a7669367ab tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:33.759677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5d344437-d068-46b1-9635-80a7669367ab tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087022 Aug 24 05:27:33.760517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1394/2900] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:33.833177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b5f5377d-9c02-44c2-bf02-5ee3f9cd3028 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:33.833859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b5f5377d-9c02-44c2-bf02-5ee3f9cd3028 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:33.840419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5f5377d-9c02-44c2-bf02-5ee3f9cd3028 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:33.840898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5f5377d-9c02-44c2-bf02-5ee3f9cd3028 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:33.841331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5f5377d-9c02-44c2-bf02-5ee3f9cd3028 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:33.842022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5f5377d-9c02-44c2-bf02-5ee3f9cd3028 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:33.842469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5f5377d-9c02-44c2-bf02-5ee3f9cd3028 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:33.842924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b5f5377d-9c02-44c2-bf02-5ee3f9cd3028 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:33.906798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b5f5377d-9c02-44c2-bf02-5ee3f9cd3028 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:33.916046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b5f5377d-9c02-44c2-bf02-5ee3f9cd3028 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086735 Aug 24 05:27:33.916763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1507/2901] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:33 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:34.097609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bf2132b4-723c-4501-bb5c-e81ed79c3b35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:34.098212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bf2132b4-723c-4501-bb5c-e81ed79c3b35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:34.104823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2132b4-723c-4501-bb5c-e81ed79c3b35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:34.105306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2132b4-723c-4501-bb5c-e81ed79c3b35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:34.105735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2132b4-723c-4501-bb5c-e81ed79c3b35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:34.106420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2132b4-723c-4501-bb5c-e81ed79c3b35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:34.106910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2132b4-723c-4501-bb5c-e81ed79c3b35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:34.107337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2132b4-723c-4501-bb5c-e81ed79c3b35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:34.169456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bf2132b4-723c-4501-bb5c-e81ed79c3b35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:34.178429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bf2132b4-723c-4501-bb5c-e81ed79c3b35 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.084603 Aug 24 05:27:34.179192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1395/2902] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:34 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:34.780622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5534efa0-fc60-4bd8-b30f-4dde15a6add5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:34.781245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5534efa0-fc60-4bd8-b30f-4dde15a6add5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:34.787341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5534efa0-fc60-4bd8-b30f-4dde15a6add5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:34.787829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5534efa0-fc60-4bd8-b30f-4dde15a6add5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:34.788270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5534efa0-fc60-4bd8-b30f-4dde15a6add5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:34.788960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5534efa0-fc60-4bd8-b30f-4dde15a6add5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:34.789416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5534efa0-fc60-4bd8-b30f-4dde15a6add5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:34.789844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5534efa0-fc60-4bd8-b30f-4dde15a6add5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:34.851306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5534efa0-fc60-4bd8-b30f-4dde15a6add5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:34.859412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5534efa0-fc60-4bd8-b30f-4dde15a6add5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.082654 Aug 24 05:27:34.859981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1508/2903] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:34.937803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3d01b5a4-37c8-4d4e-badc-5bcdb1113639 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:34.938383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3d01b5a4-37c8-4d4e-badc-5bcdb1113639 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:34.945734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d01b5a4-37c8-4d4e-badc-5bcdb1113639 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:34.946216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d01b5a4-37c8-4d4e-badc-5bcdb1113639 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:34.946642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d01b5a4-37c8-4d4e-badc-5bcdb1113639 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:34.947343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d01b5a4-37c8-4d4e-badc-5bcdb1113639 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:34.947784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d01b5a4-37c8-4d4e-badc-5bcdb1113639 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:34.948204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d01b5a4-37c8-4d4e-badc-5bcdb1113639 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:35.013581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3d01b5a4-37c8-4d4e-badc-5bcdb1113639 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:35.021977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3d01b5a4-37c8-4d4e-badc-5bcdb1113639 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087984 Aug 24 05:27:35.022671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1396/2904] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:35.200551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c1ad49b8-b9b5-4c7e-b4ef-e25128e2d3ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:35.201159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c1ad49b8-b9b5-4c7e-b4ef-e25128e2d3ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:35.207288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ad49b8-b9b5-4c7e-b4ef-e25128e2d3ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:35.207772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ad49b8-b9b5-4c7e-b4ef-e25128e2d3ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:35.208210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ad49b8-b9b5-4c7e-b4ef-e25128e2d3ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:35.208898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ad49b8-b9b5-4c7e-b4ef-e25128e2d3ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:35.209373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ad49b8-b9b5-4c7e-b4ef-e25128e2d3ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:35.209779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1ad49b8-b9b5-4c7e-b4ef-e25128e2d3ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:35.283555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c1ad49b8-b9b5-4c7e-b4ef-e25128e2d3ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:35.294143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c1ad49b8-b9b5-4c7e-b4ef-e25128e2d3ec tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.097406 Aug 24 05:27:35.294839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1509/2905] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:35.883620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-783eef45-4b2a-4aea-a06d-a75ca1f13976 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:35.884524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-783eef45-4b2a-4aea-a06d-a75ca1f13976 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:35.892146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-783eef45-4b2a-4aea-a06d-a75ca1f13976 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:35.892632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-783eef45-4b2a-4aea-a06d-a75ca1f13976 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:35.893065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-783eef45-4b2a-4aea-a06d-a75ca1f13976 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:35.893786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-783eef45-4b2a-4aea-a06d-a75ca1f13976 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:35.894241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-783eef45-4b2a-4aea-a06d-a75ca1f13976 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:35.894658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-783eef45-4b2a-4aea-a06d-a75ca1f13976 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:35.963148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-783eef45-4b2a-4aea-a06d-a75ca1f13976 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:35.973686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-783eef45-4b2a-4aea-a06d-a75ca1f13976 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.096245 Aug 24 05:27:35.974268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1397/2906] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:36.042944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a7ada7e4-b2e5-4d73-864d-26178d5d2078 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:36.043538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a7ada7e4-b2e5-4d73-864d-26178d5d2078 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:36.049966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7ada7e4-b2e5-4d73-864d-26178d5d2078 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:36.050423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7ada7e4-b2e5-4d73-864d-26178d5d2078 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:36.050900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7ada7e4-b2e5-4d73-864d-26178d5d2078 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:36.051573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7ada7e4-b2e5-4d73-864d-26178d5d2078 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:36.052014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7ada7e4-b2e5-4d73-864d-26178d5d2078 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:36.052426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a7ada7e4-b2e5-4d73-864d-26178d5d2078 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:36.120720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a7ada7e4-b2e5-4d73-864d-26178d5d2078 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:36.129250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a7ada7e4-b2e5-4d73-864d-26178d5d2078 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090137 Aug 24 05:27:36.129832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1510/2907] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:36 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:36.316513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7bc280e8-d10d-4cac-b202-82c0af80c177 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:36.316993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7bc280e8-d10d-4cac-b202-82c0af80c177 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:36.324816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7bc280e8-d10d-4cac-b202-82c0af80c177 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:36.325310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7bc280e8-d10d-4cac-b202-82c0af80c177 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:36.325742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7bc280e8-d10d-4cac-b202-82c0af80c177 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:36.326452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7bc280e8-d10d-4cac-b202-82c0af80c177 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:36.326946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7bc280e8-d10d-4cac-b202-82c0af80c177 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:36.327372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7bc280e8-d10d-4cac-b202-82c0af80c177 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:36.343996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:36.392376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7bc280e8-d10d-4cac-b202-82c0af80c177 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:36.402022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7bc280e8-d10d-4cac-b202-82c0af80c177 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089578 Aug 24 05:27:36.402595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1398/2908] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:36.999297 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-02d2d1b8-9849-4e37-adf0-e8cbf20d2669 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:36.999825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-02d2d1b8-9849-4e37-adf0-e8cbf20d2669 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:37.005894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02d2d1b8-9849-4e37-adf0-e8cbf20d2669 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:37.006406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02d2d1b8-9849-4e37-adf0-e8cbf20d2669 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:37.006882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02d2d1b8-9849-4e37-adf0-e8cbf20d2669 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:37.007653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02d2d1b8-9849-4e37-adf0-e8cbf20d2669 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:37.008107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02d2d1b8-9849-4e37-adf0-e8cbf20d2669 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:37.008531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02d2d1b8-9849-4e37-adf0-e8cbf20d2669 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:37.071854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-02d2d1b8-9849-4e37-adf0-e8cbf20d2669 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:37.080413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-02d2d1b8-9849-4e37-adf0-e8cbf20d2669 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085035 Aug 24 05:27:37.080993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1511/2909] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:37.151325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-418dee3c-70d3-45d5-8792-4192b4e0abd8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:37.151943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-418dee3c-70d3-45d5-8792-4192b4e0abd8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:37.158163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-418dee3c-70d3-45d5-8792-4192b4e0abd8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:37.158638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-418dee3c-70d3-45d5-8792-4192b4e0abd8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:37.159096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-418dee3c-70d3-45d5-8792-4192b4e0abd8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:37.159821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-418dee3c-70d3-45d5-8792-4192b4e0abd8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:37.160266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-418dee3c-70d3-45d5-8792-4192b4e0abd8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:37.160679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-418dee3c-70d3-45d5-8792-4192b4e0abd8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:37.229440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-418dee3c-70d3-45d5-8792-4192b4e0abd8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:37.237991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-418dee3c-70d3-45d5-8792-4192b4e0abd8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091230 Aug 24 05:27:37.238565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1399/2910] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:37.423307 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-42139386-165d-4db5-8561-47ef7c138f61 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:37.423830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-42139386-165d-4db5-8561-47ef7c138f61 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:37.430880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-42139386-165d-4db5-8561-47ef7c138f61 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:37.431622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-42139386-165d-4db5-8561-47ef7c138f61 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:37.432054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-42139386-165d-4db5-8561-47ef7c138f61 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:37.432869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-42139386-165d-4db5-8561-47ef7c138f61 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:37.433324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-42139386-165d-4db5-8561-47ef7c138f61 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:37.433743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-42139386-165d-4db5-8561-47ef7c138f61 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:37.503529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-42139386-165d-4db5-8561-47ef7c138f61 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:37.512659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-42139386-165d-4db5-8561-47ef7c138f61 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093245 Aug 24 05:27:37.513234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1512/2911] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:38.101847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a0332a6b-1848-4bbb-910f-d0c2dd280398 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:38.102381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a0332a6b-1848-4bbb-910f-d0c2dd280398 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:38.108662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0332a6b-1848-4bbb-910f-d0c2dd280398 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:38.109145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0332a6b-1848-4bbb-910f-d0c2dd280398 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:38.109582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0332a6b-1848-4bbb-910f-d0c2dd280398 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:38.110280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0332a6b-1848-4bbb-910f-d0c2dd280398 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:38.110757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0332a6b-1848-4bbb-910f-d0c2dd280398 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:38.111186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a0332a6b-1848-4bbb-910f-d0c2dd280398 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:38.176961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a0332a6b-1848-4bbb-910f-d0c2dd280398 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:38.187536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a0332a6b-1848-4bbb-910f-d0c2dd280398 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089674 Aug 24 05:27:38.188111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1400/2912] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:38 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:38.261121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-15827f57-aabe-4645-a116-e4087d0bfe0c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:38.261752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-15827f57-aabe-4645-a116-e4087d0bfe0c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:38.268253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15827f57-aabe-4645-a116-e4087d0bfe0c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:38.268711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15827f57-aabe-4645-a116-e4087d0bfe0c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:38.269135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15827f57-aabe-4645-a116-e4087d0bfe0c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:38.269808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15827f57-aabe-4645-a116-e4087d0bfe0c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:38.270249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15827f57-aabe-4645-a116-e4087d0bfe0c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:38.270664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15827f57-aabe-4645-a116-e4087d0bfe0c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:38.333482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-15827f57-aabe-4645-a116-e4087d0bfe0c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:38.342723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-15827f57-aabe-4645-a116-e4087d0bfe0c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085382 Aug 24 05:27:38.343319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1513/2913] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:38.534280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8a120b75-3e02-42e3-b724-354c287982d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:38.534927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8a120b75-3e02-42e3-b724-354c287982d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:38.541113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a120b75-3e02-42e3-b724-354c287982d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:38.541600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a120b75-3e02-42e3-b724-354c287982d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:38.542039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a120b75-3e02-42e3-b724-354c287982d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:38.542770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a120b75-3e02-42e3-b724-354c287982d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:38.543396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a120b75-3e02-42e3-b724-354c287982d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:38.543806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a120b75-3e02-42e3-b724-354c287982d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:38.613937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8a120b75-3e02-42e3-b724-354c287982d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:38.622879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8a120b75-3e02-42e3-b724-354c287982d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092468 Aug 24 05:27:38.623448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1401/2914] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:39.208118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1452aab8-ea3b-4645-a050-1e2a4a01af88 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:39.208737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1452aab8-ea3b-4645-a050-1e2a4a01af88 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:39.215639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1452aab8-ea3b-4645-a050-1e2a4a01af88 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:39.216118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1452aab8-ea3b-4645-a050-1e2a4a01af88 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:39.216553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1452aab8-ea3b-4645-a050-1e2a4a01af88 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:39.217238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1452aab8-ea3b-4645-a050-1e2a4a01af88 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:39.217687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1452aab8-ea3b-4645-a050-1e2a4a01af88 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:39.218105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1452aab8-ea3b-4645-a050-1e2a4a01af88 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:39.283319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1452aab8-ea3b-4645-a050-1e2a4a01af88 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:39.291574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1452aab8-ea3b-4645-a050-1e2a4a01af88 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087324 Aug 24 05:27:39.292147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1514/2915] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:39.363435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e7c526ae-6d05-428a-a8d2-3562441840d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:39.364031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e7c526ae-6d05-428a-a8d2-3562441840d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:39.371211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c526ae-6d05-428a-a8d2-3562441840d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:39.371698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c526ae-6d05-428a-a8d2-3562441840d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:39.372141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c526ae-6d05-428a-a8d2-3562441840d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:39.372828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c526ae-6d05-428a-a8d2-3562441840d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:39.373289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c526ae-6d05-428a-a8d2-3562441840d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:39.373714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e7c526ae-6d05-428a-a8d2-3562441840d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:39.436910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e7c526ae-6d05-428a-a8d2-3562441840d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:39.445766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e7c526ae-6d05-428a-a8d2-3562441840d5 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086184 Aug 24 05:27:39.446362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1402/2916] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:39.644410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d44d2b89-87a9-4770-9dce-58b0ad011991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:39.644932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d44d2b89-87a9-4770-9dce-58b0ad011991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:39.651638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d44d2b89-87a9-4770-9dce-58b0ad011991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:39.652120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d44d2b89-87a9-4770-9dce-58b0ad011991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:39.652557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d44d2b89-87a9-4770-9dce-58b0ad011991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:39.653248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d44d2b89-87a9-4770-9dce-58b0ad011991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:39.653701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d44d2b89-87a9-4770-9dce-58b0ad011991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:39.654122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d44d2b89-87a9-4770-9dce-58b0ad011991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:39.720262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d44d2b89-87a9-4770-9dce-58b0ad011991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:39.729425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d44d2b89-87a9-4770-9dce-58b0ad011991 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089023 Aug 24 05:27:39.730019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1515/2917] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:39 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:40.313627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f0981475-1009-4080-8056-8a788cf855d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:40.314237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f0981475-1009-4080-8056-8a788cf855d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:40.321433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0981475-1009-4080-8056-8a788cf855d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:40.321924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0981475-1009-4080-8056-8a788cf855d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:40.322362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0981475-1009-4080-8056-8a788cf855d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:40.323160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0981475-1009-4080-8056-8a788cf855d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:40.323614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0981475-1009-4080-8056-8a788cf855d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:40.324043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f0981475-1009-4080-8056-8a788cf855d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:40.387736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f0981475-1009-4080-8056-8a788cf855d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:40.396177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f0981475-1009-4080-8056-8a788cf855d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086436 Aug 24 05:27:40.396800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1403/2918] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:40 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:40.466705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4f3fa7ca-21af-498f-ab46-66b8442f7909 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:40.467341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4f3fa7ca-21af-498f-ab46-66b8442f7909 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:40.473864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7ca-21af-498f-ab46-66b8442f7909 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:40.474347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7ca-21af-498f-ab46-66b8442f7909 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:40.475347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7ca-21af-498f-ab46-66b8442f7909 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:40.476056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7ca-21af-498f-ab46-66b8442f7909 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:40.476489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7ca-21af-498f-ab46-66b8442f7909 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:40.476909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f3fa7ca-21af-498f-ab46-66b8442f7909 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:40.542890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4f3fa7ca-21af-498f-ab46-66b8442f7909 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:40.545288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:40.552776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4f3fa7ca-21af-498f-ab46-66b8442f7909 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090024 Aug 24 05:27:40.553997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1516/2919] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:40 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:40.749443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-88551685-3420-470c-afa5-9daf5a0822af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:40.750051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-88551685-3420-470c-afa5-9daf5a0822af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:40.756408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88551685-3420-470c-afa5-9daf5a0822af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:40.756891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88551685-3420-470c-afa5-9daf5a0822af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:40.757324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88551685-3420-470c-afa5-9daf5a0822af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:40.758015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88551685-3420-470c-afa5-9daf5a0822af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:40.758461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88551685-3420-470c-afa5-9daf5a0822af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:40.758920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-88551685-3420-470c-afa5-9daf5a0822af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:40.827313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-88551685-3420-470c-afa5-9daf5a0822af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:40.836118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-88551685-3420-470c-afa5-9daf5a0822af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090494 Aug 24 05:27:40.836712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1404/2920] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:40 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:41.417678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e878074d-d7c5-4307-b5ba-058ec106bd6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:41.418316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e878074d-d7c5-4307-b5ba-058ec106bd6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:41.424446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e878074d-d7c5-4307-b5ba-058ec106bd6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:41.424922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e878074d-d7c5-4307-b5ba-058ec106bd6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:41.425351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e878074d-d7c5-4307-b5ba-058ec106bd6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:41.426037 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e878074d-d7c5-4307-b5ba-058ec106bd6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:41.426475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e878074d-d7c5-4307-b5ba-058ec106bd6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:41.426920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e878074d-d7c5-4307-b5ba-058ec106bd6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:41.491934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e878074d-d7c5-4307-b5ba-058ec106bd6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:41.500920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e878074d-d7c5-4307-b5ba-058ec106bd6d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087075 Aug 24 05:27:41.501493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1517/2921] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:41 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:41.574924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9e24c17d-1018-40b4-9137-42d6531a2bfe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:41.575640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9e24c17d-1018-40b4-9137-42d6531a2bfe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:41.585004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e24c17d-1018-40b4-9137-42d6531a2bfe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:41.585561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e24c17d-1018-40b4-9137-42d6531a2bfe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:41.586004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e24c17d-1018-40b4-9137-42d6531a2bfe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:41.586769 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e24c17d-1018-40b4-9137-42d6531a2bfe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:41.587224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e24c17d-1018-40b4-9137-42d6531a2bfe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:41.587643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e24c17d-1018-40b4-9137-42d6531a2bfe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:41.857457 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bedb3a5e-207c-467b-b594-948e8943a1d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:41.858236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bedb3a5e-207c-467b-b594-948e8943a1d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:41.865858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bedb3a5e-207c-467b-b594-948e8943a1d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:41.866525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bedb3a5e-207c-467b-b594-948e8943a1d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:41.867319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bedb3a5e-207c-467b-b594-948e8943a1d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:41.868544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bedb3a5e-207c-467b-b594-948e8943a1d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:41.869024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bedb3a5e-207c-467b-b594-948e8943a1d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:41.869462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bedb3a5e-207c-467b-b594-948e8943a1d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:41.904536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9e24c17d-1018-40b4-9137-42d6531a2bfe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:41.913617 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9e24c17d-1018-40b4-9137-42d6531a2bfe tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.342052 Aug 24 05:27:41.914033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1405/2922] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:41 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:41.939142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bedb3a5e-207c-467b-b594-948e8943a1d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:41.948736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bedb3a5e-207c-467b-b594-948e8943a1d7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095146 Aug 24 05:27:41.949310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1518/2923] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:41 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:42.522650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ab6ccb8b-46bf-49d0-854f-05f94ed070f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:42.523285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ab6ccb8b-46bf-49d0-854f-05f94ed070f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:42.529415 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ab6ccb8b-46bf-49d0-854f-05f94ed070f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:42.529904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ab6ccb8b-46bf-49d0-854f-05f94ed070f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:42.530335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ab6ccb8b-46bf-49d0-854f-05f94ed070f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:42.531063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ab6ccb8b-46bf-49d0-854f-05f94ed070f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:42.531511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ab6ccb8b-46bf-49d0-854f-05f94ed070f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:42.531931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ab6ccb8b-46bf-49d0-854f-05f94ed070f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:42.594163 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ab6ccb8b-46bf-49d0-854f-05f94ed070f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:42.603715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ab6ccb8b-46bf-49d0-854f-05f94ed070f2 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085475 Aug 24 05:27:42.604292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1406/2924] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:42 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:42.935155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-88bdf980-fa48-4bcd-981a-15f66be47b06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:42.935732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-88bdf980-fa48-4bcd-981a-15f66be47b06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:42.942333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88bdf980-fa48-4bcd-981a-15f66be47b06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:42.942866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88bdf980-fa48-4bcd-981a-15f66be47b06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:42.943306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88bdf980-fa48-4bcd-981a-15f66be47b06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:42.944621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88bdf980-fa48-4bcd-981a-15f66be47b06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:42.945072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88bdf980-fa48-4bcd-981a-15f66be47b06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:42.945495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-88bdf980-fa48-4bcd-981a-15f66be47b06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:42.969424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-51016c2f-9f10-468e-856d-35264c545777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:42.970080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-51016c2f-9f10-468e-856d-35264c545777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:42.976714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51016c2f-9f10-468e-856d-35264c545777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:42.977196 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51016c2f-9f10-468e-856d-35264c545777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:42.977658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51016c2f-9f10-468e-856d-35264c545777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:42.978347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51016c2f-9f10-468e-856d-35264c545777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:42.979229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51016c2f-9f10-468e-856d-35264c545777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:42.979393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-51016c2f-9f10-468e-856d-35264c545777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:43.009979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-88bdf980-fa48-4bcd-981a-15f66be47b06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:43.018878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-88bdf980-fa48-4bcd-981a-15f66be47b06 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087999 Aug 24 05:27:43.019467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1519/2925] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:42 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:43.044396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-51016c2f-9f10-468e-856d-35264c545777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:43.052753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-51016c2f-9f10-468e-856d-35264c545777 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087163 Aug 24 05:27:43.053377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1407/2926] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:43.624088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-13636959-5450-4d72-b5fc-f7fc92097e11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:43.624696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-13636959-5450-4d72-b5fc-f7fc92097e11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:43.630818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13636959-5450-4d72-b5fc-f7fc92097e11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:43.631418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13636959-5450-4d72-b5fc-f7fc92097e11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:43.631862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13636959-5450-4d72-b5fc-f7fc92097e11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:43.632560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13636959-5450-4d72-b5fc-f7fc92097e11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:43.633012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13636959-5450-4d72-b5fc-f7fc92097e11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:43.633433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-13636959-5450-4d72-b5fc-f7fc92097e11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:43.697325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-13636959-5450-4d72-b5fc-f7fc92097e11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:43.706040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-13636959-5450-4d72-b5fc-f7fc92097e11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085799 Aug 24 05:27:43.706619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1520/2927] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:43 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:44.041060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-045febcd-63c5-4104-ae86-1f59a13924a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:44.041672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-045febcd-63c5-4104-ae86-1f59a13924a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:44.048377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-045febcd-63c5-4104-ae86-1f59a13924a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:44.048858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-045febcd-63c5-4104-ae86-1f59a13924a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:44.049292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-045febcd-63c5-4104-ae86-1f59a13924a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:44.049993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-045febcd-63c5-4104-ae86-1f59a13924a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:44.050445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-045febcd-63c5-4104-ae86-1f59a13924a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:44.050907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-045febcd-63c5-4104-ae86-1f59a13924a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:44.073812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-14ce2a97-326c-4877-b24a-e5b8de968052 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:44.074438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-14ce2a97-326c-4877-b24a-e5b8de968052 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:44.081399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14ce2a97-326c-4877-b24a-e5b8de968052 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:44.081883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14ce2a97-326c-4877-b24a-e5b8de968052 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:44.082317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14ce2a97-326c-4877-b24a-e5b8de968052 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:44.083044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14ce2a97-326c-4877-b24a-e5b8de968052 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:44.083499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14ce2a97-326c-4877-b24a-e5b8de968052 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:44.083917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-14ce2a97-326c-4877-b24a-e5b8de968052 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:44.116515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-045febcd-63c5-4104-ae86-1f59a13924a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:44.125440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-045febcd-63c5-4104-ae86-1f59a13924a2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088899 Aug 24 05:27:44.126024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1408/2928] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:44 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:44.150510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-14ce2a97-326c-4877-b24a-e5b8de968052 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:44.159006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-14ce2a97-326c-4877-b24a-e5b8de968052 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089243 Aug 24 05:27:44.159587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1521/2929] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:44 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:44.731324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ac80649e-fe28-4362-997b-97a08c64c3de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:44.731944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ac80649e-fe28-4362-997b-97a08c64c3de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:44.738326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac80649e-fe28-4362-997b-97a08c64c3de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:44.738920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac80649e-fe28-4362-997b-97a08c64c3de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:44.739354 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac80649e-fe28-4362-997b-97a08c64c3de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:44.740040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac80649e-fe28-4362-997b-97a08c64c3de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:44.740494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac80649e-fe28-4362-997b-97a08c64c3de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:44.740915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ac80649e-fe28-4362-997b-97a08c64c3de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:44.819432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ac80649e-fe28-4362-997b-97a08c64c3de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:44.827757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ac80649e-fe28-4362-997b-97a08c64c3de tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.100367 Aug 24 05:27:44.828328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1409/2930] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:44 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:45.148692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9e1a40d8-a214-49b9-ab35-29e5b11d31e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:45.149242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9e1a40d8-a214-49b9-ab35-29e5b11d31e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:45.155292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e1a40d8-a214-49b9-ab35-29e5b11d31e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:45.155776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e1a40d8-a214-49b9-ab35-29e5b11d31e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:45.156210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e1a40d8-a214-49b9-ab35-29e5b11d31e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:45.156896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e1a40d8-a214-49b9-ab35-29e5b11d31e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:45.157345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e1a40d8-a214-49b9-ab35-29e5b11d31e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:45.157766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9e1a40d8-a214-49b9-ab35-29e5b11d31e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:45.180352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b77f97fb-9b99-4bab-afc5-331c5e1e7993 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:45.181928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b77f97fb-9b99-4bab-afc5-331c5e1e7993 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:45.188652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b77f97fb-9b99-4bab-afc5-331c5e1e7993 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:45.189139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b77f97fb-9b99-4bab-afc5-331c5e1e7993 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:45.189580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b77f97fb-9b99-4bab-afc5-331c5e1e7993 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:45.190283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b77f97fb-9b99-4bab-afc5-331c5e1e7993 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:45.190756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b77f97fb-9b99-4bab-afc5-331c5e1e7993 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:45.191187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b77f97fb-9b99-4bab-afc5-331c5e1e7993 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:45.224167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9e1a40d8-a214-49b9-ab35-29e5b11d31e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:45.233368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9e1a40d8-a214-49b9-ab35-29e5b11d31e6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089612 Aug 24 05:27:45.233954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1522/2931] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:45 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:45.264673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b77f97fb-9b99-4bab-afc5-331c5e1e7993 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:45.273186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b77f97fb-9b99-4bab-afc5-331c5e1e7993 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.096662 Aug 24 05:27:45.273760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1410/2932] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:45 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:45.849467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ba1b7145-1fe6-4e80-a022-6811c57fe404 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:45.850139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ba1b7145-1fe6-4e80-a022-6811c57fe404 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:45.856571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba1b7145-1fe6-4e80-a022-6811c57fe404 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:45.857056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba1b7145-1fe6-4e80-a022-6811c57fe404 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:45.857494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba1b7145-1fe6-4e80-a022-6811c57fe404 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:45.858186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba1b7145-1fe6-4e80-a022-6811c57fe404 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:45.858636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba1b7145-1fe6-4e80-a022-6811c57fe404 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:45.859166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ba1b7145-1fe6-4e80-a022-6811c57fe404 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:45.924792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ba1b7145-1fe6-4e80-a022-6811c57fe404 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:45.933726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ba1b7145-1fe6-4e80-a022-6811c57fe404 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088182 Aug 24 05:27:45.934309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1523/2933] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:45 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:46.145964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:27:46.146267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:27:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:27:46.254147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d08f910c-e4e9-4ce0-897f-55be1d4d6f49 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:46.254766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d08f910c-e4e9-4ce0-897f-55be1d4d6f49 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:46.262039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d08f910c-e4e9-4ce0-897f-55be1d4d6f49 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:46.262569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d08f910c-e4e9-4ce0-897f-55be1d4d6f49 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:46.262987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d08f910c-e4e9-4ce0-897f-55be1d4d6f49 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:46.263723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d08f910c-e4e9-4ce0-897f-55be1d4d6f49 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:46.264213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d08f910c-e4e9-4ce0-897f-55be1d4d6f49 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:46.264549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d08f910c-e4e9-4ce0-897f-55be1d4d6f49 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:46.293801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0a5854d4-4493-40d5-bd2d-186fbe9034a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:46.294410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0a5854d4-4493-40d5-bd2d-186fbe9034a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:46.300915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a5854d4-4493-40d5-bd2d-186fbe9034a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:46.301398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a5854d4-4493-40d5-bd2d-186fbe9034a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:46.301823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a5854d4-4493-40d5-bd2d-186fbe9034a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:46.302505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a5854d4-4493-40d5-bd2d-186fbe9034a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:46.303600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a5854d4-4493-40d5-bd2d-186fbe9034a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:46.304329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0a5854d4-4493-40d5-bd2d-186fbe9034a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:46.333172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d08f910c-e4e9-4ce0-897f-55be1d4d6f49 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:46.343973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d08f910c-e4e9-4ce0-897f-55be1d4d6f49 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093590 Aug 24 05:27:46.344925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1411/2934] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:46 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:46.372876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0a5854d4-4493-40d5-bd2d-186fbe9034a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:46.381504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0a5854d4-4493-40d5-bd2d-186fbe9034a5 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091568 Aug 24 05:27:46.382080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1524/2935] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:46 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:46.955093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ecaf56c4-8a88-4d49-b933-63d74e0d44ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:46.955692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ecaf56c4-8a88-4d49-b933-63d74e0d44ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:46.962404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecaf56c4-8a88-4d49-b933-63d74e0d44ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:46.962914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecaf56c4-8a88-4d49-b933-63d74e0d44ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:46.963346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecaf56c4-8a88-4d49-b933-63d74e0d44ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:46.964028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecaf56c4-8a88-4d49-b933-63d74e0d44ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:46.964475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecaf56c4-8a88-4d49-b933-63d74e0d44ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:46.964893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ecaf56c4-8a88-4d49-b933-63d74e0d44ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:47.027478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ecaf56c4-8a88-4d49-b933-63d74e0d44ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:47.035931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ecaf56c4-8a88-4d49-b933-63d74e0d44ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084687 Aug 24 05:27:47.036491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1412/2936] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:46 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:47.367027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7b2da8e9-f212-4b92-9435-059253856a90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:47.367597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7b2da8e9-f212-4b92-9435-059253856a90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:47.374056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2da8e9-f212-4b92-9435-059253856a90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:47.374526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2da8e9-f212-4b92-9435-059253856a90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:47.374993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2da8e9-f212-4b92-9435-059253856a90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:47.375676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2da8e9-f212-4b92-9435-059253856a90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:47.376145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2da8e9-f212-4b92-9435-059253856a90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:47.376558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2da8e9-f212-4b92-9435-059253856a90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:47.402213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-50a84ee9-0bde-4d74-847e-2050371c584d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:47.402837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-50a84ee9-0bde-4d74-847e-2050371c584d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:47.409389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a84ee9-0bde-4d74-847e-2050371c584d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:47.409868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a84ee9-0bde-4d74-847e-2050371c584d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:47.411149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a84ee9-0bde-4d74-847e-2050371c584d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:47.411882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a84ee9-0bde-4d74-847e-2050371c584d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:47.412393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a84ee9-0bde-4d74-847e-2050371c584d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:47.415703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a84ee9-0bde-4d74-847e-2050371c584d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:47.441472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7b2da8e9-f212-4b92-9435-059253856a90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:47.450797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7b2da8e9-f212-4b92-9435-059253856a90 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089503 Aug 24 05:27:47.451596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1525/2937] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:47 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:47.482308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-50a84ee9-0bde-4d74-847e-2050371c584d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:47.490814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-50a84ee9-0bde-4d74-847e-2050371c584d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092645 Aug 24 05:27:47.491518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1413/2938] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:47 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:48.058271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8be0ebff-2de6-4e49-87b0-955da36cf033 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:48.058939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8be0ebff-2de6-4e49-87b0-955da36cf033 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:48.065041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8be0ebff-2de6-4e49-87b0-955da36cf033 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:48.065536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8be0ebff-2de6-4e49-87b0-955da36cf033 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:48.065971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8be0ebff-2de6-4e49-87b0-955da36cf033 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:48.066926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8be0ebff-2de6-4e49-87b0-955da36cf033 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:48.067391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8be0ebff-2de6-4e49-87b0-955da36cf033 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:48.067988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8be0ebff-2de6-4e49-87b0-955da36cf033 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:48.135168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8be0ebff-2de6-4e49-87b0-955da36cf033 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:48.143571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8be0ebff-2de6-4e49-87b0-955da36cf033 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089476 Aug 24 05:27:48.144138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1526/2939] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:48 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:48.473804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-df26fc83-113d-4e66-9fdf-5bb9bb70b40a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:48.474405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-df26fc83-113d-4e66-9fdf-5bb9bb70b40a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:48.481364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df26fc83-113d-4e66-9fdf-5bb9bb70b40a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:48.481841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df26fc83-113d-4e66-9fdf-5bb9bb70b40a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:48.482270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df26fc83-113d-4e66-9fdf-5bb9bb70b40a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:48.483007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df26fc83-113d-4e66-9fdf-5bb9bb70b40a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:48.483470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df26fc83-113d-4e66-9fdf-5bb9bb70b40a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:48.483897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-df26fc83-113d-4e66-9fdf-5bb9bb70b40a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:48.512294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-23df8a0b-63d0-49be-a211-a5adcd5c4e4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:48.512983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-23df8a0b-63d0-49be-a211-a5adcd5c4e4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:48.519878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23df8a0b-63d0-49be-a211-a5adcd5c4e4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:48.520371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23df8a0b-63d0-49be-a211-a5adcd5c4e4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:48.520808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23df8a0b-63d0-49be-a211-a5adcd5c4e4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:48.521627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23df8a0b-63d0-49be-a211-a5adcd5c4e4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:48.522081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23df8a0b-63d0-49be-a211-a5adcd5c4e4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:48.522504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23df8a0b-63d0-49be-a211-a5adcd5c4e4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:48.554517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-df26fc83-113d-4e66-9fdf-5bb9bb70b40a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:48.563383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-df26fc83-113d-4e66-9fdf-5bb9bb70b40a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093793 Aug 24 05:27:48.563967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1414/2940] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:48 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:48.588645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-23df8a0b-63d0-49be-a211-a5adcd5c4e4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:48.596957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-23df8a0b-63d0-49be-a211-a5adcd5c4e4a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.088452 Aug 24 05:27:48.597538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1527/2941] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:48 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:49.166092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f94d1833-a342-4285-8c75-17a4bc0153cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:49.166610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f94d1833-a342-4285-8c75-17a4bc0153cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:49.168479 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=82 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:49.174160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94d1833-a342-4285-8c75-17a4bc0153cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:49.174651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94d1833-a342-4285-8c75-17a4bc0153cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:49.175124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94d1833-a342-4285-8c75-17a4bc0153cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:49.175821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94d1833-a342-4285-8c75-17a4bc0153cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:49.176274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94d1833-a342-4285-8c75-17a4bc0153cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:49.176700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f94d1833-a342-4285-8c75-17a4bc0153cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:49.179680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:49.244084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f94d1833-a342-4285-8c75-17a4bc0153cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:49.252653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f94d1833-a342-4285-8c75-17a4bc0153cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091215 Aug 24 05:27:49.253207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1415/2942] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:49 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:49.586301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5bd0d47d-fb9d-4150-9706-c49229db1aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:49.586942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5bd0d47d-fb9d-4150-9706-c49229db1aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:49.593487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5bd0d47d-fb9d-4150-9706-c49229db1aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:49.593965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5bd0d47d-fb9d-4150-9706-c49229db1aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:49.594395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5bd0d47d-fb9d-4150-9706-c49229db1aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:49.595116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5bd0d47d-fb9d-4150-9706-c49229db1aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:49.595564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5bd0d47d-fb9d-4150-9706-c49229db1aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:49.595980 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5bd0d47d-fb9d-4150-9706-c49229db1aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:49.617606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fc8a8c7c-a162-40bc-a2b1-7eda62dcf5fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:49.618210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fc8a8c7c-a162-40bc-a2b1-7eda62dcf5fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:49.624889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc8a8c7c-a162-40bc-a2b1-7eda62dcf5fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:49.625374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc8a8c7c-a162-40bc-a2b1-7eda62dcf5fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:49.625813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc8a8c7c-a162-40bc-a2b1-7eda62dcf5fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:49.626508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc8a8c7c-a162-40bc-a2b1-7eda62dcf5fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:49.626989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc8a8c7c-a162-40bc-a2b1-7eda62dcf5fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:49.627416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fc8a8c7c-a162-40bc-a2b1-7eda62dcf5fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:49.661887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5bd0d47d-fb9d-4150-9706-c49229db1aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:49.670932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5bd0d47d-fb9d-4150-9706-c49229db1aa0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089433 Aug 24 05:27:49.671524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1528/2943] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:49 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:49.701149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fc8a8c7c-a162-40bc-a2b1-7eda62dcf5fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:49.713306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fc8a8c7c-a162-40bc-a2b1-7eda62dcf5fa tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.099491 Aug 24 05:27:49.714389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1416/2944] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:49 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:50.273381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d66e6e5b-876d-46ad-815c-633d7fb59149 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:50.273992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d66e6e5b-876d-46ad-815c-633d7fb59149 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:50.280385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d66e6e5b-876d-46ad-815c-633d7fb59149 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:50.281019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d66e6e5b-876d-46ad-815c-633d7fb59149 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:50.281590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d66e6e5b-876d-46ad-815c-633d7fb59149 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:50.282295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d66e6e5b-876d-46ad-815c-633d7fb59149 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:50.282805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d66e6e5b-876d-46ad-815c-633d7fb59149 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:50.283256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d66e6e5b-876d-46ad-815c-633d7fb59149 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:50.346987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d66e6e5b-876d-46ad-815c-633d7fb59149 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:50.356125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d66e6e5b-876d-46ad-815c-633d7fb59149 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086726 Aug 24 05:27:50.356704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1529/2945] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:50 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:50.694523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3c9c2766-daea-4e9e-b7e6-7fac67688a0b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:50.695591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3c9c2766-daea-4e9e-b7e6-7fac67688a0b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:50.702243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9c2766-daea-4e9e-b7e6-7fac67688a0b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:50.702758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9c2766-daea-4e9e-b7e6-7fac67688a0b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:50.703200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9c2766-daea-4e9e-b7e6-7fac67688a0b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:50.703901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9c2766-daea-4e9e-b7e6-7fac67688a0b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:50.704358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9c2766-daea-4e9e-b7e6-7fac67688a0b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:50.704779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c9c2766-daea-4e9e-b7e6-7fac67688a0b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:50.739414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b3d00383-0bbf-414f-ac75-d06286f11012 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:50.739814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b3d00383-0bbf-414f-ac75-d06286f11012 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:50.746741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3d00383-0bbf-414f-ac75-d06286f11012 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:50.747232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3d00383-0bbf-414f-ac75-d06286f11012 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:50.747668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3d00383-0bbf-414f-ac75-d06286f11012 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:50.748407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3d00383-0bbf-414f-ac75-d06286f11012 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:50.753176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3d00383-0bbf-414f-ac75-d06286f11012 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:50.753655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3d00383-0bbf-414f-ac75-d06286f11012 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:50.776056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c9c2766-daea-4e9e-b7e6-7fac67688a0b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:50.785116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3c9c2766-daea-4e9e-b7e6-7fac67688a0b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094881 Aug 24 05:27:50.786003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1417/2946] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:50 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:50.824412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b3d00383-0bbf-414f-ac75-d06286f11012 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:50.832669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b3d00383-0bbf-414f-ac75-d06286f11012 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.101700 Aug 24 05:27:50.833225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1530/2947] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:50 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:51.378154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a62299f4-ae63-48e4-95e4-89de7d3231fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:51.380247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a62299f4-ae63-48e4-95e4-89de7d3231fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:51.385929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a62299f4-ae63-48e4-95e4-89de7d3231fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:51.386409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a62299f4-ae63-48e4-95e4-89de7d3231fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:51.386878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a62299f4-ae63-48e4-95e4-89de7d3231fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:51.387561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a62299f4-ae63-48e4-95e4-89de7d3231fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:51.388006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a62299f4-ae63-48e4-95e4-89de7d3231fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:51.388428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a62299f4-ae63-48e4-95e4-89de7d3231fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:51.457248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a62299f4-ae63-48e4-95e4-89de7d3231fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:51.466716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a62299f4-ae63-48e4-95e4-89de7d3231fa tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.092328 Aug 24 05:27:51.467318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1418/2948] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:51 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:51.805456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-15a42551-3b60-4e47-86d6-35a1a05d9b40 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:51.806138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-15a42551-3b60-4e47-86d6-35a1a05d9b40 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:51.813182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15a42551-3b60-4e47-86d6-35a1a05d9b40 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:51.813662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15a42551-3b60-4e47-86d6-35a1a05d9b40 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:51.814158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15a42551-3b60-4e47-86d6-35a1a05d9b40 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:51.814814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15a42551-3b60-4e47-86d6-35a1a05d9b40 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:51.815260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15a42551-3b60-4e47-86d6-35a1a05d9b40 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:51.815677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-15a42551-3b60-4e47-86d6-35a1a05d9b40 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:51.853648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-79bde2ab-c0e5-45c4-b291-4faa9a34d7ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:51.854253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-79bde2ab-c0e5-45c4-b291-4faa9a34d7ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:51.861073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79bde2ab-c0e5-45c4-b291-4faa9a34d7ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:51.861552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79bde2ab-c0e5-45c4-b291-4faa9a34d7ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:51.862088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79bde2ab-c0e5-45c4-b291-4faa9a34d7ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:51.862833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79bde2ab-c0e5-45c4-b291-4faa9a34d7ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:51.863281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79bde2ab-c0e5-45c4-b291-4faa9a34d7ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:51.863687 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79bde2ab-c0e5-45c4-b291-4faa9a34d7ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:51.879010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-15a42551-3b60-4e47-86d6-35a1a05d9b40 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:51.888236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-15a42551-3b60-4e47-86d6-35a1a05d9b40 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086648 Aug 24 05:27:51.888821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1531/2949] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:51 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:51.927487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-79bde2ab-c0e5-45c4-b291-4faa9a34d7ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:51.936291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-79bde2ab-c0e5-45c4-b291-4faa9a34d7ae tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086848 Aug 24 05:27:51.936867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1419/2950] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:51 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:52.488624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-eff6aa7f-9774-46b3-b4ff-aa5b85f36fdf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:52.489244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-eff6aa7f-9774-46b3-b4ff-aa5b85f36fdf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:52.495636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eff6aa7f-9774-46b3-b4ff-aa5b85f36fdf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:52.496118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eff6aa7f-9774-46b3-b4ff-aa5b85f36fdf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:52.496554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eff6aa7f-9774-46b3-b4ff-aa5b85f36fdf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:52.497244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eff6aa7f-9774-46b3-b4ff-aa5b85f36fdf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:52.497697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eff6aa7f-9774-46b3-b4ff-aa5b85f36fdf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:52.498120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-eff6aa7f-9774-46b3-b4ff-aa5b85f36fdf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:52.564820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-eff6aa7f-9774-46b3-b4ff-aa5b85f36fdf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:52.574325 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-eff6aa7f-9774-46b3-b4ff-aa5b85f36fdf tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089504 Aug 24 05:27:52.574946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1532/2951] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:52 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:52.909603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dc14e7d3-f067-419a-a8b6-ea5da569cd37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:52.910186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dc14e7d3-f067-419a-a8b6-ea5da569cd37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:52.917329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc14e7d3-f067-419a-a8b6-ea5da569cd37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:52.917810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc14e7d3-f067-419a-a8b6-ea5da569cd37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:52.918242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc14e7d3-f067-419a-a8b6-ea5da569cd37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:52.918954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc14e7d3-f067-419a-a8b6-ea5da569cd37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:52.919406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc14e7d3-f067-419a-a8b6-ea5da569cd37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:52.919861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc14e7d3-f067-419a-a8b6-ea5da569cd37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:52.957577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a4ffbe44-9727-436d-8cf7-7c10ed9456a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:52.958180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a4ffbe44-9727-436d-8cf7-7c10ed9456a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:52.961290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=82 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:52.967065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ffbe44-9727-436d-8cf7-7c10ed9456a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:52.967560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ffbe44-9727-436d-8cf7-7c10ed9456a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:52.967995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ffbe44-9727-436d-8cf7-7c10ed9456a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:52.968701 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ffbe44-9727-436d-8cf7-7c10ed9456a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:52.969149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ffbe44-9727-436d-8cf7-7c10ed9456a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:52.969575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4ffbe44-9727-436d-8cf7-7c10ed9456a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:52.989803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dc14e7d3-f067-419a-a8b6-ea5da569cd37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:52.990377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:27:52.999177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dc14e7d3-f067-419a-a8b6-ea5da569cd37 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093423 Aug 24 05:27:52.999755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1420/2952] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:52 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:53.038998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a4ffbe44-9727-436d-8cf7-7c10ed9456a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:53.047443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a4ffbe44-9727-436d-8cf7-7c10ed9456a4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093756 Aug 24 05:27:53.048016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1533/2953] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:52 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:53.596240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-09e3f0d9-53e9-4c6c-b53f-b22761a5e47f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:53.596855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-09e3f0d9-53e9-4c6c-b53f-b22761a5e47f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:53.603257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e3f0d9-53e9-4c6c-b53f-b22761a5e47f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:53.603740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e3f0d9-53e9-4c6c-b53f-b22761a5e47f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:53.604171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e3f0d9-53e9-4c6c-b53f-b22761a5e47f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:53.604859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e3f0d9-53e9-4c6c-b53f-b22761a5e47f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:53.605309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e3f0d9-53e9-4c6c-b53f-b22761a5e47f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:53.605763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-09e3f0d9-53e9-4c6c-b53f-b22761a5e47f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:53.673559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-09e3f0d9-53e9-4c6c-b53f-b22761a5e47f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:53.684789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-09e3f0d9-53e9-4c6c-b53f-b22761a5e47f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091117 Aug 24 05:27:53.685365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1421/2954] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:53 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:54.020808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2781cab2-fa76-41a3-8e60-1162d5fe21cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:54.021522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2781cab2-fa76-41a3-8e60-1162d5fe21cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:54.028303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2781cab2-fa76-41a3-8e60-1162d5fe21cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:54.028772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2781cab2-fa76-41a3-8e60-1162d5fe21cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:54.029222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2781cab2-fa76-41a3-8e60-1162d5fe21cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:54.029901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2781cab2-fa76-41a3-8e60-1162d5fe21cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:54.030343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2781cab2-fa76-41a3-8e60-1162d5fe21cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:54.030791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2781cab2-fa76-41a3-8e60-1162d5fe21cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:54.068564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-641e1e9f-7a99-4ab0-97a3-117cf1e2dfe9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:54.069309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-641e1e9f-7a99-4ab0-97a3-117cf1e2dfe9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:54.076173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-641e1e9f-7a99-4ab0-97a3-117cf1e2dfe9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:54.076663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-641e1e9f-7a99-4ab0-97a3-117cf1e2dfe9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:54.077104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-641e1e9f-7a99-4ab0-97a3-117cf1e2dfe9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:54.077810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-641e1e9f-7a99-4ab0-97a3-117cf1e2dfe9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:54.078299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-641e1e9f-7a99-4ab0-97a3-117cf1e2dfe9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:54.078745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-641e1e9f-7a99-4ab0-97a3-117cf1e2dfe9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:54.100470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2781cab2-fa76-41a3-8e60-1162d5fe21cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:54.108501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2781cab2-fa76-41a3-8e60-1162d5fe21cb tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091068 Aug 24 05:27:54.108501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1534/2955] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:54 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:54.144616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-641e1e9f-7a99-4ab0-97a3-117cf1e2dfe9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:54.153923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-641e1e9f-7a99-4ab0-97a3-117cf1e2dfe9 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089411 Aug 24 05:27:54.154496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1422/2956] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:54 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:54.710065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-23b864ce-b294-4daf-8988-d769d1648171 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:54.710673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-23b864ce-b294-4daf-8988-d769d1648171 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:54.716726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23b864ce-b294-4daf-8988-d769d1648171 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:54.717206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23b864ce-b294-4daf-8988-d769d1648171 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:54.717639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23b864ce-b294-4daf-8988-d769d1648171 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:54.718323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23b864ce-b294-4daf-8988-d769d1648171 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:54.718807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23b864ce-b294-4daf-8988-d769d1648171 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:54.719236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-23b864ce-b294-4daf-8988-d769d1648171 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:54.784547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-23b864ce-b294-4daf-8988-d769d1648171 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:54.792975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-23b864ce-b294-4daf-8988-d769d1648171 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087259 Aug 24 05:27:54.793561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1535/2957] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:54 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:55.130288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9bc8419f-95ad-4981-ba60-2227ce3ac429 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:55.131000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9bc8419f-95ad-4981-ba60-2227ce3ac429 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:55.137692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bc8419f-95ad-4981-ba60-2227ce3ac429 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:55.138173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bc8419f-95ad-4981-ba60-2227ce3ac429 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:55.138605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bc8419f-95ad-4981-ba60-2227ce3ac429 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:55.139322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bc8419f-95ad-4981-ba60-2227ce3ac429 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:55.139765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bc8419f-95ad-4981-ba60-2227ce3ac429 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:55.140181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9bc8419f-95ad-4981-ba60-2227ce3ac429 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:55.174434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cd6a233a-f9cf-462b-acea-c955d642c341 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:55.175084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cd6a233a-f9cf-462b-acea-c955d642c341 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:55.182116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6a233a-f9cf-462b-acea-c955d642c341 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:55.182605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6a233a-f9cf-462b-acea-c955d642c341 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:55.183105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6a233a-f9cf-462b-acea-c955d642c341 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:55.183817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6a233a-f9cf-462b-acea-c955d642c341 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:55.184270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6a233a-f9cf-462b-acea-c955d642c341 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:55.184695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd6a233a-f9cf-462b-acea-c955d642c341 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:55.206048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9bc8419f-95ad-4981-ba60-2227ce3ac429 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:55.216738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9bc8419f-95ad-4981-ba60-2227ce3ac429 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090363 Aug 24 05:27:55.217317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1423/2958] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:55 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:55.249319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cd6a233a-f9cf-462b-acea-c955d642c341 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:55.258044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cd6a233a-f9cf-462b-acea-c955d642c341 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087586 Aug 24 05:27:55.258625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1536/2959] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:55 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:55.813573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-50a519db-df48-48d1-898e-72caab3d3a48 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:55.814185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-50a519db-df48-48d1-898e-72caab3d3a48 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:55.820626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a519db-df48-48d1-898e-72caab3d3a48 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:55.821112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a519db-df48-48d1-898e-72caab3d3a48 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:55.821555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a519db-df48-48d1-898e-72caab3d3a48 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:55.822249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a519db-df48-48d1-898e-72caab3d3a48 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:55.822723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a519db-df48-48d1-898e-72caab3d3a48 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:55.823152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-50a519db-df48-48d1-898e-72caab3d3a48 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:55.886440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-50a519db-df48-48d1-898e-72caab3d3a48 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:55.894837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-50a519db-df48-48d1-898e-72caab3d3a48 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085047 Aug 24 05:27:55.895409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1424/2960] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:55 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:56.238217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f13e06d8-a088-4667-b16b-93d0ad66d85f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:56.238839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f13e06d8-a088-4667-b16b-93d0ad66d85f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:56.245780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f13e06d8-a088-4667-b16b-93d0ad66d85f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:56.246260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f13e06d8-a088-4667-b16b-93d0ad66d85f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:56.246702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f13e06d8-a088-4667-b16b-93d0ad66d85f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:56.247401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f13e06d8-a088-4667-b16b-93d0ad66d85f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:56.247848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f13e06d8-a088-4667-b16b-93d0ad66d85f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:56.248274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f13e06d8-a088-4667-b16b-93d0ad66d85f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:56.278955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cbd2248b-0b09-47c2-bbae-872e20dda7af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:56.279566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cbd2248b-0b09-47c2-bbae-872e20dda7af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:56.287111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbd2248b-0b09-47c2-bbae-872e20dda7af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:56.287623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbd2248b-0b09-47c2-bbae-872e20dda7af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:56.288095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbd2248b-0b09-47c2-bbae-872e20dda7af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:56.288844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbd2248b-0b09-47c2-bbae-872e20dda7af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:56.289289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbd2248b-0b09-47c2-bbae-872e20dda7af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:56.289704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cbd2248b-0b09-47c2-bbae-872e20dda7af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:56.314097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f13e06d8-a088-4667-b16b-93d0ad66d85f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:56.323726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f13e06d8-a088-4667-b16b-93d0ad66d85f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089282 Aug 24 05:27:56.324314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1537/2961] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:56 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:56.362003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cbd2248b-0b09-47c2-bbae-872e20dda7af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:56.370599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cbd2248b-0b09-47c2-bbae-872e20dda7af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095501 Aug 24 05:27:56.371213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1425/2962] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:56 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:56.916287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7db38e87-3812-4f2f-b59d-282fef69f3c5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:56.916884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7db38e87-3812-4f2f-b59d-282fef69f3c5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:56.923451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7db38e87-3812-4f2f-b59d-282fef69f3c5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:56.923936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7db38e87-3812-4f2f-b59d-282fef69f3c5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:56.924370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7db38e87-3812-4f2f-b59d-282fef69f3c5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:56.925060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7db38e87-3812-4f2f-b59d-282fef69f3c5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:56.925520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7db38e87-3812-4f2f-b59d-282fef69f3c5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:56.925938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7db38e87-3812-4f2f-b59d-282fef69f3c5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:56.993072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7db38e87-3812-4f2f-b59d-282fef69f3c5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:57.001450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7db38e87-3812-4f2f-b59d-282fef69f3c5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088996 Aug 24 05:27:57.002015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1538/2963] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:56 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:57.348285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2da06d95-7a54-4148-86b6-39fe2cbd130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:57.348860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2da06d95-7a54-4148-86b6-39fe2cbd130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:57.356271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2da06d95-7a54-4148-86b6-39fe2cbd130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:57.356754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2da06d95-7a54-4148-86b6-39fe2cbd130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:57.357188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2da06d95-7a54-4148-86b6-39fe2cbd130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:57.357882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2da06d95-7a54-4148-86b6-39fe2cbd130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:57.358328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2da06d95-7a54-4148-86b6-39fe2cbd130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:57.358768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2da06d95-7a54-4148-86b6-39fe2cbd130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:57.392936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7085f1bb-7cf6-4242-a02e-f891d4529d1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:57.393538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7085f1bb-7cf6-4242-a02e-f891d4529d1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:57.400302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7085f1bb-7cf6-4242-a02e-f891d4529d1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:57.400789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7085f1bb-7cf6-4242-a02e-f891d4529d1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:57.401219 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7085f1bb-7cf6-4242-a02e-f891d4529d1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:57.401913 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7085f1bb-7cf6-4242-a02e-f891d4529d1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:57.402366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7085f1bb-7cf6-4242-a02e-f891d4529d1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:57.402811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7085f1bb-7cf6-4242-a02e-f891d4529d1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:57.424790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2da06d95-7a54-4148-86b6-39fe2cbd130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:57.434965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2da06d95-7a54-4148-86b6-39fe2cbd130f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090535 Aug 24 05:27:57.435634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1426/2964] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:57 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:57.475386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7085f1bb-7cf6-4242-a02e-f891d4529d1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:57.483867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7085f1bb-7cf6-4242-a02e-f891d4529d1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095294 Aug 24 05:27:57.484417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1539/2965] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:57 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:27:58.022816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-66b2999c-83ba-4ea1-915f-2cba267b2dde tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:58.023343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-66b2999c-83ba-4ea1-915f-2cba267b2dde tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:58.029435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b2999c-83ba-4ea1-915f-2cba267b2dde tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:58.029943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b2999c-83ba-4ea1-915f-2cba267b2dde tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:58.030382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b2999c-83ba-4ea1-915f-2cba267b2dde tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:58.031109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b2999c-83ba-4ea1-915f-2cba267b2dde tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:58.031561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b2999c-83ba-4ea1-915f-2cba267b2dde tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:58.031987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b2999c-83ba-4ea1-915f-2cba267b2dde tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:58.095700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-66b2999c-83ba-4ea1-915f-2cba267b2dde tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:58.104757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-66b2999c-83ba-4ea1-915f-2cba267b2dde tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086141 Aug 24 05:27:58.105339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1427/2966] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:58 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:58.455922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7eb2569e-0081-4314-adf6-35850a12ddb0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:58.456516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7eb2569e-0081-4314-adf6-35850a12ddb0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:58.463907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eb2569e-0081-4314-adf6-35850a12ddb0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:58.464390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eb2569e-0081-4314-adf6-35850a12ddb0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:58.464829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eb2569e-0081-4314-adf6-35850a12ddb0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:58.465523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eb2569e-0081-4314-adf6-35850a12ddb0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:58.465975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eb2569e-0081-4314-adf6-35850a12ddb0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:58.466399 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7eb2569e-0081-4314-adf6-35850a12ddb0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:58.505167 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-64fd023c-f22d-4bab-b52a-d120c36cf53b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:58.506371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-64fd023c-f22d-4bab-b52a-d120c36cf53b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:58.513098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64fd023c-f22d-4bab-b52a-d120c36cf53b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:58.513585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64fd023c-f22d-4bab-b52a-d120c36cf53b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:58.514033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64fd023c-f22d-4bab-b52a-d120c36cf53b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:58.514882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64fd023c-f22d-4bab-b52a-d120c36cf53b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:58.515339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64fd023c-f22d-4bab-b52a-d120c36cf53b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:58.516081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-64fd023c-f22d-4bab-b52a-d120c36cf53b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:58.535239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7eb2569e-0081-4314-adf6-35850a12ddb0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:58.543853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7eb2569e-0081-4314-adf6-35850a12ddb0 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091788 Aug 24 05:27:58.544426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1540/2967] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:58 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:58.587019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-64fd023c-f22d-4bab-b52a-d120c36cf53b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:58.595388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-64fd023c-f22d-4bab-b52a-d120c36cf53b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093977 Aug 24 05:27:58.595961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1428/2968] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:58 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:59.125512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-871d1861-c915-458a-89bc-efc809d7aebc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:59.126128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-871d1861-c915-458a-89bc-efc809d7aebc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:59.132577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-871d1861-c915-458a-89bc-efc809d7aebc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:59.133060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-871d1861-c915-458a-89bc-efc809d7aebc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:59.133495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-871d1861-c915-458a-89bc-efc809d7aebc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:59.134186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-871d1861-c915-458a-89bc-efc809d7aebc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:59.134640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-871d1861-c915-458a-89bc-efc809d7aebc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:59.135088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-871d1861-c915-458a-89bc-efc809d7aebc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:59.201237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-871d1861-c915-458a-89bc-efc809d7aebc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:59.210494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-871d1861-c915-458a-89bc-efc809d7aebc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088776 Aug 24 05:27:59.211100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1541/2969] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:59 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:59.565137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7b7d30d2-5f97-4ba5-9de4-49e55b0eebee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:59.565940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7b7d30d2-5f97-4ba5-9de4-49e55b0eebee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:59.572725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7d30d2-5f97-4ba5-9de4-49e55b0eebee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:59.573208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7d30d2-5f97-4ba5-9de4-49e55b0eebee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:59.573641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7d30d2-5f97-4ba5-9de4-49e55b0eebee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:59.574331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7d30d2-5f97-4ba5-9de4-49e55b0eebee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:59.574805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7d30d2-5f97-4ba5-9de4-49e55b0eebee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:59.575224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b7d30d2-5f97-4ba5-9de4-49e55b0eebee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:59.617357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-59ce98ad-07f2-4d20-96db-827286070a45 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:27:59.617996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-59ce98ad-07f2-4d20-96db-827286070a45 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:27:59.624672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59ce98ad-07f2-4d20-96db-827286070a45 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:59.625147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59ce98ad-07f2-4d20-96db-827286070a45 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:59.625579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59ce98ad-07f2-4d20-96db-827286070a45 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:59.626266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59ce98ad-07f2-4d20-96db-827286070a45 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:27:59.626736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59ce98ad-07f2-4d20-96db-827286070a45 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:27:59.627157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59ce98ad-07f2-4d20-96db-827286070a45 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:27:59.645061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7b7d30d2-5f97-4ba5-9de4-49e55b0eebee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:59.654122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7b7d30d2-5f97-4ba5-9de4-49e55b0eebee tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092929 Aug 24 05:27:59.654711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1429/2970] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:59 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:27:59.693809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-59ce98ad-07f2-4d20-96db-827286070a45 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:27:59.702536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-59ce98ad-07f2-4d20-96db-827286070a45 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089925 Aug 24 05:27:59.703162 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1542/2971] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:27:59 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:00.231872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-65b34dce-c2f9-4018-943b-b8881de7c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:00.232476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-65b34dce-c2f9-4018-943b-b8881de7c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:00.238538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b34dce-c2f9-4018-943b-b8881de7c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:00.239045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b34dce-c2f9-4018-943b-b8881de7c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:00.239473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b34dce-c2f9-4018-943b-b8881de7c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:00.240158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b34dce-c2f9-4018-943b-b8881de7c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:00.241237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b34dce-c2f9-4018-943b-b8881de7c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:00.241656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-65b34dce-c2f9-4018-943b-b8881de7c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:00.307356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-65b34dce-c2f9-4018-943b-b8881de7c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:00.315909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-65b34dce-c2f9-4018-943b-b8881de7c5e8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087840 Aug 24 05:28:00.316504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1430/2972] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:00 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:00.675759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0e34f470-e096-4696-9d0b-ad1c4fd8ba7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:00.676467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0e34f470-e096-4696-9d0b-ad1c4fd8ba7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:00.685775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e34f470-e096-4696-9d0b-ad1c4fd8ba7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:00.686262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e34f470-e096-4696-9d0b-ad1c4fd8ba7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:00.686717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e34f470-e096-4696-9d0b-ad1c4fd8ba7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:00.687547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e34f470-e096-4696-9d0b-ad1c4fd8ba7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:00.688063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e34f470-e096-4696-9d0b-ad1c4fd8ba7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:00.688469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e34f470-e096-4696-9d0b-ad1c4fd8ba7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:00.723457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3620cc6b-827b-4218-948f-b8740a202908 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:00.724081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3620cc6b-827b-4218-948f-b8740a202908 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:00.732011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3620cc6b-827b-4218-948f-b8740a202908 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:00.732498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3620cc6b-827b-4218-948f-b8740a202908 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:00.732938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3620cc6b-827b-4218-948f-b8740a202908 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:00.733628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3620cc6b-827b-4218-948f-b8740a202908 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:00.734285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3620cc6b-827b-4218-948f-b8740a202908 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:00.734727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3620cc6b-827b-4218-948f-b8740a202908 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:00.757271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0e34f470-e096-4696-9d0b-ad1c4fd8ba7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:00.765792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0e34f470-e096-4696-9d0b-ad1c4fd8ba7a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094183 Aug 24 05:28:00.766365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1543/2973] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:00 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:00.803665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3620cc6b-827b-4218-948f-b8740a202908 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:00.805989 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:00.814073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3620cc6b-827b-4218-948f-b8740a202908 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.094425 Aug 24 05:28:00.814652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1431/2974] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:00 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:01.337278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e3f0d9d3-b716-489f-bc2e-b066ca65e840 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:01.337887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e3f0d9d3-b716-489f-bc2e-b066ca65e840 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:01.344082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3f0d9d3-b716-489f-bc2e-b066ca65e840 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:01.344567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3f0d9d3-b716-489f-bc2e-b066ca65e840 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:01.345007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3f0d9d3-b716-489f-bc2e-b066ca65e840 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:01.345702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3f0d9d3-b716-489f-bc2e-b066ca65e840 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:01.346152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3f0d9d3-b716-489f-bc2e-b066ca65e840 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:01.346576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e3f0d9d3-b716-489f-bc2e-b066ca65e840 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:01.409873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e3f0d9d3-b716-489f-bc2e-b066ca65e840 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:01.427364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e3f0d9d3-b716-489f-bc2e-b066ca65e840 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.094556 Aug 24 05:28:01.427986 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1544/2975] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:01 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:01.791283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f5eb8cf3-fea7-44e6-a210-95ce8a0cc4ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:01.791283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f5eb8cf3-fea7-44e6-a210-95ce8a0cc4ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:01.796085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5eb8cf3-fea7-44e6-a210-95ce8a0cc4ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:01.796548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5eb8cf3-fea7-44e6-a210-95ce8a0cc4ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:01.797002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5eb8cf3-fea7-44e6-a210-95ce8a0cc4ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:01.797667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5eb8cf3-fea7-44e6-a210-95ce8a0cc4ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:01.798126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5eb8cf3-fea7-44e6-a210-95ce8a0cc4ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:01.798542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5eb8cf3-fea7-44e6-a210-95ce8a0cc4ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:01.835496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c6d01fcd-92f9-452b-b41d-11ad7cc6d86b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:01.836158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c6d01fcd-92f9-452b-b41d-11ad7cc6d86b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:01.843452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6d01fcd-92f9-452b-b41d-11ad7cc6d86b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:01.844086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6d01fcd-92f9-452b-b41d-11ad7cc6d86b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:01.844647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6d01fcd-92f9-452b-b41d-11ad7cc6d86b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:01.845544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6d01fcd-92f9-452b-b41d-11ad7cc6d86b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:01.846028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6d01fcd-92f9-452b-b41d-11ad7cc6d86b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:01.846524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c6d01fcd-92f9-452b-b41d-11ad7cc6d86b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:01.875169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f5eb8cf3-fea7-44e6-a210-95ce8a0cc4ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:01.884159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f5eb8cf3-fea7-44e6-a210-95ce8a0cc4ab tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.100553 Aug 24 05:28:01.885073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1432/2976] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:01 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:01.926222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c6d01fcd-92f9-452b-b41d-11ad7cc6d86b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:01.928963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c6d01fcd-92f9-452b-b41d-11ad7cc6d86b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.097644 Aug 24 05:28:01.929549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1545/2977] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:01 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:02.448430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6002d10e-e378-4ff4-bf71-c8eea3eca2e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:02.449051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6002d10e-e378-4ff4-bf71-c8eea3eca2e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:02.455169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6002d10e-e378-4ff4-bf71-c8eea3eca2e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:02.455679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6002d10e-e378-4ff4-bf71-c8eea3eca2e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:02.456114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6002d10e-e378-4ff4-bf71-c8eea3eca2e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:02.456805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6002d10e-e378-4ff4-bf71-c8eea3eca2e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:02.457258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6002d10e-e378-4ff4-bf71-c8eea3eca2e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:02.457681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6002d10e-e378-4ff4-bf71-c8eea3eca2e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:02.533939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6002d10e-e378-4ff4-bf71-c8eea3eca2e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:02.542540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6002d10e-e378-4ff4-bf71-c8eea3eca2e3 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.098619 Aug 24 05:28:02.543144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1433/2978] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:02 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:02.905148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6f77a32d-ab10-4ff0-acc0-fddf16f42488 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:02.905787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6f77a32d-ab10-4ff0-acc0-fddf16f42488 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:02.912959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f77a32d-ab10-4ff0-acc0-fddf16f42488 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:02.913455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f77a32d-ab10-4ff0-acc0-fddf16f42488 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:02.913893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f77a32d-ab10-4ff0-acc0-fddf16f42488 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:02.914584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f77a32d-ab10-4ff0-acc0-fddf16f42488 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:02.915065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f77a32d-ab10-4ff0-acc0-fddf16f42488 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:02.915486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f77a32d-ab10-4ff0-acc0-fddf16f42488 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:02.949772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-870deaba-dd6c-4387-8400-ce568d13dae8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:02.950380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-870deaba-dd6c-4387-8400-ce568d13dae8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:02.957193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-870deaba-dd6c-4387-8400-ce568d13dae8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:02.957677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-870deaba-dd6c-4387-8400-ce568d13dae8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:02.958112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-870deaba-dd6c-4387-8400-ce568d13dae8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:02.958831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-870deaba-dd6c-4387-8400-ce568d13dae8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:02.959884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-870deaba-dd6c-4387-8400-ce568d13dae8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:02.960318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-870deaba-dd6c-4387-8400-ce568d13dae8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:02.982992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6f77a32d-ab10-4ff0-acc0-fddf16f42488 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:02.991725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6f77a32d-ab10-4ff0-acc0-fddf16f42488 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090390 Aug 24 05:28:02.992303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1546/2979] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:02 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:03.025295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-870deaba-dd6c-4387-8400-ce568d13dae8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:03.033904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-870deaba-dd6c-4387-8400-ce568d13dae8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087997 Aug 24 05:28:03.034474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1434/2980] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:02 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:03.563282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1560e4fa-ffaf-429c-9eec-2a5d44027899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:03.563872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1560e4fa-ffaf-429c-9eec-2a5d44027899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:03.569937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1560e4fa-ffaf-429c-9eec-2a5d44027899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:03.570410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1560e4fa-ffaf-429c-9eec-2a5d44027899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:03.570871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1560e4fa-ffaf-429c-9eec-2a5d44027899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:03.571555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1560e4fa-ffaf-429c-9eec-2a5d44027899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:03.571998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1560e4fa-ffaf-429c-9eec-2a5d44027899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:03.572412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1560e4fa-ffaf-429c-9eec-2a5d44027899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:03.637616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1560e4fa-ffaf-429c-9eec-2a5d44027899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:03.645961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1560e4fa-ffaf-429c-9eec-2a5d44027899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086476 Aug 24 05:28:03.646535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1547/2981] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:03 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:04.012772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d0e0824c-e2fc-4c40-aae5-31dc95a8e1f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:04.013344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d0e0824c-e2fc-4c40-aae5-31dc95a8e1f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:04.019911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0e0824c-e2fc-4c40-aae5-31dc95a8e1f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:04.020395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0e0824c-e2fc-4c40-aae5-31dc95a8e1f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:04.020857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0e0824c-e2fc-4c40-aae5-31dc95a8e1f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:04.021850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0e0824c-e2fc-4c40-aae5-31dc95a8e1f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:04.022219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0e0824c-e2fc-4c40-aae5-31dc95a8e1f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:04.022645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d0e0824c-e2fc-4c40-aae5-31dc95a8e1f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:04.055460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-71209b6e-d928-4506-b589-374e30e5087d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:04.056066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-71209b6e-d928-4506-b589-374e30e5087d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:04.063131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71209b6e-d928-4506-b589-374e30e5087d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:04.063615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71209b6e-d928-4506-b589-374e30e5087d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:04.064049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71209b6e-d928-4506-b589-374e30e5087d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:04.064738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71209b6e-d928-4506-b589-374e30e5087d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:04.065186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71209b6e-d928-4506-b589-374e30e5087d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:04.065605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71209b6e-d928-4506-b589-374e30e5087d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:04.091383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d0e0824c-e2fc-4c40-aae5-31dc95a8e1f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:04.103902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d0e0824c-e2fc-4c40-aae5-31dc95a8e1f7 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094804 Aug 24 05:28:04.104761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1435/2982] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:04 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:04.139072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-71209b6e-d928-4506-b589-374e30e5087d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:04.147763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-71209b6e-d928-4506-b589-374e30e5087d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.096726 Aug 24 05:28:04.148360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1548/2983] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:04 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:04.668325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eb923a69-c908-43b5-a58e-40b807e2a5b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:04.668836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-eb923a69-c908-43b5-a58e-40b807e2a5b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:04.675493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb923a69-c908-43b5-a58e-40b807e2a5b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:04.675986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb923a69-c908-43b5-a58e-40b807e2a5b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:04.676427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb923a69-c908-43b5-a58e-40b807e2a5b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:04.677147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb923a69-c908-43b5-a58e-40b807e2a5b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:04.677601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb923a69-c908-43b5-a58e-40b807e2a5b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:04.678169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb923a69-c908-43b5-a58e-40b807e2a5b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:04.742962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-eb923a69-c908-43b5-a58e-40b807e2a5b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:04.751547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-eb923a69-c908-43b5-a58e-40b807e2a5b0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087506 Aug 24 05:28:04.752125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1436/2984] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:04 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:05.126435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-62e9d6e0-467b-4a07-a59d-b19f173a51dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:05.127093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-62e9d6e0-467b-4a07-a59d-b19f173a51dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:05.134299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62e9d6e0-467b-4a07-a59d-b19f173a51dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:05.134812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62e9d6e0-467b-4a07-a59d-b19f173a51dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:05.135252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62e9d6e0-467b-4a07-a59d-b19f173a51dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:05.135941 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62e9d6e0-467b-4a07-a59d-b19f173a51dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:05.136400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62e9d6e0-467b-4a07-a59d-b19f173a51dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:05.136822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62e9d6e0-467b-4a07-a59d-b19f173a51dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:05.169261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-38e016a9-e7d6-43eb-b676-23a040751735 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:05.169864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-38e016a9-e7d6-43eb-b676-23a040751735 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:05.176671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38e016a9-e7d6-43eb-b676-23a040751735 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:05.177162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38e016a9-e7d6-43eb-b676-23a040751735 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:05.177599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38e016a9-e7d6-43eb-b676-23a040751735 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:05.179185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38e016a9-e7d6-43eb-b676-23a040751735 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:05.179992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38e016a9-e7d6-43eb-b676-23a040751735 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:05.180575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-38e016a9-e7d6-43eb-b676-23a040751735 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:05.202277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-62e9d6e0-467b-4a07-a59d-b19f173a51dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:05.210871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-62e9d6e0-467b-4a07-a59d-b19f173a51dd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088261 Aug 24 05:28:05.211462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1549/2985] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:05 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:05.253065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-38e016a9-e7d6-43eb-b676-23a040751735 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:05.263672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-38e016a9-e7d6-43eb-b676-23a040751735 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.098637 Aug 24 05:28:05.264253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1437/2986] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:05 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:05.773723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1655fecf-90cc-4bc2-8ad9-774664cb043c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:05.774367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1655fecf-90cc-4bc2-8ad9-774664cb043c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:05.780541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1655fecf-90cc-4bc2-8ad9-774664cb043c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:05.781022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1655fecf-90cc-4bc2-8ad9-774664cb043c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:05.781462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1655fecf-90cc-4bc2-8ad9-774664cb043c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:05.782267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1655fecf-90cc-4bc2-8ad9-774664cb043c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:05.782751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1655fecf-90cc-4bc2-8ad9-774664cb043c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:05.783175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1655fecf-90cc-4bc2-8ad9-774664cb043c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:05.785892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:05.850585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1655fecf-90cc-4bc2-8ad9-774664cb043c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:05.859045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1655fecf-90cc-4bc2-8ad9-774664cb043c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089884 Aug 24 05:28:05.859646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1550/2987] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:05 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:06.232719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-abc927b2-155d-4e10-8f2f-70eba465ab91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:06.233343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-abc927b2-155d-4e10-8f2f-70eba465ab91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:06.240024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc927b2-155d-4e10-8f2f-70eba465ab91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:06.240484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc927b2-155d-4e10-8f2f-70eba465ab91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:06.240911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc927b2-155d-4e10-8f2f-70eba465ab91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:06.241596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc927b2-155d-4e10-8f2f-70eba465ab91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:06.242814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc927b2-155d-4e10-8f2f-70eba465ab91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:06.243248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abc927b2-155d-4e10-8f2f-70eba465ab91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:06.285015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b54a2c92-21cf-4025-ac18-ede21e2dd9d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:06.285625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b54a2c92-21cf-4025-ac18-ede21e2dd9d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:06.292367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b54a2c92-21cf-4025-ac18-ede21e2dd9d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:06.292882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b54a2c92-21cf-4025-ac18-ede21e2dd9d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:06.293317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b54a2c92-21cf-4025-ac18-ede21e2dd9d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:06.294092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b54a2c92-21cf-4025-ac18-ede21e2dd9d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:06.294540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b54a2c92-21cf-4025-ac18-ede21e2dd9d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:06.294987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b54a2c92-21cf-4025-ac18-ede21e2dd9d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:06.307950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-abc927b2-155d-4e10-8f2f-70eba465ab91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:06.316505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-abc927b2-155d-4e10-8f2f-70eba465ab91 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087708 Aug 24 05:28:06.317086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1438/2988] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:06 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:06.364299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b54a2c92-21cf-4025-ac18-ede21e2dd9d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:06.373217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b54a2c92-21cf-4025-ac18-ede21e2dd9d0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092044 Aug 24 05:28:06.373792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1551/2989] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:06 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:06.880056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b5e063f0-7872-4c91-80f3-1f6e9f523681 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:06.880669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b5e063f0-7872-4c91-80f3-1f6e9f523681 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:06.886819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5e063f0-7872-4c91-80f3-1f6e9f523681 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:06.887304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5e063f0-7872-4c91-80f3-1f6e9f523681 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:06.887740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5e063f0-7872-4c91-80f3-1f6e9f523681 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:06.888429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5e063f0-7872-4c91-80f3-1f6e9f523681 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:06.888887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5e063f0-7872-4c91-80f3-1f6e9f523681 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:06.889309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b5e063f0-7872-4c91-80f3-1f6e9f523681 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:06.952454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b5e063f0-7872-4c91-80f3-1f6e9f523681 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:06.960874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b5e063f0-7872-4c91-80f3-1f6e9f523681 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084650 Aug 24 05:28:06.961546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1439/2990] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:06 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:07.337559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-79dcbf18-186b-4d93-bc78-f3d1b5f6ffc6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:07.338175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-79dcbf18-186b-4d93-bc78-f3d1b5f6ffc6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:07.344950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79dcbf18-186b-4d93-bc78-f3d1b5f6ffc6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:07.345445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79dcbf18-186b-4d93-bc78-f3d1b5f6ffc6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:07.345885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79dcbf18-186b-4d93-bc78-f3d1b5f6ffc6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:07.346582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79dcbf18-186b-4d93-bc78-f3d1b5f6ffc6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:07.347078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79dcbf18-186b-4d93-bc78-f3d1b5f6ffc6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:07.347501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-79dcbf18-186b-4d93-bc78-f3d1b5f6ffc6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:07.393403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a5d81c18-4888-4d84-9ae3-5a1c2fef9860 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:07.394034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a5d81c18-4888-4d84-9ae3-5a1c2fef9860 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:07.400677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a5d81c18-4888-4d84-9ae3-5a1c2fef9860 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:07.401171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a5d81c18-4888-4d84-9ae3-5a1c2fef9860 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:07.401608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a5d81c18-4888-4d84-9ae3-5a1c2fef9860 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:07.402305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a5d81c18-4888-4d84-9ae3-5a1c2fef9860 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:07.402785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a5d81c18-4888-4d84-9ae3-5a1c2fef9860 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:07.403209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a5d81c18-4888-4d84-9ae3-5a1c2fef9860 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:07.410423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-79dcbf18-186b-4d93-bc78-f3d1b5f6ffc6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:07.419060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-79dcbf18-186b-4d93-bc78-f3d1b5f6ffc6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.085434 Aug 24 05:28:07.419653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1552/2991] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:07 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:07.469611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a5d81c18-4888-4d84-9ae3-5a1c2fef9860 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:07.478642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a5d81c18-4888-4d84-9ae3-5a1c2fef9860 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089123 Aug 24 05:28:07.479229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1440/2992] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:07 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:07.982606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8bf9c911-b8a7-46ce-8473-e4be5434c820 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:07.983259 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8bf9c911-b8a7-46ce-8473-e4be5434c820 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:07.989382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8bf9c911-b8a7-46ce-8473-e4be5434c820 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:07.989805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8bf9c911-b8a7-46ce-8473-e4be5434c820 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:07.990237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8bf9c911-b8a7-46ce-8473-e4be5434c820 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:07.990999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8bf9c911-b8a7-46ce-8473-e4be5434c820 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:07.991455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8bf9c911-b8a7-46ce-8473-e4be5434c820 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:07.991897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8bf9c911-b8a7-46ce-8473-e4be5434c820 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:08.057042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8bf9c911-b8a7-46ce-8473-e4be5434c820 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:08.065336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8bf9c911-b8a7-46ce-8473-e4be5434c820 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086633 Aug 24 05:28:08.065905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1553/2993] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:07 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:08.441369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8914dd1-937d-4935-b9c2-b03e5a8339d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:08.442133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c8914dd1-937d-4935-b9c2-b03e5a8339d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:08.449162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8914dd1-937d-4935-b9c2-b03e5a8339d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:08.449648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8914dd1-937d-4935-b9c2-b03e5a8339d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:08.450090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8914dd1-937d-4935-b9c2-b03e5a8339d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:08.450817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8914dd1-937d-4935-b9c2-b03e5a8339d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:08.451278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8914dd1-937d-4935-b9c2-b03e5a8339d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:08.451699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8914dd1-937d-4935-b9c2-b03e5a8339d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:08.498915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7b2a70f0-db91-4e71-859c-2bd61f01d357 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:08.499523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7b2a70f0-db91-4e71-859c-2bd61f01d357 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:08.506015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2a70f0-db91-4e71-859c-2bd61f01d357 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:08.506500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2a70f0-db91-4e71-859c-2bd61f01d357 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:08.506974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2a70f0-db91-4e71-859c-2bd61f01d357 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:08.508240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2a70f0-db91-4e71-859c-2bd61f01d357 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:08.508852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2a70f0-db91-4e71-859c-2bd61f01d357 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:08.509282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b2a70f0-db91-4e71-859c-2bd61f01d357 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:08.519709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c8914dd1-937d-4935-b9c2-b03e5a8339d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:08.531017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c8914dd1-937d-4935-b9c2-b03e5a8339d1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093619 Aug 24 05:28:08.531593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1441/2994] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:08 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:08.577511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7b2a70f0-db91-4e71-859c-2bd61f01d357 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:08.586478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7b2a70f0-db91-4e71-859c-2bd61f01d357 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090872 Aug 24 05:28:08.587085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1554/2995] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:08 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:09.087043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fe194453-4fe8-4ef7-a9da-b4708890d8f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:09.087708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fe194453-4fe8-4ef7-a9da-b4708890d8f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:09.093884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe194453-4fe8-4ef7-a9da-b4708890d8f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:09.094371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe194453-4fe8-4ef7-a9da-b4708890d8f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:09.094882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe194453-4fe8-4ef7-a9da-b4708890d8f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:09.095527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe194453-4fe8-4ef7-a9da-b4708890d8f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:09.095981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe194453-4fe8-4ef7-a9da-b4708890d8f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:09.096406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe194453-4fe8-4ef7-a9da-b4708890d8f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:09.162864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fe194453-4fe8-4ef7-a9da-b4708890d8f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:09.173404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fe194453-4fe8-4ef7-a9da-b4708890d8f5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091020 Aug 24 05:28:09.173974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1442/2996] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:09 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:09.552521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3f047246-0ede-4ea8-9ac8-34b1d0c24c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:09.553164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3f047246-0ede-4ea8-9ac8-34b1d0c24c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:09.560050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f047246-0ede-4ea8-9ac8-34b1d0c24c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:09.560531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f047246-0ede-4ea8-9ac8-34b1d0c24c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:09.560963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f047246-0ede-4ea8-9ac8-34b1d0c24c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:09.561654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f047246-0ede-4ea8-9ac8-34b1d0c24c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:09.562101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f047246-0ede-4ea8-9ac8-34b1d0c24c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:09.562522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3f047246-0ede-4ea8-9ac8-34b1d0c24c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:09.607782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fe8013a1-75bb-43c4-8264-f2219dbe1826 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:09.608493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fe8013a1-75bb-43c4-8264-f2219dbe1826 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:09.615071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe8013a1-75bb-43c4-8264-f2219dbe1826 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:09.615542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe8013a1-75bb-43c4-8264-f2219dbe1826 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:09.615967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe8013a1-75bb-43c4-8264-f2219dbe1826 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:09.616648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe8013a1-75bb-43c4-8264-f2219dbe1826 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:09.617092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe8013a1-75bb-43c4-8264-f2219dbe1826 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:09.617747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe8013a1-75bb-43c4-8264-f2219dbe1826 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:09.628552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3f047246-0ede-4ea8-9ac8-34b1d0c24c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:09.641518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3f047246-0ede-4ea8-9ac8-34b1d0c24c99 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092573 Aug 24 05:28:09.642406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1555/2997] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:09 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:09.682401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fe8013a1-75bb-43c4-8264-f2219dbe1826 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:09.690826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fe8013a1-75bb-43c4-8264-f2219dbe1826 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.086882 Aug 24 05:28:09.691390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1443/2998] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:09 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:10.195545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e5cd6648-e4c9-4ee8-9be0-d5147a370f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:10.196071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e5cd6648-e4c9-4ee8-9be0-d5147a370f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:10.202115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5cd6648-e4c9-4ee8-9be0-d5147a370f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:10.202593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5cd6648-e4c9-4ee8-9be0-d5147a370f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:10.203059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5cd6648-e4c9-4ee8-9be0-d5147a370f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:10.203771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5cd6648-e4c9-4ee8-9be0-d5147a370f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:10.204245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5cd6648-e4c9-4ee8-9be0-d5147a370f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:10.204663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5cd6648-e4c9-4ee8-9be0-d5147a370f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:10.267676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e5cd6648-e4c9-4ee8-9be0-d5147a370f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:10.277255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e5cd6648-e4c9-4ee8-9be0-d5147a370f92 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085666 Aug 24 05:28:10.277835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1556/2999] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:10 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:10.670915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-558aa2b8-208b-4183-81a9-34ffb8f3e58a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:10.671523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-558aa2b8-208b-4183-81a9-34ffb8f3e58a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:10.678232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-558aa2b8-208b-4183-81a9-34ffb8f3e58a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:10.678741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-558aa2b8-208b-4183-81a9-34ffb8f3e58a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:10.679179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-558aa2b8-208b-4183-81a9-34ffb8f3e58a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:10.679996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-558aa2b8-208b-4183-81a9-34ffb8f3e58a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:10.680613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-558aa2b8-208b-4183-81a9-34ffb8f3e58a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:10.681042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-558aa2b8-208b-4183-81a9-34ffb8f3e58a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:10.713201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c1aa9fb5-a3c4-41c6-b075-16c44c0371ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:10.713804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c1aa9fb5-a3c4-41c6-b075-16c44c0371ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:10.720423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1aa9fb5-a3c4-41c6-b075-16c44c0371ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:10.720898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1aa9fb5-a3c4-41c6-b075-16c44c0371ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:10.721329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1aa9fb5-a3c4-41c6-b075-16c44c0371ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:10.722042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1aa9fb5-a3c4-41c6-b075-16c44c0371ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:10.722488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1aa9fb5-a3c4-41c6-b075-16c44c0371ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:10.722933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1aa9fb5-a3c4-41c6-b075-16c44c0371ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:10.746703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-558aa2b8-208b-4183-81a9-34ffb8f3e58a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:10.758255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-558aa2b8-208b-4183-81a9-34ffb8f3e58a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090588 Aug 24 05:28:10.758914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1444/3000] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:10 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:10.790784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c1aa9fb5-a3c4-41c6-b075-16c44c0371ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:10.799280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c1aa9fb5-a3c4-41c6-b075-16c44c0371ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090669 Aug 24 05:28:10.799851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1557/3001] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:10 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:11.299958 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a8bd95da-4386-48ab-93a1-ad43e8c871f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:11.300566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a8bd95da-4386-48ab-93a1-ad43e8c871f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:11.307558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8bd95da-4386-48ab-93a1-ad43e8c871f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:11.308039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8bd95da-4386-48ab-93a1-ad43e8c871f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:11.308472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8bd95da-4386-48ab-93a1-ad43e8c871f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:11.309159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8bd95da-4386-48ab-93a1-ad43e8c871f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:11.309611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8bd95da-4386-48ab-93a1-ad43e8c871f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:11.310035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8bd95da-4386-48ab-93a1-ad43e8c871f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:11.375845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a8bd95da-4386-48ab-93a1-ad43e8c871f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:11.384260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a8bd95da-4386-48ab-93a1-ad43e8c871f0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088133 Aug 24 05:28:11.384847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1445/3002] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:11 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:11.779962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b3dcf1b8-099a-4393-bb61-73f9c04c82df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:11.780579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b3dcf1b8-099a-4393-bb61-73f9c04c82df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:11.787051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3dcf1b8-099a-4393-bb61-73f9c04c82df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:11.787508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3dcf1b8-099a-4393-bb61-73f9c04c82df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:11.787932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3dcf1b8-099a-4393-bb61-73f9c04c82df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:11.788603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3dcf1b8-099a-4393-bb61-73f9c04c82df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:11.789210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3dcf1b8-099a-4393-bb61-73f9c04c82df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:11.789872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3dcf1b8-099a-4393-bb61-73f9c04c82df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:11.821773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-87994dc4-96d5-41fe-9314-5cef04a2b708 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:11.822375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-87994dc4-96d5-41fe-9314-5cef04a2b708 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:11.829039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87994dc4-96d5-41fe-9314-5cef04a2b708 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:11.829517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87994dc4-96d5-41fe-9314-5cef04a2b708 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:11.829951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87994dc4-96d5-41fe-9314-5cef04a2b708 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:11.830634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87994dc4-96d5-41fe-9314-5cef04a2b708 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:11.831122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87994dc4-96d5-41fe-9314-5cef04a2b708 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:11.831538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-87994dc4-96d5-41fe-9314-5cef04a2b708 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:11.858163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b3dcf1b8-099a-4393-bb61-73f9c04c82df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:11.866377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b3dcf1b8-099a-4393-bb61-73f9c04c82df tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090270 Aug 24 05:28:11.869819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1558/3003] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:11 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:11.898528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-87994dc4-96d5-41fe-9314-5cef04a2b708 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:11.907352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-87994dc4-96d5-41fe-9314-5cef04a2b708 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090174 Aug 24 05:28:11.907925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1446/3004] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:11 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:12.405439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-71e34ce6-d291-48ec-8177-ec974d606509 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:12.406041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-71e34ce6-d291-48ec-8177-ec974d606509 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:12.412077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71e34ce6-d291-48ec-8177-ec974d606509 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:12.412543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71e34ce6-d291-48ec-8177-ec974d606509 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:12.412975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71e34ce6-d291-48ec-8177-ec974d606509 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:12.413652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71e34ce6-d291-48ec-8177-ec974d606509 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:12.414095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71e34ce6-d291-48ec-8177-ec974d606509 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:12.414515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-71e34ce6-d291-48ec-8177-ec974d606509 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:12.478402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-71e34ce6-d291-48ec-8177-ec974d606509 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:12.486966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-71e34ce6-d291-48ec-8177-ec974d606509 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085289 Aug 24 05:28:12.487576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1559/3005] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:12 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:12.887755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2fbb64a1-f33c-4633-8c0d-666a6fa5dd48 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:12.888362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2fbb64a1-f33c-4633-8c0d-666a6fa5dd48 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:12.894954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2fbb64a1-f33c-4633-8c0d-666a6fa5dd48 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:12.895436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2fbb64a1-f33c-4633-8c0d-666a6fa5dd48 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:12.895869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2fbb64a1-f33c-4633-8c0d-666a6fa5dd48 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:12.896555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2fbb64a1-f33c-4633-8c0d-666a6fa5dd48 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:12.897007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2fbb64a1-f33c-4633-8c0d-666a6fa5dd48 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:12.897422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2fbb64a1-f33c-4633-8c0d-666a6fa5dd48 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:12.930053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-91f77029-f7a6-457a-887b-52c9a31584d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:12.930877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-91f77029-f7a6-457a-887b-52c9a31584d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:12.937780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91f77029-f7a6-457a-887b-52c9a31584d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:12.938267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91f77029-f7a6-457a-887b-52c9a31584d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:12.938720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91f77029-f7a6-457a-887b-52c9a31584d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:12.939424 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91f77029-f7a6-457a-887b-52c9a31584d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:12.939880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91f77029-f7a6-457a-887b-52c9a31584d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:12.940300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-91f77029-f7a6-457a-887b-52c9a31584d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:12.965431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2fbb64a1-f33c-4633-8c0d-666a6fa5dd48 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:12.974005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2fbb64a1-f33c-4633-8c0d-666a6fa5dd48 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090092 Aug 24 05:28:12.974603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1447/3006] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:12 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:13.004123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-91f77029-f7a6-457a-887b-52c9a31584d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:13.012479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-91f77029-f7a6-457a-887b-52c9a31584d6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087209 Aug 24 05:28:13.013043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1560/3007] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:12 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:13.509137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0ce2b1d4-f4ec-49f5-bcb6-b84269eacd11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:13.509753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0ce2b1d4-f4ec-49f5-bcb6-b84269eacd11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:13.516063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1d4-f4ec-49f5-bcb6-b84269eacd11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:13.516543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1d4-f4ec-49f5-bcb6-b84269eacd11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:13.516974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1d4-f4ec-49f5-bcb6-b84269eacd11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:13.517661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1d4-f4ec-49f5-bcb6-b84269eacd11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:13.518107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1d4-f4ec-49f5-bcb6-b84269eacd11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:13.518541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ce2b1d4-f4ec-49f5-bcb6-b84269eacd11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:13.535468 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:13.585096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ce2b1d4-f4ec-49f5-bcb6-b84269eacd11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:13.593719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0ce2b1d4-f4ec-49f5-bcb6-b84269eacd11 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088681 Aug 24 05:28:13.594290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1448/3008] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:13 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:13.995005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c795ceaf-97c3-4514-80b0-c26b37cfc599 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:13.995578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c795ceaf-97c3-4514-80b0-c26b37cfc599 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:14.002061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c795ceaf-97c3-4514-80b0-c26b37cfc599 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:14.002537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c795ceaf-97c3-4514-80b0-c26b37cfc599 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:14.003009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c795ceaf-97c3-4514-80b0-c26b37cfc599 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:14.003695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c795ceaf-97c3-4514-80b0-c26b37cfc599 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:14.004146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c795ceaf-97c3-4514-80b0-c26b37cfc599 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:14.004565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c795ceaf-97c3-4514-80b0-c26b37cfc599 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:14.033388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3e86c0f5-2fa6-4a3d-8df9-0c292f9c8654 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:14.033986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3e86c0f5-2fa6-4a3d-8df9-0c292f9c8654 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:14.041377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e86c0f5-2fa6-4a3d-8df9-0c292f9c8654 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:14.041871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e86c0f5-2fa6-4a3d-8df9-0c292f9c8654 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:14.042309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e86c0f5-2fa6-4a3d-8df9-0c292f9c8654 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:14.043069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e86c0f5-2fa6-4a3d-8df9-0c292f9c8654 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:14.043527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e86c0f5-2fa6-4a3d-8df9-0c292f9c8654 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:14.043950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e86c0f5-2fa6-4a3d-8df9-0c292f9c8654 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:14.067367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c795ceaf-97c3-4514-80b0-c26b37cfc599 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:14.078141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c795ceaf-97c3-4514-80b0-c26b37cfc599 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087176 Aug 24 05:28:14.078734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1561/3009] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:13 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:14.116846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3e86c0f5-2fa6-4a3d-8df9-0c292f9c8654 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:14.125459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3e86c0f5-2fa6-4a3d-8df9-0c292f9c8654 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095940 Aug 24 05:28:14.126013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1449/3010] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:14 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:14.615416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c09a1922-2368-4f13-83ae-98bb287e9da0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:14.616029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c09a1922-2368-4f13-83ae-98bb287e9da0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:14.622995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c09a1922-2368-4f13-83ae-98bb287e9da0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:14.623483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c09a1922-2368-4f13-83ae-98bb287e9da0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:14.623922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c09a1922-2368-4f13-83ae-98bb287e9da0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:14.624614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c09a1922-2368-4f13-83ae-98bb287e9da0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:14.625064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c09a1922-2368-4f13-83ae-98bb287e9da0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:14.625521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c09a1922-2368-4f13-83ae-98bb287e9da0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:14.692824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c09a1922-2368-4f13-83ae-98bb287e9da0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:14.702892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c09a1922-2368-4f13-83ae-98bb287e9da0 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.091264 Aug 24 05:28:14.703476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1562/3011] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:14 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:15.100200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fe98a321-bc07-4e7a-91ae-49553a7833c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:15.100821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fe98a321-bc07-4e7a-91ae-49553a7833c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:15.107843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe98a321-bc07-4e7a-91ae-49553a7833c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:15.108380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe98a321-bc07-4e7a-91ae-49553a7833c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:15.108891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe98a321-bc07-4e7a-91ae-49553a7833c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:15.109754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe98a321-bc07-4e7a-91ae-49553a7833c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:15.110333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe98a321-bc07-4e7a-91ae-49553a7833c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:15.110786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe98a321-bc07-4e7a-91ae-49553a7833c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:15.146159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d53e9ec4-4c58-41bb-8fc6-835b758df2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:15.146793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d53e9ec4-4c58-41bb-8fc6-835b758df2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:15.154295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d53e9ec4-4c58-41bb-8fc6-835b758df2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:15.154975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d53e9ec4-4c58-41bb-8fc6-835b758df2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:15.155638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d53e9ec4-4c58-41bb-8fc6-835b758df2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:15.156601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d53e9ec4-4c58-41bb-8fc6-835b758df2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:15.157160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d53e9ec4-4c58-41bb-8fc6-835b758df2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:15.157680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d53e9ec4-4c58-41bb-8fc6-835b758df2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:15.178308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fe98a321-bc07-4e7a-91ae-49553a7833c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:15.187172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fe98a321-bc07-4e7a-91ae-49553a7833c8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.090650 Aug 24 05:28:15.188074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1450/3012] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:15 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:15.224874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d53e9ec4-4c58-41bb-8fc6-835b758df2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:15.234499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d53e9ec4-4c58-41bb-8fc6-835b758df2da tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092334 Aug 24 05:28:15.235097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1563/3013] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:15 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:15.724156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-606f9744-a14a-4dd6-89ef-74e9ffc9d079 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:15.724686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-606f9744-a14a-4dd6-89ef-74e9ffc9d079 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:15.731656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-606f9744-a14a-4dd6-89ef-74e9ffc9d079 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:15.732156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-606f9744-a14a-4dd6-89ef-74e9ffc9d079 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:15.732596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-606f9744-a14a-4dd6-89ef-74e9ffc9d079 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:15.733302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-606f9744-a14a-4dd6-89ef-74e9ffc9d079 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:15.733758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-606f9744-a14a-4dd6-89ef-74e9ffc9d079 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:15.734183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-606f9744-a14a-4dd6-89ef-74e9ffc9d079 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:15.804103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-606f9744-a14a-4dd6-89ef-74e9ffc9d079 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:15.813733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-606f9744-a14a-4dd6-89ef-74e9ffc9d079 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093526 Aug 24 05:28:15.814306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1451/3014] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:15 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:16.207964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-17ef0dad-ca0a-4efd-b1e2-c9058f59876a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:16.208562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-17ef0dad-ca0a-4efd-b1e2-c9058f59876a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:16.215991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17ef0dad-ca0a-4efd-b1e2-c9058f59876a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:16.216471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17ef0dad-ca0a-4efd-b1e2-c9058f59876a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:16.216895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17ef0dad-ca0a-4efd-b1e2-c9058f59876a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:16.217581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17ef0dad-ca0a-4efd-b1e2-c9058f59876a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:16.218023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17ef0dad-ca0a-4efd-b1e2-c9058f59876a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:16.218436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17ef0dad-ca0a-4efd-b1e2-c9058f59876a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:16.255721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1f459084-39f8-478f-abb6-2f93230c5ce2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:16.256419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1f459084-39f8-478f-abb6-2f93230c5ce2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:16.263721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f459084-39f8-478f-abb6-2f93230c5ce2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:16.264205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f459084-39f8-478f-abb6-2f93230c5ce2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:16.264639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f459084-39f8-478f-abb6-2f93230c5ce2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:16.265331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f459084-39f8-478f-abb6-2f93230c5ce2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:16.265790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f459084-39f8-478f-abb6-2f93230c5ce2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:16.266210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f459084-39f8-478f-abb6-2f93230c5ce2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:16.282867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-17ef0dad-ca0a-4efd-b1e2-c9058f59876a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:16.291196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-17ef0dad-ca0a-4efd-b1e2-c9058f59876a tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087114 Aug 24 05:28:16.291773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1564/3015] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:16 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:16.332208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1f459084-39f8-478f-abb6-2f93230c5ce2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:16.341697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1f459084-39f8-478f-abb6-2f93230c5ce2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089774 Aug 24 05:28:16.342281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1452/3016] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:16 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:16.834895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d797782c-c03b-4fc1-9127-579eac75f9ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:16.835515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d797782c-c03b-4fc1-9127-579eac75f9ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:16.841540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d797782c-c03b-4fc1-9127-579eac75f9ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:16.842028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d797782c-c03b-4fc1-9127-579eac75f9ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:16.842467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d797782c-c03b-4fc1-9127-579eac75f9ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:16.843295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d797782c-c03b-4fc1-9127-579eac75f9ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:16.843755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d797782c-c03b-4fc1-9127-579eac75f9ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:16.844180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d797782c-c03b-4fc1-9127-579eac75f9ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:16.906924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d797782c-c03b-4fc1-9127-579eac75f9ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:16.916117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d797782c-c03b-4fc1-9127-579eac75f9ca tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085253 Aug 24 05:28:16.916690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1565/3017] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:16 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:17.313049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9374531e-4e99-4ab8-bea9-2c5725891770 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:17.313775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9374531e-4e99-4ab8-bea9-2c5725891770 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:17.321913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9374531e-4e99-4ab8-bea9-2c5725891770 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:17.322435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9374531e-4e99-4ab8-bea9-2c5725891770 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:17.322929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9374531e-4e99-4ab8-bea9-2c5725891770 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:17.323647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9374531e-4e99-4ab8-bea9-2c5725891770 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:17.324101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9374531e-4e99-4ab8-bea9-2c5725891770 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:17.324520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9374531e-4e99-4ab8-bea9-2c5725891770 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:17.362723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cfd8777f-0a47-4797-bdef-7d2490cda9f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:17.363398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cfd8777f-0a47-4797-bdef-7d2490cda9f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:17.372797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfd8777f-0a47-4797-bdef-7d2490cda9f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:17.373279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfd8777f-0a47-4797-bdef-7d2490cda9f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:17.373707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfd8777f-0a47-4797-bdef-7d2490cda9f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:17.374396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfd8777f-0a47-4797-bdef-7d2490cda9f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:17.374867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfd8777f-0a47-4797-bdef-7d2490cda9f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:17.375282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cfd8777f-0a47-4797-bdef-7d2490cda9f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:17.394230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9374531e-4e99-4ab8-bea9-2c5725891770 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:17.403345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9374531e-4e99-4ab8-bea9-2c5725891770 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094432 Aug 24 05:28:17.403934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1453/3018] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:17 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:17.443429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cfd8777f-0a47-4797-bdef-7d2490cda9f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:17.446408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:17.454041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cfd8777f-0a47-4797-bdef-7d2490cda9f0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.095150 Aug 24 05:28:17.454751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1566/3019] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:17 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:17.937679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1d6c4ff2-b1fc-4aea-922b-06e30020acc4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:17.938288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1d6c4ff2-b1fc-4aea-922b-06e30020acc4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:17.944365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c4ff2-b1fc-4aea-922b-06e30020acc4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:17.945374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c4ff2-b1fc-4aea-922b-06e30020acc4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:17.945968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c4ff2-b1fc-4aea-922b-06e30020acc4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:17.946926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c4ff2-b1fc-4aea-922b-06e30020acc4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:17.947383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c4ff2-b1fc-4aea-922b-06e30020acc4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:17.947811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1d6c4ff2-b1fc-4aea-922b-06e30020acc4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:18.010451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1d6c4ff2-b1fc-4aea-922b-06e30020acc4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:18.018859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1d6c4ff2-b1fc-4aea-922b-06e30020acc4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.084975 Aug 24 05:28:18.019431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1454/3020] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:18.424186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9a09bdcf-7a99-4553-b857-33eb374122a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:18.424734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9a09bdcf-7a99-4553-b857-33eb374122a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:18.431841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a09bdcf-7a99-4553-b857-33eb374122a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:18.432327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a09bdcf-7a99-4553-b857-33eb374122a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:18.432773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a09bdcf-7a99-4553-b857-33eb374122a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:18.433466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a09bdcf-7a99-4553-b857-33eb374122a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:18.433922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a09bdcf-7a99-4553-b857-33eb374122a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:18.434342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a09bdcf-7a99-4553-b857-33eb374122a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:18.476270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b7563449-0093-47b1-8f38-02c46e399308 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:18.477211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b7563449-0093-47b1-8f38-02c46e399308 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:18.484019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7563449-0093-47b1-8f38-02c46e399308 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:18.484508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7563449-0093-47b1-8f38-02c46e399308 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:18.484974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7563449-0093-47b1-8f38-02c46e399308 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:18.485676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7563449-0093-47b1-8f38-02c46e399308 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:18.486142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7563449-0093-47b1-8f38-02c46e399308 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:18.486560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7563449-0093-47b1-8f38-02c46e399308 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:18.498392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9a09bdcf-7a99-4553-b857-33eb374122a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:18.506851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9a09bdcf-7a99-4553-b857-33eb374122a3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086563 Aug 24 05:28:18.508181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1567/3021] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:18 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:18.553750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b7563449-0093-47b1-8f38-02c46e399308 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:18.562552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b7563449-0093-47b1-8f38-02c46e399308 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091079 Aug 24 05:28:18.563173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1455/3022] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:18 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:19.040599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82501cb5-08d8-4160-b28b-60f39d575c07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:19.041123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-82501cb5-08d8-4160-b28b-60f39d575c07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:19.047337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82501cb5-08d8-4160-b28b-60f39d575c07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:19.047822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82501cb5-08d8-4160-b28b-60f39d575c07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:19.048257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82501cb5-08d8-4160-b28b-60f39d575c07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:19.048951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82501cb5-08d8-4160-b28b-60f39d575c07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:19.049404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82501cb5-08d8-4160-b28b-60f39d575c07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:19.049831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82501cb5-08d8-4160-b28b-60f39d575c07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:19.113721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-82501cb5-08d8-4160-b28b-60f39d575c07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:19.122846 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-82501cb5-08d8-4160-b28b-60f39d575c07 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.086146 Aug 24 05:28:19.123436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1568/3023] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:19 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:19.528035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-78df3aa1-11a0-4b6f-a8cf-9b1e27dc6038 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:19.528645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-78df3aa1-11a0-4b6f-a8cf-9b1e27dc6038 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:19.531029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=82 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:19.536294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78df3aa1-11a0-4b6f-a8cf-9b1e27dc6038 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:19.536777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78df3aa1-11a0-4b6f-a8cf-9b1e27dc6038 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:19.537220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78df3aa1-11a0-4b6f-a8cf-9b1e27dc6038 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:19.537912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78df3aa1-11a0-4b6f-a8cf-9b1e27dc6038 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:19.538361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78df3aa1-11a0-4b6f-a8cf-9b1e27dc6038 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:19.538805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-78df3aa1-11a0-4b6f-a8cf-9b1e27dc6038 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:19.584000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c5c671ac-fd52-4c9c-83fd-7cbe38315d3c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:19.584606 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c5c671ac-fd52-4c9c-83fd-7cbe38315d3c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:19.591317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5c671ac-fd52-4c9c-83fd-7cbe38315d3c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:19.591805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5c671ac-fd52-4c9c-83fd-7cbe38315d3c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:19.592234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5c671ac-fd52-4c9c-83fd-7cbe38315d3c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:19.592927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5c671ac-fd52-4c9c-83fd-7cbe38315d3c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:19.593377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5c671ac-fd52-4c9c-83fd-7cbe38315d3c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:19.593800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5c671ac-fd52-4c9c-83fd-7cbe38315d3c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:19.603205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-78df3aa1-11a0-4b6f-a8cf-9b1e27dc6038 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:19.612034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-78df3aa1-11a0-4b6f-a8cf-9b1e27dc6038 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087823 Aug 24 05:28:19.612909 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1456/3024] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:19 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:19.659189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c5c671ac-fd52-4c9c-83fd-7cbe38315d3c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:19.667897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c5c671ac-fd52-4c9c-83fd-7cbe38315d3c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.087711 Aug 24 05:28:19.668495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1569/3025] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:19 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:20.144182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a26a6e90-542c-4fb3-ae7f-12b1619ca0ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:20.144713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a26a6e90-542c-4fb3-ae7f-12b1619ca0ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:20.151248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a26a6e90-542c-4fb3-ae7f-12b1619ca0ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:20.151855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a26a6e90-542c-4fb3-ae7f-12b1619ca0ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:20.152390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a26a6e90-542c-4fb3-ae7f-12b1619ca0ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:20.153183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a26a6e90-542c-4fb3-ae7f-12b1619ca0ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:20.153732 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a26a6e90-542c-4fb3-ae7f-12b1619ca0ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:20.154248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a26a6e90-542c-4fb3-ae7f-12b1619ca0ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:20.221521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a26a6e90-542c-4fb3-ae7f-12b1619ca0ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:20.230934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a26a6e90-542c-4fb3-ae7f-12b1619ca0ba tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090792 Aug 24 05:28:20.231517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1457/3026] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:20 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:20.638988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8c086e2f-b902-4cea-9e35-e98029a96840 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:20.639964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8c086e2f-b902-4cea-9e35-e98029a96840 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:20.646715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c086e2f-b902-4cea-9e35-e98029a96840 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:20.647212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c086e2f-b902-4cea-9e35-e98029a96840 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:20.647643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c086e2f-b902-4cea-9e35-e98029a96840 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:20.648337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c086e2f-b902-4cea-9e35-e98029a96840 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:20.648891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c086e2f-b902-4cea-9e35-e98029a96840 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:20.649311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8c086e2f-b902-4cea-9e35-e98029a96840 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:20.693902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b34b64e5-7e22-4004-8011-225a9ce29125 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:20.695056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b34b64e5-7e22-4004-8011-225a9ce29125 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:20.704423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b34b64e5-7e22-4004-8011-225a9ce29125 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:20.704904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b34b64e5-7e22-4004-8011-225a9ce29125 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:20.705333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b34b64e5-7e22-4004-8011-225a9ce29125 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:20.706023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b34b64e5-7e22-4004-8011-225a9ce29125 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:20.706470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b34b64e5-7e22-4004-8011-225a9ce29125 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:20.706913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b34b64e5-7e22-4004-8011-225a9ce29125 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:20.727621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8c086e2f-b902-4cea-9e35-e98029a96840 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:20.736211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8c086e2f-b902-4cea-9e35-e98029a96840 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.104022 Aug 24 05:28:20.736790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1570/3027] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:20 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:20.776510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b34b64e5-7e22-4004-8011-225a9ce29125 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:20.784916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b34b64e5-7e22-4004-8011-225a9ce29125 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.098170 Aug 24 05:28:20.785488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1458/3028] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:20 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:21.252322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-de47a32d-8eeb-411f-a251-3df5dd05aa64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:21.252931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-de47a32d-8eeb-411f-a251-3df5dd05aa64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:21.261572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-de47a32d-8eeb-411f-a251-3df5dd05aa64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:21.263586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-de47a32d-8eeb-411f-a251-3df5dd05aa64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:21.264054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-de47a32d-8eeb-411f-a251-3df5dd05aa64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:21.265867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-de47a32d-8eeb-411f-a251-3df5dd05aa64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:21.266331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-de47a32d-8eeb-411f-a251-3df5dd05aa64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:21.266789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-de47a32d-8eeb-411f-a251-3df5dd05aa64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:21.332415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-de47a32d-8eeb-411f-a251-3df5dd05aa64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:21.341107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-de47a32d-8eeb-411f-a251-3df5dd05aa64 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.092609 Aug 24 05:28:21.341684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1571/3029] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:21 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:21.756999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8f994525-cc38-43c8-bccc-5afd99b8fff9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:21.757608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8f994525-cc38-43c8-bccc-5afd99b8fff9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:21.765052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f994525-cc38-43c8-bccc-5afd99b8fff9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:21.765538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f994525-cc38-43c8-bccc-5afd99b8fff9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:21.765974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f994525-cc38-43c8-bccc-5afd99b8fff9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:21.766667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f994525-cc38-43c8-bccc-5afd99b8fff9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:21.767143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f994525-cc38-43c8-bccc-5afd99b8fff9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:21.767569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f994525-cc38-43c8-bccc-5afd99b8fff9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:21.808093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-95e2e116-2ab8-4136-a571-f947a2278cc8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:21.808789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-95e2e116-2ab8-4136-a571-f947a2278cc8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:21.815343 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95e2e116-2ab8-4136-a571-f947a2278cc8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:21.815826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95e2e116-2ab8-4136-a571-f947a2278cc8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:21.816256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95e2e116-2ab8-4136-a571-f947a2278cc8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:21.816947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95e2e116-2ab8-4136-a571-f947a2278cc8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:21.817387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95e2e116-2ab8-4136-a571-f947a2278cc8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:21.817800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-95e2e116-2ab8-4136-a571-f947a2278cc8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:21.832180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8f994525-cc38-43c8-bccc-5afd99b8fff9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:21.840724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8f994525-cc38-43c8-bccc-5afd99b8fff9 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087609 Aug 24 05:28:21.841302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1459/3030] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:21 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:21.890048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-95e2e116-2ab8-4136-a571-f947a2278cc8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:21.899867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-95e2e116-2ab8-4136-a571-f947a2278cc8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.096408 Aug 24 05:28:21.900475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1572/3031] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:21 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:22.363423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9e124d85-0ccf-4a02-8837-e971214cbe7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:22.364028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9e124d85-0ccf-4a02-8837-e971214cbe7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:22.371082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e124d85-0ccf-4a02-8837-e971214cbe7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:22.371566 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e124d85-0ccf-4a02-8837-e971214cbe7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:22.371999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e124d85-0ccf-4a02-8837-e971214cbe7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:22.372743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e124d85-0ccf-4a02-8837-e971214cbe7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:22.373140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e124d85-0ccf-4a02-8837-e971214cbe7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:22.373558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9e124d85-0ccf-4a02-8837-e971214cbe7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:22.436956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9e124d85-0ccf-4a02-8837-e971214cbe7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:22.445315 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9e124d85-0ccf-4a02-8837-e971214cbe7d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085969 Aug 24 05:28:22.445895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1460/3032] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:22 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:22.921525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2867c9c5-eafc-4dd5-8a41-c2d142181551 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:22.922123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2867c9c5-eafc-4dd5-8a41-c2d142181551 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:22.924551 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-61707d54-0fbb-4b91-a251-a7bffcc9db8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:22.925172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-61707d54-0fbb-4b91-a251-a7bffcc9db8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:22.928956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2867c9c5-eafc-4dd5-8a41-c2d142181551 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:22.929432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2867c9c5-eafc-4dd5-8a41-c2d142181551 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:22.929860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2867c9c5-eafc-4dd5-8a41-c2d142181551 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:22.930541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2867c9c5-eafc-4dd5-8a41-c2d142181551 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:22.931040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2867c9c5-eafc-4dd5-8a41-c2d142181551 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:22.931791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2867c9c5-eafc-4dd5-8a41-c2d142181551 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:22.932156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61707d54-0fbb-4b91-a251-a7bffcc9db8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:22.932598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61707d54-0fbb-4b91-a251-a7bffcc9db8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:22.935726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61707d54-0fbb-4b91-a251-a7bffcc9db8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:22.935726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61707d54-0fbb-4b91-a251-a7bffcc9db8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:22.935726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61707d54-0fbb-4b91-a251-a7bffcc9db8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:22.935726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-61707d54-0fbb-4b91-a251-a7bffcc9db8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:23.004963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-61707d54-0fbb-4b91-a251-a7bffcc9db8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:23.006904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2867c9c5-eafc-4dd5-8a41-c2d142181551 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:23.014194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-61707d54-0fbb-4b91-a251-a7bffcc9db8b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093395 Aug 24 05:28:23.014799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1461/3033] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:22 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:23.017421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2867c9c5-eafc-4dd5-8a41-c2d142181551 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.099455 Aug 24 05:28:23.018147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1573/3034] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:22 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:23.466295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3b457347-9345-4557-af76-d1d753225248 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:23.466934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3b457347-9345-4557-af76-d1d753225248 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:23.473073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b457347-9345-4557-af76-d1d753225248 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:23.473554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b457347-9345-4557-af76-d1d753225248 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:23.473982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b457347-9345-4557-af76-d1d753225248 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:23.474663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b457347-9345-4557-af76-d1d753225248 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:23.475135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b457347-9345-4557-af76-d1d753225248 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:23.475545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b457347-9345-4557-af76-d1d753225248 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:23.539412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3b457347-9345-4557-af76-d1d753225248 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:23.553286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3b457347-9345-4557-af76-d1d753225248 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090985 Aug 24 05:28:23.553880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1462/3035] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:23 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:24.035748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aa8a6d0c-01eb-4479-b0f1-26932ee2961b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:24.036319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aa8a6d0c-01eb-4479-b0f1-26932ee2961b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:24.038533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-79370a1b-77f5-411a-9c16-27e0e6396e1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:24.038974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=82 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:24.039185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-79370a1b-77f5-411a-9c16-27e0e6396e1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:24.044519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa8a6d0c-01eb-4479-b0f1-26932ee2961b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:24.045007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa8a6d0c-01eb-4479-b0f1-26932ee2961b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:24.045446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa8a6d0c-01eb-4479-b0f1-26932ee2961b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:24.046151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa8a6d0c-01eb-4479-b0f1-26932ee2961b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:24.046661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa8a6d0c-01eb-4479-b0f1-26932ee2961b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:24.047113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa8a6d0c-01eb-4479-b0f1-26932ee2961b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:24.048223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79370a1b-77f5-411a-9c16-27e0e6396e1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:24.048833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79370a1b-77f5-411a-9c16-27e0e6396e1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:24.049383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79370a1b-77f5-411a-9c16-27e0e6396e1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:24.050333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79370a1b-77f5-411a-9c16-27e0e6396e1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:24.050952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79370a1b-77f5-411a-9c16-27e0e6396e1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:24.051524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79370a1b-77f5-411a-9c16-27e0e6396e1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:24.116466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aa8a6d0c-01eb-4479-b0f1-26932ee2961b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:24.125883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aa8a6d0c-01eb-4479-b0f1-26932ee2961b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094151 Aug 24 05:28:24.126466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1574/3036] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:24 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:24.126949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-79370a1b-77f5-411a-9c16-27e0e6396e1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:24.136125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-79370a1b-77f5-411a-9c16-27e0e6396e1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.101295 Aug 24 05:28:24.136698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1463/3037] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:24 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:24.575260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bd8e433f-f45f-457b-94dd-d43ad7ebeecb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:24.576022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bd8e433f-f45f-457b-94dd-d43ad7ebeecb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:24.581981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd8e433f-f45f-457b-94dd-d43ad7ebeecb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:24.582522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd8e433f-f45f-457b-94dd-d43ad7ebeecb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:24.582987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd8e433f-f45f-457b-94dd-d43ad7ebeecb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:24.583688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd8e433f-f45f-457b-94dd-d43ad7ebeecb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:24.584142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd8e433f-f45f-457b-94dd-d43ad7ebeecb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:24.584588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd8e433f-f45f-457b-94dd-d43ad7ebeecb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:24.647223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bd8e433f-f45f-457b-94dd-d43ad7ebeecb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:24.656475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bd8e433f-f45f-457b-94dd-d43ad7ebeecb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.085787 Aug 24 05:28:24.657052 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1575/3038] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:24 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:25.147488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c57d720c-de4a-4c4d-a33d-78ad08b1f0cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:25.148100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c57d720c-de4a-4c4d-a33d-78ad08b1f0cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:25.155944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c57d720c-de4a-4c4d-a33d-78ad08b1f0cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:25.156435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c57d720c-de4a-4c4d-a33d-78ad08b1f0cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:25.156870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c57d720c-de4a-4c4d-a33d-78ad08b1f0cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:25.157597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c57d720c-de4a-4c4d-a33d-78ad08b1f0cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:25.158015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c57d720c-de4a-4c4d-a33d-78ad08b1f0cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:25.158431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c57d720c-de4a-4c4d-a33d-78ad08b1f0cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:25.164889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aa7e68fb-c8ff-4503-a7d4-99c73e79f4fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:25.164889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aa7e68fb-c8ff-4503-a7d4-99c73e79f4fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:25.167922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa7e68fb-c8ff-4503-a7d4-99c73e79f4fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:25.168561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa7e68fb-c8ff-4503-a7d4-99c73e79f4fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:25.169116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa7e68fb-c8ff-4503-a7d4-99c73e79f4fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:25.170017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa7e68fb-c8ff-4503-a7d4-99c73e79f4fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:25.170601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa7e68fb-c8ff-4503-a7d4-99c73e79f4fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:25.171155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa7e68fb-c8ff-4503-a7d4-99c73e79f4fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:25.229145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c57d720c-de4a-4c4d-a33d-78ad08b1f0cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:25.238330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c57d720c-de4a-4c4d-a33d-78ad08b1f0cd tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094373 Aug 24 05:28:25.238636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1464/3039] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:25 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:25.241021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aa7e68fb-c8ff-4503-a7d4-99c73e79f4fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:25.250679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aa7e68fb-c8ff-4503-a7d4-99c73e79f4fc tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.096585 Aug 24 05:28:25.251276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1576/3040] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:25 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:25.677870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8a50b225-1a36-4593-a198-a6219df6b8d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:25.678482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8a50b225-1a36-4593-a198-a6219df6b8d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:25.685172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a50b225-1a36-4593-a198-a6219df6b8d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:25.685719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a50b225-1a36-4593-a198-a6219df6b8d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:25.686154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a50b225-1a36-4593-a198-a6219df6b8d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:25.686886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a50b225-1a36-4593-a198-a6219df6b8d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:25.687345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a50b225-1a36-4593-a198-a6219df6b8d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:25.687763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8a50b225-1a36-4593-a198-a6219df6b8d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:25.690554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:25.758442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8a50b225-1a36-4593-a198-a6219df6b8d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:25.767175 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8a50b225-1a36-4593-a198-a6219df6b8d7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093193 Aug 24 05:28:25.767751 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1465/3041] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:25 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:26.259903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-52b10ae8-2dba-498e-a443-75db9cc58e92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:26.260542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-52b10ae8-2dba-498e-a443-75db9cc58e92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:26.267118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10ae8-2dba-498e-a443-75db9cc58e92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:26.267602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10ae8-2dba-498e-a443-75db9cc58e92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:26.268041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10ae8-2dba-498e-a443-75db9cc58e92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:26.268727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10ae8-2dba-498e-a443-75db9cc58e92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:26.269174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10ae8-2dba-498e-a443-75db9cc58e92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:26.269594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-52b10ae8-2dba-498e-a443-75db9cc58e92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:26.271486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6f24c62f-36f4-4d19-a264-ce6c647e4202 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:26.272045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6f24c62f-36f4-4d19-a264-ce6c647e4202 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:26.280031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f24c62f-36f4-4d19-a264-ce6c647e4202 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:26.280624 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f24c62f-36f4-4d19-a264-ce6c647e4202 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:26.281130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f24c62f-36f4-4d19-a264-ce6c647e4202 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:26.281817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f24c62f-36f4-4d19-a264-ce6c647e4202 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:26.282263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f24c62f-36f4-4d19-a264-ce6c647e4202 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:26.282673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6f24c62f-36f4-4d19-a264-ce6c647e4202 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:26.338712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-52b10ae8-2dba-498e-a443-75db9cc58e92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:26.347791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-52b10ae8-2dba-498e-a443-75db9cc58e92 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091461 Aug 24 05:28:26.348110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1577/3042] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:26 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:26.349924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6f24c62f-36f4-4d19-a264-ce6c647e4202 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:26.359485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6f24c62f-36f4-4d19-a264-ce6c647e4202 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.091820 Aug 24 05:28:26.360170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1466/3043] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:26 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:26.788685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f74c2da-5f11-4258-8a8c-5a237baf60d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:26.789292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1f74c2da-5f11-4258-8a8c-5a237baf60d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:26.796009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f74c2da-5f11-4258-8a8c-5a237baf60d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:26.796474 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f74c2da-5f11-4258-8a8c-5a237baf60d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:26.796909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f74c2da-5f11-4258-8a8c-5a237baf60d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:26.797597 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f74c2da-5f11-4258-8a8c-5a237baf60d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:26.798043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f74c2da-5f11-4258-8a8c-5a237baf60d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:26.798461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f74c2da-5f11-4258-8a8c-5a237baf60d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:26.864915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1f74c2da-5f11-4258-8a8c-5a237baf60d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:26.875022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1f74c2da-5f11-4258-8a8c-5a237baf60d6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.090144 Aug 24 05:28:26.875610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1578/3044] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:26 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:27.369089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9667afbf-6606-4ef2-bf75-f265e6186dba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:27.369823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9667afbf-6606-4ef2-bf75-f265e6186dba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:27.376308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9667afbf-6606-4ef2-bf75-f265e6186dba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:27.376796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9667afbf-6606-4ef2-bf75-f265e6186dba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:27.377225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9667afbf-6606-4ef2-bf75-f265e6186dba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:27.377936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9667afbf-6606-4ef2-bf75-f265e6186dba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:27.378383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9667afbf-6606-4ef2-bf75-f265e6186dba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:27.378825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9667afbf-6606-4ef2-bf75-f265e6186dba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:27.383332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e63e1ad4-f66d-4201-9198-598a6adfbb1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:27.383975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e63e1ad4-f66d-4201-9198-598a6adfbb1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:27.391028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e63e1ad4-f66d-4201-9198-598a6adfbb1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:27.391519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e63e1ad4-f66d-4201-9198-598a6adfbb1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:27.391954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e63e1ad4-f66d-4201-9198-598a6adfbb1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:27.392654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e63e1ad4-f66d-4201-9198-598a6adfbb1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:27.393101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e63e1ad4-f66d-4201-9198-598a6adfbb1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:27.393519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e63e1ad4-f66d-4201-9198-598a6adfbb1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:27.444513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9667afbf-6606-4ef2-bf75-f265e6186dba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:27.453891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9667afbf-6606-4ef2-bf75-f265e6186dba tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.088671 Aug 24 05:28:27.454531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1467/3045] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:27 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:27.458988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e63e1ad4-f66d-4201-9198-598a6adfbb1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:27.468028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e63e1ad4-f66d-4201-9198-598a6adfbb1c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090654 Aug 24 05:28:27.468603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1579/3046] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:27 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:27.897554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-93d8377e-0ad5-41bc-9ff2-0e87ce4ead5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:27.898165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-93d8377e-0ad5-41bc-9ff2-0e87ce4ead5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:27.905425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93d8377e-0ad5-41bc-9ff2-0e87ce4ead5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:27.905913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93d8377e-0ad5-41bc-9ff2-0e87ce4ead5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:27.906343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93d8377e-0ad5-41bc-9ff2-0e87ce4ead5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:27.907070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93d8377e-0ad5-41bc-9ff2-0e87ce4ead5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:27.907519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93d8377e-0ad5-41bc-9ff2-0e87ce4ead5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:27.907937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-93d8377e-0ad5-41bc-9ff2-0e87ce4ead5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:27.997298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-93d8377e-0ad5-41bc-9ff2-0e87ce4ead5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:28.005707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-93d8377e-0ad5-41bc-9ff2-0e87ce4ead5c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.113302 Aug 24 05:28:28.006271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1468/3047] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:27 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:28.474861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-53820598-e1f1-4eee-adb5-a7b991853a41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:28.475497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-53820598-e1f1-4eee-adb5-a7b991853a41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:28.482605 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53820598-e1f1-4eee-adb5-a7b991853a41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:28.483115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53820598-e1f1-4eee-adb5-a7b991853a41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:28.483545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53820598-e1f1-4eee-adb5-a7b991853a41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:28.484231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53820598-e1f1-4eee-adb5-a7b991853a41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:28.484682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53820598-e1f1-4eee-adb5-a7b991853a41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:28.485872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-53820598-e1f1-4eee-adb5-a7b991853a41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:28.489550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-942c0b21-d9bb-4393-af10-f73f0c69e64f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:28.490352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-942c0b21-d9bb-4393-af10-f73f0c69e64f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:28.497040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-942c0b21-d9bb-4393-af10-f73f0c69e64f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:28.497525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-942c0b21-d9bb-4393-af10-f73f0c69e64f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:28.497965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-942c0b21-d9bb-4393-af10-f73f0c69e64f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:28.498648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-942c0b21-d9bb-4393-af10-f73f0c69e64f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:28.499130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-942c0b21-d9bb-4393-af10-f73f0c69e64f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:28.499544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-942c0b21-d9bb-4393-af10-f73f0c69e64f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:28.548945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-53820598-e1f1-4eee-adb5-a7b991853a41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:28.557929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-53820598-e1f1-4eee-adb5-a7b991853a41 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.086791 Aug 24 05:28:28.558746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1580/3048] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:28 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:28.566228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-942c0b21-d9bb-4393-af10-f73f0c69e64f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:28.575093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-942c0b21-d9bb-4393-af10-f73f0c69e64f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089261 Aug 24 05:28:28.575880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1469/3049] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:28 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:29.027497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d7c117a3-83ed-4dd7-b80a-1b79abcec049 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:29.028114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d7c117a3-83ed-4dd7-b80a-1b79abcec049 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:29.034344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7c117a3-83ed-4dd7-b80a-1b79abcec049 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:29.034870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7c117a3-83ed-4dd7-b80a-1b79abcec049 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:29.035314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7c117a3-83ed-4dd7-b80a-1b79abcec049 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:29.036013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7c117a3-83ed-4dd7-b80a-1b79abcec049 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:29.036467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7c117a3-83ed-4dd7-b80a-1b79abcec049 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:29.036891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7c117a3-83ed-4dd7-b80a-1b79abcec049 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:29.101359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d7c117a3-83ed-4dd7-b80a-1b79abcec049 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:29.109945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d7c117a3-83ed-4dd7-b80a-1b79abcec049 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087145 Aug 24 05:28:29.110523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1581/3050] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:29 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:29.578782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f5dab253-860b-49d8-8f5a-28545efb9735 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:29.579419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f5dab253-860b-49d8-8f5a-28545efb9735 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:29.586042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5dab253-860b-49d8-8f5a-28545efb9735 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:29.586519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5dab253-860b-49d8-8f5a-28545efb9735 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:29.586990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5dab253-860b-49d8-8f5a-28545efb9735 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:29.587684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5dab253-860b-49d8-8f5a-28545efb9735 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:29.588129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5dab253-860b-49d8-8f5a-28545efb9735 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:29.588550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f5dab253-860b-49d8-8f5a-28545efb9735 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:29.597670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e2dc59e7-697e-4b74-80ff-de22f0b84c2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:29.598286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e2dc59e7-697e-4b74-80ff-de22f0b84c2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:29.605569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2dc59e7-697e-4b74-80ff-de22f0b84c2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:29.606058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2dc59e7-697e-4b74-80ff-de22f0b84c2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:29.606528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2dc59e7-697e-4b74-80ff-de22f0b84c2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:29.607261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2dc59e7-697e-4b74-80ff-de22f0b84c2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:29.607716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2dc59e7-697e-4b74-80ff-de22f0b84c2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:29.608139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e2dc59e7-697e-4b74-80ff-de22f0b84c2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:29.654817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f5dab253-860b-49d8-8f5a-28545efb9735 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:29.666491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f5dab253-860b-49d8-8f5a-28545efb9735 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091234 Aug 24 05:28:29.667191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1470/3051] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:29 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:29.687309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e2dc59e7-697e-4b74-80ff-de22f0b84c2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:29.695949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e2dc59e7-697e-4b74-80ff-de22f0b84c2d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.102140 Aug 24 05:28:29.696518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1582/3052] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:29 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:30.130109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-97b50813-9761-46fc-b55b-75ec022b651b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:30.130660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-97b50813-9761-46fc-b55b-75ec022b651b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:30.136874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b50813-9761-46fc-b55b-75ec022b651b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:30.137367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b50813-9761-46fc-b55b-75ec022b651b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:30.137805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b50813-9761-46fc-b55b-75ec022b651b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:30.138499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b50813-9761-46fc-b55b-75ec022b651b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:30.138980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b50813-9761-46fc-b55b-75ec022b651b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:30.139396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-97b50813-9761-46fc-b55b-75ec022b651b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:30.212234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-97b50813-9761-46fc-b55b-75ec022b651b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:30.221228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-97b50813-9761-46fc-b55b-75ec022b651b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.095046 Aug 24 05:28:30.221810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1471/3053] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:30 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:30.689019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5eee614c-8ada-45ee-aee0-ace437920fa3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:30.689643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5eee614c-8ada-45ee-aee0-ace437920fa3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:30.696344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eee614c-8ada-45ee-aee0-ace437920fa3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:30.697379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eee614c-8ada-45ee-aee0-ace437920fa3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:30.697825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eee614c-8ada-45ee-aee0-ace437920fa3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:30.698511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eee614c-8ada-45ee-aee0-ace437920fa3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:30.698981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eee614c-8ada-45ee-aee0-ace437920fa3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:30.699397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5eee614c-8ada-45ee-aee0-ace437920fa3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:30.714739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:30.718339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d79c1cd3-afaa-4d09-8414-df991d835295 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:30.718986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d79c1cd3-afaa-4d09-8414-df991d835295 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:30.725487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79c1cd3-afaa-4d09-8414-df991d835295 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:30.725977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79c1cd3-afaa-4d09-8414-df991d835295 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:30.726418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79c1cd3-afaa-4d09-8414-df991d835295 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:30.727380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79c1cd3-afaa-4d09-8414-df991d835295 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:30.727842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79c1cd3-afaa-4d09-8414-df991d835295 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:30.728542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d79c1cd3-afaa-4d09-8414-df991d835295 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:30.764468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5eee614c-8ada-45ee-aee0-ace437920fa3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:30.773138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5eee614c-8ada-45ee-aee0-ace437920fa3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087912 Aug 24 05:28:30.773918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1583/3054] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:30 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:30.798335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d79c1cd3-afaa-4d09-8414-df991d835295 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:30.807842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d79c1cd3-afaa-4d09-8414-df991d835295 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.093984 Aug 24 05:28:30.808548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1472/3055] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:30 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:31.242416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7124204b-88b6-4b01-bee5-3fd8fb046899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:31.243057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7124204b-88b6-4b01-bee5-3fd8fb046899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:31.249967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7124204b-88b6-4b01-bee5-3fd8fb046899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:31.250452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7124204b-88b6-4b01-bee5-3fd8fb046899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:31.250925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7124204b-88b6-4b01-bee5-3fd8fb046899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:31.251624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7124204b-88b6-4b01-bee5-3fd8fb046899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:31.252089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7124204b-88b6-4b01-bee5-3fd8fb046899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:31.252512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7124204b-88b6-4b01-bee5-3fd8fb046899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:31.323060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7124204b-88b6-4b01-bee5-3fd8fb046899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:31.331768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7124204b-88b6-4b01-bee5-3fd8fb046899 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.093191 Aug 24 05:28:31.332344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1584/3056] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:31 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:31.794150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cdbb7291-5128-4cb4-9250-c014ab45b0d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:31.794777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cdbb7291-5128-4cb4-9250-c014ab45b0d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:31.801405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdbb7291-5128-4cb4-9250-c014ab45b0d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:31.801886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdbb7291-5128-4cb4-9250-c014ab45b0d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:31.802321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdbb7291-5128-4cb4-9250-c014ab45b0d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:31.803065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdbb7291-5128-4cb4-9250-c014ab45b0d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:31.803518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdbb7291-5128-4cb4-9250-c014ab45b0d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:31.803937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdbb7291-5128-4cb4-9250-c014ab45b0d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:31.828961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aa2a8918-ab21-407c-bc77-b0ecd009ea5d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:31.829653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aa2a8918-ab21-407c-bc77-b0ecd009ea5d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:31.836561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2a8918-ab21-407c-bc77-b0ecd009ea5d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:31.837622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2a8918-ab21-407c-bc77-b0ecd009ea5d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:31.840711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2a8918-ab21-407c-bc77-b0ecd009ea5d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:31.840711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2a8918-ab21-407c-bc77-b0ecd009ea5d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:31.840711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2a8918-ab21-407c-bc77-b0ecd009ea5d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:31.840711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aa2a8918-ab21-407c-bc77-b0ecd009ea5d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:31.867411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cdbb7291-5128-4cb4-9250-c014ab45b0d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:31.876813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cdbb7291-5128-4cb4-9250-c014ab45b0d2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.087145 Aug 24 05:28:31.877406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1473/3057] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:31 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:31.906418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aa2a8918-ab21-407c-bc77-b0ecd009ea5d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:31.914959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aa2a8918-ab21-407c-bc77-b0ecd009ea5d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089854 Aug 24 05:28:31.916055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1585/3058] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:31 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:32.352454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1f3f5fd4-851f-42c5-95db-5d9616d8c602 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:32.353836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1f3f5fd4-851f-42c5-95db-5d9616d8c602 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:32.360157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f3f5fd4-851f-42c5-95db-5d9616d8c602 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:32.360643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f3f5fd4-851f-42c5-95db-5d9616d8c602 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:32.361078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f3f5fd4-851f-42c5-95db-5d9616d8c602 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:32.361770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f3f5fd4-851f-42c5-95db-5d9616d8c602 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:32.362223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f3f5fd4-851f-42c5-95db-5d9616d8c602 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:32.362649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f3f5fd4-851f-42c5-95db-5d9616d8c602 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:32.425796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1f3f5fd4-851f-42c5-95db-5d9616d8c602 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:32.436256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1f3f5fd4-851f-42c5-95db-5d9616d8c602 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087625 Aug 24 05:28:32.436833 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1474/3059] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:32 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:32.897729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b041bac6-1e6e-4cf7-915e-7510fc5dd731 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:32.898340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b041bac6-1e6e-4cf7-915e-7510fc5dd731 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:32.905534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041bac6-1e6e-4cf7-915e-7510fc5dd731 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:32.906011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041bac6-1e6e-4cf7-915e-7510fc5dd731 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:32.906438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041bac6-1e6e-4cf7-915e-7510fc5dd731 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:32.907169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041bac6-1e6e-4cf7-915e-7510fc5dd731 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:32.907631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041bac6-1e6e-4cf7-915e-7510fc5dd731 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:32.908027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b041bac6-1e6e-4cf7-915e-7510fc5dd731 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:32.937157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-aab8e6ec-677c-4f9e-958d-b281b77d7f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:32.937766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-aab8e6ec-677c-4f9e-958d-b281b77d7f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:32.944409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aab8e6ec-677c-4f9e-958d-b281b77d7f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:32.944892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aab8e6ec-677c-4f9e-958d-b281b77d7f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:32.945350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aab8e6ec-677c-4f9e-958d-b281b77d7f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:32.946053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aab8e6ec-677c-4f9e-958d-b281b77d7f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:32.946505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aab8e6ec-677c-4f9e-958d-b281b77d7f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:32.947527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aab8e6ec-677c-4f9e-958d-b281b77d7f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:32.977039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b041bac6-1e6e-4cf7-915e-7510fc5dd731 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:32.985802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b041bac6-1e6e-4cf7-915e-7510fc5dd731 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.091960 Aug 24 05:28:32.986323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1586/3060] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:32 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:33.012730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-aab8e6ec-677c-4f9e-958d-b281b77d7f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:33.022676 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-aab8e6ec-677c-4f9e-958d-b281b77d7f04 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089323 Aug 24 05:28:33.023293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1475/3061] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:32 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:33.458112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2ac7a6e0-dee4-46be-ba21-0ca5dad7b35a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:33.458748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2ac7a6e0-dee4-46be-ba21-0ca5dad7b35a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:33.465006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ac7a6e0-dee4-46be-ba21-0ca5dad7b35a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:33.465485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ac7a6e0-dee4-46be-ba21-0ca5dad7b35a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:33.465919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ac7a6e0-dee4-46be-ba21-0ca5dad7b35a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:33.466607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ac7a6e0-dee4-46be-ba21-0ca5dad7b35a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:33.467083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ac7a6e0-dee4-46be-ba21-0ca5dad7b35a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:33.467502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ac7a6e0-dee4-46be-ba21-0ca5dad7b35a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:33.532863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2ac7a6e0-dee4-46be-ba21-0ca5dad7b35a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:33.541832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2ac7a6e0-dee4-46be-ba21-0ca5dad7b35a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.087507 Aug 24 05:28:33.542413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1587/3062] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:33 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:34.006843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-eb6db64a-8061-416c-915c-3bf29545b4f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:34.007492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-eb6db64a-8061-416c-915c-3bf29545b4f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:34.014567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb6db64a-8061-416c-915c-3bf29545b4f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:34.015076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb6db64a-8061-416c-915c-3bf29545b4f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:34.015506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb6db64a-8061-416c-915c-3bf29545b4f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:34.016185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb6db64a-8061-416c-915c-3bf29545b4f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:34.016628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb6db64a-8061-416c-915c-3bf29545b4f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:34.017042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-eb6db64a-8061-416c-915c-3bf29545b4f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:34.044436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e7e591c6-f6e5-45ef-885e-345b02352c48 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:34.045144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e7e591c6-f6e5-45ef-885e-345b02352c48 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:34.051694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7e591c6-f6e5-45ef-885e-345b02352c48 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:34.052180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7e591c6-f6e5-45ef-885e-345b02352c48 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:34.052609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7e591c6-f6e5-45ef-885e-345b02352c48 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:34.053297 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7e591c6-f6e5-45ef-885e-345b02352c48 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:34.053746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7e591c6-f6e5-45ef-885e-345b02352c48 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:34.054256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e7e591c6-f6e5-45ef-885e-345b02352c48 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:34.088324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-eb6db64a-8061-416c-915c-3bf29545b4f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:34.096934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-eb6db64a-8061-416c-915c-3bf29545b4f3 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.094034 Aug 24 05:28:34.097870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1476/3063] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:34 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:34.122039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e7e591c6-f6e5-45ef-885e-345b02352c48 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:34.132249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e7e591c6-f6e5-45ef-885e-345b02352c48 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.092652 Aug 24 05:28:34.132824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1588/3064] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:34 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:34.562506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1f7cba0c-5977-415c-bb17-a741c5f4678f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:34.563127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1f7cba0c-5977-415c-bb17-a741c5f4678f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:34.569275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f7cba0c-5977-415c-bb17-a741c5f4678f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:34.569754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f7cba0c-5977-415c-bb17-a741c5f4678f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:34.570182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f7cba0c-5977-415c-bb17-a741c5f4678f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:34.570897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f7cba0c-5977-415c-bb17-a741c5f4678f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:34.571345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f7cba0c-5977-415c-bb17-a741c5f4678f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:34.571763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1f7cba0c-5977-415c-bb17-a741c5f4678f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:34.639416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1f7cba0c-5977-415c-bb17-a741c5f4678f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:34.647869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1f7cba0c-5977-415c-bb17-a741c5f4678f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089329 Aug 24 05:28:34.648483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1477/3065] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:34 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:35.117831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9c348847-b877-4ebe-848c-282ed6467d3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:35.118463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9c348847-b877-4ebe-848c-282ed6467d3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:35.125298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c348847-b877-4ebe-848c-282ed6467d3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:35.125776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c348847-b877-4ebe-848c-282ed6467d3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:35.126202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c348847-b877-4ebe-848c-282ed6467d3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:35.126917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c348847-b877-4ebe-848c-282ed6467d3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:35.127362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c348847-b877-4ebe-848c-282ed6467d3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:35.127781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9c348847-b877-4ebe-848c-282ed6467d3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:35.154438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a37d9280-e30a-4ee9-a780-37cd232931a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:35.155353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a37d9280-e30a-4ee9-a780-37cd232931a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:35.161881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a37d9280-e30a-4ee9-a780-37cd232931a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:35.162361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a37d9280-e30a-4ee9-a780-37cd232931a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:35.162818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a37d9280-e30a-4ee9-a780-37cd232931a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:35.163507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a37d9280-e30a-4ee9-a780-37cd232931a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:35.163950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a37d9280-e30a-4ee9-a780-37cd232931a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:35.164362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a37d9280-e30a-4ee9-a780-37cd232931a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:35.204772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9c348847-b877-4ebe-848c-282ed6467d3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:35.214201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9c348847-b877-4ebe-848c-282ed6467d3d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.100150 Aug 24 05:28:35.214914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1589/3066] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:35 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:35.241127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a37d9280-e30a-4ee9-a780-37cd232931a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:35.250526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a37d9280-e30a-4ee9-a780-37cd232931a7 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.100807 Aug 24 05:28:35.251153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1478/3067] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:35 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:35.670905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6762a40b-0565-413e-8b3c-1c0e83ba76df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:35.671512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6762a40b-0565-413e-8b3c-1c0e83ba76df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:35.678040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6762a40b-0565-413e-8b3c-1c0e83ba76df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:35.678518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6762a40b-0565-413e-8b3c-1c0e83ba76df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:35.678990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6762a40b-0565-413e-8b3c-1c0e83ba76df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:35.679683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6762a40b-0565-413e-8b3c-1c0e83ba76df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:35.680266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6762a40b-0565-413e-8b3c-1c0e83ba76df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:35.680996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6762a40b-0565-413e-8b3c-1c0e83ba76df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:35.760734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6762a40b-0565-413e-8b3c-1c0e83ba76df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:35.770668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6762a40b-0565-413e-8b3c-1c0e83ba76df tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.104496 Aug 24 05:28:35.771277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1590/3068] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:35 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:36.240255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-22ead233-f17a-4b05-bc90-a8bd40c7603f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:36.241110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-22ead233-f17a-4b05-bc90-a8bd40c7603f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:36.248238 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22ead233-f17a-4b05-bc90-a8bd40c7603f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:36.248730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22ead233-f17a-4b05-bc90-a8bd40c7603f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:36.249171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22ead233-f17a-4b05-bc90-a8bd40c7603f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:36.249880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22ead233-f17a-4b05-bc90-a8bd40c7603f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:36.250334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22ead233-f17a-4b05-bc90-a8bd40c7603f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:36.250789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-22ead233-f17a-4b05-bc90-a8bd40c7603f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:36.272935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8e7660a0-cd25-486a-b5af-f3f010cab036 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:36.273614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8e7660a0-cd25-486a-b5af-f3f010cab036 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:36.281132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e7660a0-cd25-486a-b5af-f3f010cab036 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:36.281672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e7660a0-cd25-486a-b5af-f3f010cab036 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:36.282119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e7660a0-cd25-486a-b5af-f3f010cab036 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:36.282845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e7660a0-cd25-486a-b5af-f3f010cab036 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:36.283547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e7660a0-cd25-486a-b5af-f3f010cab036 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:36.283996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8e7660a0-cd25-486a-b5af-f3f010cab036 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:36.319183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-22ead233-f17a-4b05-bc90-a8bd40c7603f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:36.328707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-22ead233-f17a-4b05-bc90-a8bd40c7603f tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.092524 Aug 24 05:28:36.329293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1479/3069] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:36 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:36.350589 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8e7660a0-cd25-486a-b5af-f3f010cab036 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:36.359217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8e7660a0-cd25-486a-b5af-f3f010cab036 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.090371 Aug 24 05:28:36.359793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1591/3070] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:36 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:36.792472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-474d3d7d-9f04-46df-8b3f-86978f1933ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:36.793090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-474d3d7d-9f04-46df-8b3f-86978f1933ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:36.799420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474d3d7d-9f04-46df-8b3f-86978f1933ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:36.799904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474d3d7d-9f04-46df-8b3f-86978f1933ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:36.800336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474d3d7d-9f04-46df-8b3f-86978f1933ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:36.801023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474d3d7d-9f04-46df-8b3f-86978f1933ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:36.801473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474d3d7d-9f04-46df-8b3f-86978f1933ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:36.801891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-474d3d7d-9f04-46df-8b3f-86978f1933ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:36.868970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-474d3d7d-9f04-46df-8b3f-86978f1933ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:36.878107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-474d3d7d-9f04-46df-8b3f-86978f1933ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.089680 Aug 24 05:28:36.878884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1480/3071] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:36 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:37.349857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5d2310a4-e5ba-447b-b67e-719d3a88dc88 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:37.350464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5d2310a4-e5ba-447b-b67e-719d3a88dc88 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:37.358271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2310a4-e5ba-447b-b67e-719d3a88dc88 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:37.358832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2310a4-e5ba-447b-b67e-719d3a88dc88 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:37.359303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2310a4-e5ba-447b-b67e-719d3a88dc88 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:37.360004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2310a4-e5ba-447b-b67e-719d3a88dc88 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:37.360451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2310a4-e5ba-447b-b67e-719d3a88dc88 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:37.360871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d2310a4-e5ba-447b-b67e-719d3a88dc88 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:37.381364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-69aef51e-1949-40c7-b718-fcac2f40f912 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:37.382065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-69aef51e-1949-40c7-b718-fcac2f40f912 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:37.388709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aef51e-1949-40c7-b718-fcac2f40f912 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:37.389188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aef51e-1949-40c7-b718-fcac2f40f912 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:37.389618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aef51e-1949-40c7-b718-fcac2f40f912 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:37.390308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aef51e-1949-40c7-b718-fcac2f40f912 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:37.390778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aef51e-1949-40c7-b718-fcac2f40f912 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:37.391203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-69aef51e-1949-40c7-b718-fcac2f40f912 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:37.429479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5d2310a4-e5ba-447b-b67e-719d3a88dc88 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:37.439635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5d2310a4-e5ba-447b-b67e-719d3a88dc88 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.093620 Aug 24 05:28:37.440397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1592/3072] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:37 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:37.456643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-69aef51e-1949-40c7-b718-fcac2f40f912 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:37.458839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:37.467069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-69aef51e-1949-40c7-b718-fcac2f40f912 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.089651 Aug 24 05:28:37.467651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1481/3073] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:37 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:37.899609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-246e0f83-8cb0-4099-9f45-f8e492658158 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:37.900218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-246e0f83-8cb0-4099-9f45-f8e492658158 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:37.907029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-246e0f83-8cb0-4099-9f45-f8e492658158 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:37.907516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-246e0f83-8cb0-4099-9f45-f8e492658158 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:37.907952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-246e0f83-8cb0-4099-9f45-f8e492658158 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:37.908659 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-246e0f83-8cb0-4099-9f45-f8e492658158 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:37.909111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-246e0f83-8cb0-4099-9f45-f8e492658158 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:37.909534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-246e0f83-8cb0-4099-9f45-f8e492658158 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:37.978011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-246e0f83-8cb0-4099-9f45-f8e492658158 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:37.984413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-246e0f83-8cb0-4099-9f45-f8e492658158 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088615 Aug 24 05:28:37.984989 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1593/3074] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:37 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:38.462141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9d8c6162-f96a-4d8b-a4b7-2765d3dc74e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:38.462601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-9d8c6162-f96a-4d8b-a4b7-2765d3dc74e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:38.469933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d8c6162-f96a-4d8b-a4b7-2765d3dc74e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:38.470429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d8c6162-f96a-4d8b-a4b7-2765d3dc74e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:38.470893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d8c6162-f96a-4d8b-a4b7-2765d3dc74e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:38.471584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d8c6162-f96a-4d8b-a4b7-2765d3dc74e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:38.472030 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d8c6162-f96a-4d8b-a4b7-2765d3dc74e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:38.472447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-9d8c6162-f96a-4d8b-a4b7-2765d3dc74e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:38.488790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1174e60c-b7f8-4da8-a971-fabcdf725106 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:38.489669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1174e60c-b7f8-4da8-a971-fabcdf725106 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:38.496270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1174e60c-b7f8-4da8-a971-fabcdf725106 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:38.496882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1174e60c-b7f8-4da8-a971-fabcdf725106 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:38.497521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1174e60c-b7f8-4da8-a971-fabcdf725106 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:38.498277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1174e60c-b7f8-4da8-a971-fabcdf725106 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:38.498743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1174e60c-b7f8-4da8-a971-fabcdf725106 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:38.499161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1174e60c-b7f8-4da8-a971-fabcdf725106 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:38.538397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-9d8c6162-f96a-4d8b-a4b7-2765d3dc74e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:38.547344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9d8c6162-f96a-4d8b-a4b7-2765d3dc74e1 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.089574 Aug 24 05:28:38.547993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1482/3075] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:38 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:38.572189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1174e60c-b7f8-4da8-a971-fabcdf725106 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:38.581446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1174e60c-b7f8-4da8-a971-fabcdf725106 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 200 len: 1373 microversion: 2.1 time: 0.096586 Aug 24 05:28:38.582023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1594/3076] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:38 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 1373 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:38.602490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f83ca98f-0240-48a8-a7dd-ea4486ab9f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '.version_select at 0x7f359063d1f0>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:38.624788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f83ca98f-0240-48a8-a7dd-ea4486ab9f20 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370825006" status: 202 len: 0 microversion: 2.1 time: 0.025944 Aug 24 05:28:38.625292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1483/3077] 10.222.0.97 () {58 vars in 1221 bytes} [Wed Aug 24 05:28:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1370825006 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:28:39.005312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6abffb80-4df9-4ad5-be84-04099d8f50f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:39.005936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6abffb80-4df9-4ad5-be84-04099d8f50f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:39.012378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6abffb80-4df9-4ad5-be84-04099d8f50f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:39.012883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6abffb80-4df9-4ad5-be84-04099d8f50f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:39.013324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6abffb80-4df9-4ad5-be84-04099d8f50f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:39.014029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6abffb80-4df9-4ad5-be84-04099d8f50f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:39.014487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6abffb80-4df9-4ad5-be84-04099d8f50f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:39.014940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6abffb80-4df9-4ad5-be84-04099d8f50f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:39.081134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6abffb80-4df9-4ad5-be84-04099d8f50f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:39.096091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6abffb80-4df9-4ad5-be84-04099d8f50f8 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 200 len: 1368 microversion: 2.1 time: 0.088961 Aug 24 05:28:39.096091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1595/3078] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:39 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:39.114503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-57d58924-7e60-4dfd-a814-b7cfae34c51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '.version_select at 0x7f35943889d0>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:39.133608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-57d58924-7e60-4dfd-a814-b7cfae34c51e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624361171" status: 202 len: 0 microversion: 2.1 time: 0.023300 Aug 24 05:28:39.134190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1484/3079] 10.222.0.97 () {58 vars in 1221 bytes} [Wed Aug 24 05:28:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1624361171 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:28:39.540975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4141b3c1-37dd-421e-b5b8-1f360ada359f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: .version_select at 0x7f359031d820>, body: {"keypair": {"name": "tempest-keypair-1234920889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ03DUbgoHGIg3Z8lU53KUPelvfCtEGNBPuo5YD7ZAV+fOQN4vVRiNRMggv8/PVLV2ZXq+Wet6QTop4Kf6MexCoc1ir7ju+O5swCPKWHwGag8LzhvrWRfLzIPbN7CtHBVw=="}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:28:39.563453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-4141b3c1-37dd-421e-b5b8-1f360ada359f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'key_pairs'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:28:39.570331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-4141b3c1-37dd-421e-b5b8-1f360ada359f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for user 4bc6971289b943aebec90909ffb8096a and project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'key_pairs'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:28:39.572823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b35cd7cd-605a-42b3-aca9-528eba7f6408 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:39.573451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b35cd7cd-605a-42b3-aca9-528eba7f6408 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 246c7f17-b6b8-470f-aa27-f23cac6e0df5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:39.581392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b35cd7cd-605a-42b3-aca9-528eba7f6408 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:39.581889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b35cd7cd-605a-42b3-aca9-528eba7f6408 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:39.582321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b35cd7cd-605a-42b3-aca9-528eba7f6408 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:39.583313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b35cd7cd-605a-42b3-aca9-528eba7f6408 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:39.583767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b35cd7cd-605a-42b3-aca9-528eba7f6408 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:39.584398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b35cd7cd-605a-42b3-aca9-528eba7f6408 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:39.603217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4141b3c1-37dd-421e-b5b8-1f360ada359f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066020 Aug 24 05:28:39.606754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1596/3080] 10.222.0.97 () {60 vars in 1159 bytes} [Wed Aug 24 05:28:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:28:39.671597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b35cd7cd-605a-42b3-aca9-528eba7f6408 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:39.680330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b35cd7cd-605a-42b3-aca9-528eba7f6408 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5" status: 200 len: 1363 microversion: 2.1 time: 0.114347 Aug 24 05:28:39.680926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1485/3081] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:39 2022] GET /compute/v2.1/servers/246c7f17-b6b8-470f-aa27-f23cac6e0df5 => generated 1363 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:39.701893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f7b0955a-f57a-4096-9673-70a3c887f7c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '.version_select at 0x7f3591934790>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:39.725109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f7b0955a-f57a-4096-9673-70a3c887f7c6 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661748740" status: 202 len: 0 microversion: 2.1 time: 0.027793 Aug 24 05:28:39.725678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1597/3082] 10.222.0.97 () {58 vars in 1221 bytes} [Wed Aug 24 05:28:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1661748740 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:28:40.348301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-26cceeda-3eac-4d5d-a6c9-7ce9b0d4b0ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Action: 'create', calling method: .version_select at 0x7f35901f8f70>, body: {"keypair": {"name": "tempest-keypair-1704441748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpdR6otbHLC7ycZXqi3R+hHJmb4S5ejPLCPNwRoGyMQpiia1Gf3cCACaiQG+mrHkMiJ7anhgpPwMc1egWiSqiJvY5fdDZ0H2CMfzLGg67NaP8ZpnwItU/qiubG/7gacyw=="}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:28:40.368411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-26cceeda-3eac-4d5d-a6c9-7ce9b0d4b0ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Getting quotas for project c2394a6093e241469dd0900c8efad29c. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:28:40.382637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-26cceeda-3eac-4d5d-a6c9-7ce9b0d4b0ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Getting quotas for user 5c6fb51f911e40338628bd734299c0d0 and project c2394a6093e241469dd0900c8efad29c. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:28:40.409697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-26cceeda-3eac-4d5d-a6c9-7ce9b0d4b0ce tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066759 Aug 24 05:28:40.410319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1486/3083] 10.222.0.97 () {60 vars in 1159 bytes} [Wed Aug 24 05:28:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:28:41.435105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1638527364", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b192333e-49cd-4bbd-809a-5981852bd697"}], "security_groups": [{"name": "tempest-securitygroup--1480979363"}], "key_name": "tempest-keypair-1234920889", "user_data": "}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:28:41.608549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.network.neutron [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] validate_networks() for [('b192333e-49cd-4bbd-809a-5981852bd697', None, None, None, None, None)] {{(pid=120558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:28:41.959416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1819175385", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a028b6ee-3eb5-44e6-a480-826fa1084130"}], "security_groups": [{"name": "tempest-securitygroup--1689334438"}], "key_name": "tempest-keypair-1704441748", "user_data": "}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:28:42.070097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] validate_networks() for [('a028b6ee-3eb5-44e6-a480-826fa1084130', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:28:42.167578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Flavor limits 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:28:42.168064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Image limits 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:28:42.169254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Flavor pref 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:28:42.169764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Image pref 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:28:42.170240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:28:42.179323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:42.179886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:42.180382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:42.181230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:42.182010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:42.182498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:42.201113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'instances', 'ram', 'cores'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:28:42.205346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for user 4bc6971289b943aebec90909ffb8096a and project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'instances', 'ram', 'cores'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:28:42.217492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Going to run 1 instances... {{(pid=120558) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:28:42.219844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:28:42.270583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c306f0f9-d823-4325-8602-5beb4aa1d8a3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.840472 Aug 24 05:28:42.271423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1598/3084] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 05:28:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:28:42.282760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2e1aa604-6d77-4138-9199-d773838e2a05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:42.283503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2e1aa604-6d77-4138-9199-d773838e2a05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:42.347842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2e1aa604-6d77-4138-9199-d773838e2a05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:42.356593 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2e1aa604-6d77-4138-9199-d773838e2a05 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1242 microversion: 2.1 time: 0.077215 Aug 24 05:28:42.357911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1599/3085] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:42 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:42.537940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:28:42.538380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:28:42.538870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:28:42.539273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:28:42.539674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:28:42.550049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:42.550965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:42.551416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:42.552729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:42.553316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:42.553901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:42.572839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Getting quotas for project c2394a6093e241469dd0900c8efad29c. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:28:42.577738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Getting quotas for user 5c6fb51f911e40338628bd734299c0d0 and project c2394a6093e241469dd0900c8efad29c. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:28:42.588948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:28:42.592029 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:28:42.645302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-387cae17-035b-4f38-ad04-c31e5409cff6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691389 Aug 24 05:28:42.645968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1487/3086] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 05:28:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:28:42.657438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-96d13459-9873-4a4a-b37a-377db0ecab35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:42.658055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-96d13459-9873-4a4a-b37a-377db0ecab35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:42.732681 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-96d13459-9873-4a4a-b37a-377db0ecab35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:42.744294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-96d13459-9873-4a4a-b37a-377db0ecab35 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1238 microversion: 2.1 time: 0.090933 Aug 24 05:28:42.745032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1600/3087] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:42 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:43.379329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-016b64b1-4dce-4a9e-a21e-0c1f41377130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:43.380261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-016b64b1-4dce-4a9e-a21e-0c1f41377130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:43.386379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016b64b1-4dce-4a9e-a21e-0c1f41377130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:43.387548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016b64b1-4dce-4a9e-a21e-0c1f41377130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:43.388293 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016b64b1-4dce-4a9e-a21e-0c1f41377130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:43.389155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016b64b1-4dce-4a9e-a21e-0c1f41377130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:43.390055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016b64b1-4dce-4a9e-a21e-0c1f41377130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:43.390517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-016b64b1-4dce-4a9e-a21e-0c1f41377130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:43.478927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-016b64b1-4dce-4a9e-a21e-0c1f41377130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:43.503331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-016b64b1-4dce-4a9e-a21e-0c1f41377130 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1302 microversion: 2.1 time: 0.128441 Aug 24 05:28:43.505089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1488/3088] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:43 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1302 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:43.770386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d676ec15-0b64-4dc5-923b-98f73fa09293 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:43.771056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d676ec15-0b64-4dc5-923b-98f73fa09293 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:43.777619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d676ec15-0b64-4dc5-923b-98f73fa09293 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:43.778109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d676ec15-0b64-4dc5-923b-98f73fa09293 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:43.778549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d676ec15-0b64-4dc5-923b-98f73fa09293 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:43.779274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d676ec15-0b64-4dc5-923b-98f73fa09293 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:43.779730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d676ec15-0b64-4dc5-923b-98f73fa09293 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:43.780150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d676ec15-0b64-4dc5-923b-98f73fa09293 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:43.848485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d676ec15-0b64-4dc5-923b-98f73fa09293 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:43.857391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d676ec15-0b64-4dc5-923b-98f73fa09293 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1290 microversion: 2.1 time: 0.090865 Aug 24 05:28:43.858077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1601/3089] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:43 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:44.530505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bf2aab71-cded-493b-b988-928caed7faf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:44.531249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bf2aab71-cded-493b-b988-928caed7faf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:44.538131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2aab71-cded-493b-b988-928caed7faf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:44.538745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2aab71-cded-493b-b988-928caed7faf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:44.539242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2aab71-cded-493b-b988-928caed7faf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:44.540003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2aab71-cded-493b-b988-928caed7faf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:44.540517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2aab71-cded-493b-b988-928caed7faf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:44.541000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf2aab71-cded-493b-b988-928caed7faf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:44.878624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2e30084a-d86e-48a9-9627-12826d31549f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:44.879324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2e30084a-d86e-48a9-9627-12826d31549f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:44.886422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e30084a-d86e-48a9-9627-12826d31549f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:44.887079 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e30084a-d86e-48a9-9627-12826d31549f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:44.887541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e30084a-d86e-48a9-9627-12826d31549f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:44.889910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e30084a-d86e-48a9-9627-12826d31549f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:44.890463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e30084a-d86e-48a9-9627-12826d31549f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:44.890926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e30084a-d86e-48a9-9627-12826d31549f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:44.966974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2e30084a-d86e-48a9-9627-12826d31549f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:44.975535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2e30084a-d86e-48a9-9627-12826d31549f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1296 microversion: 2.1 time: 0.100778 Aug 24 05:28:44.976355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1602/3090] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:44 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1296 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:45.016925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bf2aab71-cded-493b-b988-928caed7faf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:45.030295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bf2aab71-cded-493b-b988-928caed7faf2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1368 microversion: 2.1 time: 0.503891 Aug 24 05:28:45.031462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1489/3091] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:44 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1368 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:45.997546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6a69fa06-c8aa-4566-af95-77b812b0d375 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:45.998971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6a69fa06-c8aa-4566-af95-77b812b0d375 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:46.007359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-6013e374-4a03-496d-a41d-13ed64ebba47 req-d1472c4f-99e4-4da5-86d6-f405096fd713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455aaf6b-38bd-45d3-9fe4-6c3b25f0751c", "tag": "e197b6e5-a95b-4e87-8f42-63627a372213"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:28:46.018569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-6013e374-4a03-496d-a41d-13ed64ebba47 req-d1472c4f-99e4-4da5-86d6-f405096fd713 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:46.022114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a69fa06-c8aa-4566-af95-77b812b0d375 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:46.028424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a69fa06-c8aa-4566-af95-77b812b0d375 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:46.029591 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a69fa06-c8aa-4566-af95-77b812b0d375 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:46.030520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a69fa06-c8aa-4566-af95-77b812b0d375 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:46.031658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a69fa06-c8aa-4566-af95-77b812b0d375 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:46.031931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-6013e374-4a03-496d-a41d-13ed64ebba47 req-d1472c4f-99e4-4da5-86d6-f405096fd713 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:46.032362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-6013e374-4a03-496d-a41d-13ed64ebba47 req-d1472c4f-99e4-4da5-86d6-f405096fd713 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:46.034868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a69fa06-c8aa-4566-af95-77b812b0d375 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:46.056276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-6013e374-4a03-496d-a41d-13ed64ebba47 req-d1472c4f-99e4-4da5-86d6-f405096fd713 service nova] Creating event network-changed:e197b6e5-a95b-4e87-8f42-63627a372213 for instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c on hv-cinder-85426 Aug 24 05:28:46.063762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-6013e374-4a03-496d-a41d-13ed64ebba47 req-d1472c4f-99e4-4da5-86d6-f405096fd713 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195692 Aug 24 05:28:46.064657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1603/3092] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:28:46.069920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-893517eb-9252-48cb-ab63-654cf411d4a6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:46.070790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-893517eb-9252-48cb-ab63-654cf411d4a6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:46.077274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-893517eb-9252-48cb-ab63-654cf411d4a6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:46.077777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-893517eb-9252-48cb-ab63-654cf411d4a6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:46.078212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-893517eb-9252-48cb-ab63-654cf411d4a6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:46.078926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-893517eb-9252-48cb-ab63-654cf411d4a6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:46.079569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-893517eb-9252-48cb-ab63-654cf411d4a6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:46.079991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-893517eb-9252-48cb-ab63-654cf411d4a6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:46.221078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-893517eb-9252-48cb-ab63-654cf411d4a6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:46.229540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-893517eb-9252-48cb-ab63-654cf411d4a6 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1368 microversion: 2.1 time: 0.163502 Aug 24 05:28:46.230209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1604/3093] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:46 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:46.417444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6a69fa06-c8aa-4566-af95-77b812b0d375 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:46.425660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6a69fa06-c8aa-4566-af95-77b812b0d375 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.432121 Aug 24 05:28:46.426246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1490/3094] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:45 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:47.256123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a9fe640b-505d-4919-9d8d-586004b9df68 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:47.256735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a9fe640b-505d-4919-9d8d-586004b9df68 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:47.263948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a9fe640b-505d-4919-9d8d-586004b9df68 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:47.264436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a9fe640b-505d-4919-9d8d-586004b9df68 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:47.264873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a9fe640b-505d-4919-9d8d-586004b9df68 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:47.265558 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a9fe640b-505d-4919-9d8d-586004b9df68 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:47.266007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a9fe640b-505d-4919-9d8d-586004b9df68 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:47.266430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a9fe640b-505d-4919-9d8d-586004b9df68 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:47.281826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:47.399545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a9fe640b-505d-4919-9d8d-586004b9df68 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:47.409349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a9fe640b-505d-4919-9d8d-586004b9df68 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1368 microversion: 2.1 time: 0.156725 Aug 24 05:28:47.410313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1605/3095] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:47 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:47.447577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-317e24ac-9fc6-47f8-b6af-9ff9222d5a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:47.448223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-317e24ac-9fc6-47f8-b6af-9ff9222d5a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:47.451090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:47.457165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-317e24ac-9fc6-47f8-b6af-9ff9222d5a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:47.457657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-317e24ac-9fc6-47f8-b6af-9ff9222d5a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:47.458087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-317e24ac-9fc6-47f8-b6af-9ff9222d5a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:47.458844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-317e24ac-9fc6-47f8-b6af-9ff9222d5a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:47.459295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-317e24ac-9fc6-47f8-b6af-9ff9222d5a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:47.459710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-317e24ac-9fc6-47f8-b6af-9ff9222d5a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:47.592688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-317e24ac-9fc6-47f8-b6af-9ff9222d5a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:47.600416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-317e24ac-9fc6-47f8-b6af-9ff9222d5a58 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.156829 Aug 24 05:28:47.601172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1491/3096] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:47 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:48.102095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-2b653852-864b-4745-a746-173a641470d4 req-be3611da-937a-4c39-9bfc-46afcdd96085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448db0f9-77b5-46a7-8c7e-98cddd6a0ec5", "tag": "cf1cd12d-535b-4621-b475-9fd55f8e8acf"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:28:48.111946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-2b653852-864b-4745-a746-173a641470d4 req-be3611da-937a-4c39-9bfc-46afcdd96085 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:48.112425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-2b653852-864b-4745-a746-173a641470d4 req-be3611da-937a-4c39-9bfc-46afcdd96085 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:48.112853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-2b653852-864b-4745-a746-173a641470d4 req-be3611da-937a-4c39-9bfc-46afcdd96085 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:48.124535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-2b653852-864b-4745-a746-173a641470d4 req-be3611da-937a-4c39-9bfc-46afcdd96085 service nova] Creating event network-changed:cf1cd12d-535b-4621-b475-9fd55f8e8acf for instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 on hv-cinder-85426 Aug 24 05:28:48.129645 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-2b653852-864b-4745-a746-173a641470d4 req-be3611da-937a-4c39-9bfc-46afcdd96085 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031250 Aug 24 05:28:48.130249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1606/3097] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:28:48.432141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-361d86ec-0791-4da7-8155-4d3caa38df7e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:48.432671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-361d86ec-0791-4da7-8155-4d3caa38df7e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:48.439482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-361d86ec-0791-4da7-8155-4d3caa38df7e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:48.439961 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-361d86ec-0791-4da7-8155-4d3caa38df7e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:48.440393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-361d86ec-0791-4da7-8155-4d3caa38df7e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:48.441078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-361d86ec-0791-4da7-8155-4d3caa38df7e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:48.441528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-361d86ec-0791-4da7-8155-4d3caa38df7e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:48.441951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-361d86ec-0791-4da7-8155-4d3caa38df7e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:48.575245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-361d86ec-0791-4da7-8155-4d3caa38df7e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:48.583104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-361d86ec-0791-4da7-8155-4d3caa38df7e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1368 microversion: 2.1 time: 0.155220 Aug 24 05:28:48.583666 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1492/3098] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:48 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:48.621822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-009e8c92-7761-4539-8ac6-10b4b51e7603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:48.622526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-009e8c92-7761-4539-8ac6-10b4b51e7603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:48.629151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-009e8c92-7761-4539-8ac6-10b4b51e7603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:48.629629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-009e8c92-7761-4539-8ac6-10b4b51e7603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:48.630068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-009e8c92-7761-4539-8ac6-10b4b51e7603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:48.630783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-009e8c92-7761-4539-8ac6-10b4b51e7603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:48.631238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-009e8c92-7761-4539-8ac6-10b4b51e7603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:48.631661 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-009e8c92-7761-4539-8ac6-10b4b51e7603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:48.761023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-009e8c92-7761-4539-8ac6-10b4b51e7603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:48.769005 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-009e8c92-7761-4539-8ac6-10b4b51e7603 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.151790 Aug 24 05:28:48.769572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1607/3099] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:48 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:49.603720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1611a153-8e55-43fc-aac7-1c7b8942ce9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:49.604366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1611a153-8e55-43fc-aac7-1c7b8942ce9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:49.611598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1611a153-8e55-43fc-aac7-1c7b8942ce9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:49.612085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1611a153-8e55-43fc-aac7-1c7b8942ce9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:49.612520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1611a153-8e55-43fc-aac7-1c7b8942ce9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:49.613447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1611a153-8e55-43fc-aac7-1c7b8942ce9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:49.613901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1611a153-8e55-43fc-aac7-1c7b8942ce9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:49.614328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1611a153-8e55-43fc-aac7-1c7b8942ce9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:49.789496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fd25f8b1-8af9-4502-a13b-10f1ed8bc412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:49.790110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fd25f8b1-8af9-4502-a13b-10f1ed8bc412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:49.792689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:49.799689 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd25f8b1-8af9-4502-a13b-10f1ed8bc412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:49.800199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd25f8b1-8af9-4502-a13b-10f1ed8bc412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:49.800651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd25f8b1-8af9-4502-a13b-10f1ed8bc412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:49.801349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd25f8b1-8af9-4502-a13b-10f1ed8bc412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:49.801798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd25f8b1-8af9-4502-a13b-10f1ed8bc412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:49.802216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fd25f8b1-8af9-4502-a13b-10f1ed8bc412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:49.950967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-1611a153-8e55-43fc-aac7-1c7b8942ce9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:49.960372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1611a153-8e55-43fc-aac7-1c7b8942ce9b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1368 microversion: 2.1 time: 0.360309 Aug 24 05:28:49.960894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fd25f8b1-8af9-4502-a13b-10f1ed8bc412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:49.961939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1493/3100] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:49 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1368 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:49.972091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fd25f8b1-8af9-4502-a13b-10f1ed8bc412 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.186298 Aug 24 05:28:49.972773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1608/3101] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:49 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:50.993213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3742c0c8-eea7-47f9-aace-8b4a58d06ae5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:50.993764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3742c0c8-eea7-47f9-aace-8b4a58d06ae5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:50.995276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0e617814-0803-40d2-8943-74b3bb354402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:50.995877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0e617814-0803-40d2-8943-74b3bb354402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:51.000441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3742c0c8-eea7-47f9-aace-8b4a58d06ae5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:51.000936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3742c0c8-eea7-47f9-aace-8b4a58d06ae5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:51.001368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3742c0c8-eea7-47f9-aace-8b4a58d06ae5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:51.002065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3742c0c8-eea7-47f9-aace-8b4a58d06ae5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:51.002440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e617814-0803-40d2-8943-74b3bb354402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:51.002572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3742c0c8-eea7-47f9-aace-8b4a58d06ae5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:51.002952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e617814-0803-40d2-8943-74b3bb354402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:51.003083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3742c0c8-eea7-47f9-aace-8b4a58d06ae5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:51.003383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e617814-0803-40d2-8943-74b3bb354402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:51.004062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e617814-0803-40d2-8943-74b3bb354402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:51.004502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e617814-0803-40d2-8943-74b3bb354402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:51.004916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0e617814-0803-40d2-8943-74b3bb354402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:51.151263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0e617814-0803-40d2-8943-74b3bb354402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:51.152105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3742c0c8-eea7-47f9-aace-8b4a58d06ae5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:51.162049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3742c0c8-eea7-47f9-aace-8b4a58d06ae5 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.173026 Aug 24 05:28:51.162837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1494/3102] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:50 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:51.165186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0e617814-0803-40d2-8943-74b3bb354402 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1368 microversion: 2.1 time: 0.173882 Aug 24 05:28:51.165781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1609/3103] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:50 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:52.186094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6811733f-e1d4-403f-9d8d-0fe7271ccffb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:52.186794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6811733f-e1d4-403f-9d8d-0fe7271ccffb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:52.193286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6811733f-e1d4-403f-9d8d-0fe7271ccffb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:52.193793 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6811733f-e1d4-403f-9d8d-0fe7271ccffb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:52.194434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7baf25cb-e07f-4bf8-a5d7-2526775d81d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:52.194937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6811733f-e1d4-403f-9d8d-0fe7271ccffb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:52.195101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7baf25cb-e07f-4bf8-a5d7-2526775d81d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:52.195594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6811733f-e1d4-403f-9d8d-0fe7271ccffb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:52.196068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6811733f-e1d4-403f-9d8d-0fe7271ccffb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:52.196497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6811733f-e1d4-403f-9d8d-0fe7271ccffb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:52.197396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:52.203486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7baf25cb-e07f-4bf8-a5d7-2526775d81d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:52.203965 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7baf25cb-e07f-4bf8-a5d7-2526775d81d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:52.204396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7baf25cb-e07f-4bf8-a5d7-2526775d81d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:52.205086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7baf25cb-e07f-4bf8-a5d7-2526775d81d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:52.205533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7baf25cb-e07f-4bf8-a5d7-2526775d81d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:52.205949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7baf25cb-e07f-4bf8-a5d7-2526775d81d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:52.359268 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7baf25cb-e07f-4bf8-a5d7-2526775d81d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:52.364056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6811733f-e1d4-403f-9d8d-0fe7271ccffb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:52.367533 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7baf25cb-e07f-4bf8-a5d7-2526775d81d4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.176645 Aug 24 05:28:52.368127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1610/3104] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:52 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:52.373077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6811733f-e1d4-403f-9d8d-0fe7271ccffb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1368 microversion: 2.1 time: 0.191181 Aug 24 05:28:52.373743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1495/3105] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:52 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1368 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:53.389679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-82d79851-2941-4e8a-9d05-15b1b9e4e214 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:53.390244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-82d79851-2941-4e8a-9d05-15b1b9e4e214 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:53.392039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=14 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:53.393572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-13e527c4-b576-4f4f-bd06-f9470e83d47f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:53.394188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-13e527c4-b576-4f4f-bd06-f9470e83d47f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:53.396084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:53.396794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=10 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:28:53.398478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82d79851-2941-4e8a-9d05-15b1b9e4e214 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:53.399131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82d79851-2941-4e8a-9d05-15b1b9e4e214 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:53.399559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82d79851-2941-4e8a-9d05-15b1b9e4e214 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:53.400237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82d79851-2941-4e8a-9d05-15b1b9e4e214 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:53.400691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82d79851-2941-4e8a-9d05-15b1b9e4e214 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:53.401105 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-82d79851-2941-4e8a-9d05-15b1b9e4e214 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:53.403971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e527c4-b576-4f4f-bd06-f9470e83d47f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:53.404426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e527c4-b576-4f4f-bd06-f9470e83d47f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:53.404865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e527c4-b576-4f4f-bd06-f9470e83d47f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:53.405558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e527c4-b576-4f4f-bd06-f9470e83d47f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:53.406009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e527c4-b576-4f4f-bd06-f9470e83d47f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:53.406447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-13e527c4-b576-4f4f-bd06-f9470e83d47f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:53.538925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-82d79851-2941-4e8a-9d05-15b1b9e4e214 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:53.545529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-13e527c4-b576-4f4f-bd06-f9470e83d47f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:53.547607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-82d79851-2941-4e8a-9d05-15b1b9e4e214 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.161994 Aug 24 05:28:53.557704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1611/3106] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:53 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:53.558385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-13e527c4-b576-4f4f-bd06-f9470e83d47f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1368 microversion: 2.1 time: 0.164605 Aug 24 05:28:53.558385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1496/3107] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:53 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:53.789185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-8b644e60-9a23-4c9d-a6b5-ac580bfcf2cb req-738669e6-7e32-46ff-83c9-0aeba39796d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455aaf6b-38bd-45d3-9fe4-6c3b25f0751c", "name": "network-vif-plugged", "status": "completed", "tag": "e197b6e5-a95b-4e87-8f42-63627a372213"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:28:53.798632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-8b644e60-9a23-4c9d-a6b5-ac580bfcf2cb req-738669e6-7e32-46ff-83c9-0aeba39796d5 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:53.799125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-8b644e60-9a23-4c9d-a6b5-ac580bfcf2cb req-738669e6-7e32-46ff-83c9-0aeba39796d5 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:53.799547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-8b644e60-9a23-4c9d-a6b5-ac580bfcf2cb req-738669e6-7e32-46ff-83c9-0aeba39796d5 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:53.810562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-8b644e60-9a23-4c9d-a6b5-ac580bfcf2cb req-738669e6-7e32-46ff-83c9-0aeba39796d5 service nova] Creating event network-vif-plugged:e197b6e5-a95b-4e87-8f42-63627a372213 for instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c on hv-cinder-85426 Aug 24 05:28:53.815580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-8b644e60-9a23-4c9d-a6b5-ac580bfcf2cb req-738669e6-7e32-46ff-83c9-0aeba39796d5 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110003 Aug 24 05:28:53.816161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1612/3108] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:28:54.568712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-57aaa64b-6faa-4608-bca7-f0cf8666d43b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:54.569362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-57aaa64b-6faa-4608-bca7-f0cf8666d43b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:54.576855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57aaa64b-6faa-4608-bca7-f0cf8666d43b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:54.577180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6ff0cf32-2da2-4cb5-9574-3222d00c2e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:54.577618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57aaa64b-6faa-4608-bca7-f0cf8666d43b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:54.577768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57aaa64b-6faa-4608-bca7-f0cf8666d43b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:54.577905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6ff0cf32-2da2-4cb5-9574-3222d00c2e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:54.578465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57aaa64b-6faa-4608-bca7-f0cf8666d43b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:54.578951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57aaa64b-6faa-4608-bca7-f0cf8666d43b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:54.579377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57aaa64b-6faa-4608-bca7-f0cf8666d43b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:54.584126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff0cf32-2da2-4cb5-9574-3222d00c2e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:54.584610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff0cf32-2da2-4cb5-9574-3222d00c2e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:54.585045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff0cf32-2da2-4cb5-9574-3222d00c2e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:54.585735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff0cf32-2da2-4cb5-9574-3222d00c2e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:54.586184 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff0cf32-2da2-4cb5-9574-3222d00c2e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:54.586607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6ff0cf32-2da2-4cb5-9574-3222d00c2e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:54.713682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-57aaa64b-6faa-4608-bca7-f0cf8666d43b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:54.722031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6ff0cf32-2da2-4cb5-9574-3222d00c2e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:54.722473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-57aaa64b-6faa-4608-bca7-f0cf8666d43b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.157685 Aug 24 05:28:54.723078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1497/3109] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:54 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:54.729864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6ff0cf32-2da2-4cb5-9574-3222d00c2e9a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1368 microversion: 2.1 time: 0.157836 Aug 24 05:28:54.738740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1613/3110] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:54 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:28:55.745278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-674f27a3-901a-452a-af54-d449a3fccd57 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:55.746680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-674f27a3-901a-452a-af54-d449a3fccd57 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:55.753962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-674f27a3-901a-452a-af54-d449a3fccd57 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:55.754450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-674f27a3-901a-452a-af54-d449a3fccd57 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:55.755112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-674f27a3-901a-452a-af54-d449a3fccd57 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:55.756000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-674f27a3-901a-452a-af54-d449a3fccd57 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:55.756632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-674f27a3-901a-452a-af54-d449a3fccd57 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:55.757235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-674f27a3-901a-452a-af54-d449a3fccd57 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:55.758042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-62aa44fd-e510-4104-ad5e-ff01893cc0a2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:55.759530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-62aa44fd-e510-4104-ad5e-ff01893cc0a2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:55.769800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62aa44fd-e510-4104-ad5e-ff01893cc0a2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:55.770599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62aa44fd-e510-4104-ad5e-ff01893cc0a2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:55.771527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62aa44fd-e510-4104-ad5e-ff01893cc0a2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:55.772675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62aa44fd-e510-4104-ad5e-ff01893cc0a2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:55.773844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62aa44fd-e510-4104-ad5e-ff01893cc0a2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:55.774650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62aa44fd-e510-4104-ad5e-ff01893cc0a2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:55.906392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-674f27a3-901a-452a-af54-d449a3fccd57 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:55.915817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-674f27a3-901a-452a-af54-d449a3fccd57 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.174528 Aug 24 05:28:55.916395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1498/3111] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:55 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:55.950241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-62aa44fd-e510-4104-ad5e-ff01893cc0a2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:55.958360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-62aa44fd-e510-4104-ad5e-ff01893cc0a2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1556 microversion: 2.1 time: 0.209575 Aug 24 05:28:55.958985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1614/3112] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:55 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1556 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:55.979987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-aa8253ef-42d0-46c8-9a70-8033ebe292ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:55.981213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-aa8253ef-42d0-46c8-9a70-8033ebe292ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:55.987454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa8253ef-42d0-46c8-9a70-8033ebe292ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:55.987934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa8253ef-42d0-46c8-9a70-8033ebe292ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:55.988369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa8253ef-42d0-46c8-9a70-8033ebe292ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:55.989052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa8253ef-42d0-46c8-9a70-8033ebe292ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:55.989501 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa8253ef-42d0-46c8-9a70-8033ebe292ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:55.989921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aa8253ef-42d0-46c8-9a70-8033ebe292ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:56.068931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-aa8253ef-42d0-46c8-9a70-8033ebe292ba tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092802 Aug 24 05:28:56.069538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1499/3113] 10.222.0.97 () {58 vars in 1275 bytes} [Wed Aug 24 05:28:55 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:28:56.937726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-45a3919a-3309-4f20-a046-6e4e742d6683 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:56.938330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-45a3919a-3309-4f20-a046-6e4e742d6683 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:56.944760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45a3919a-3309-4f20-a046-6e4e742d6683 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:56.945241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45a3919a-3309-4f20-a046-6e4e742d6683 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:56.945672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45a3919a-3309-4f20-a046-6e4e742d6683 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:56.946358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45a3919a-3309-4f20-a046-6e4e742d6683 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:56.946823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45a3919a-3309-4f20-a046-6e4e742d6683 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:56.947247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-45a3919a-3309-4f20-a046-6e4e742d6683 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:57.095331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-e67a7c2d-dd7b-41fc-90fa-8c5299d18ee0 req-a82c3a1e-debe-4fb6-8561-aa0cc50d44f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "455aaf6b-38bd-45d3-9fe4-6c3b25f0751c", "tag": "e197b6e5-a95b-4e87-8f42-63627a372213"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:28:57.107788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-e67a7c2d-dd7b-41fc-90fa-8c5299d18ee0 req-a82c3a1e-debe-4fb6-8561-aa0cc50d44f4 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:57.108530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-e67a7c2d-dd7b-41fc-90fa-8c5299d18ee0 req-a82c3a1e-debe-4fb6-8561-aa0cc50d44f4 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:57.109137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-e67a7c2d-dd7b-41fc-90fa-8c5299d18ee0 req-a82c3a1e-debe-4fb6-8561-aa0cc50d44f4 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:57.112313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-45a3919a-3309-4f20-a046-6e4e742d6683 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:57.120669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-45a3919a-3309-4f20-a046-6e4e742d6683 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.186778 Aug 24 05:28:57.122758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1615/3114] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:56 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:57.123048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-e67a7c2d-dd7b-41fc-90fa-8c5299d18ee0 req-a82c3a1e-debe-4fb6-8561-aa0cc50d44f4 service nova] Creating event network-changed:e197b6e5-a95b-4e87-8f42-63627a372213 for instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c on hv-cinder-85426 Aug 24 05:28:57.141553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-e67a7c2d-dd7b-41fc-90fa-8c5299d18ee0 req-a82c3a1e-debe-4fb6-8561-aa0cc50d44f4 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106820 Aug 24 05:28:57.142302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1500/3115] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:28:57.943202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-1559a41a-704b-469a-9c80-c55dec0e2da6 req-00584258-4942-477c-b835-6c042e9f34b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448db0f9-77b5-46a7-8c7e-98cddd6a0ec5", "name": "network-vif-plugged", "status": "completed", "tag": "cf1cd12d-535b-4621-b475-9fd55f8e8acf"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:28:57.953992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-1559a41a-704b-469a-9c80-c55dec0e2da6 req-00584258-4942-477c-b835-6c042e9f34b7 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:57.954551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-1559a41a-704b-469a-9c80-c55dec0e2da6 req-00584258-4942-477c-b835-6c042e9f34b7 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:57.954999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-1559a41a-704b-469a-9c80-c55dec0e2da6 req-00584258-4942-477c-b835-6c042e9f34b7 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:57.966674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-1559a41a-704b-469a-9c80-c55dec0e2da6 req-00584258-4942-477c-b835-6c042e9f34b7 service nova] Creating event network-vif-plugged:cf1cd12d-535b-4621-b475-9fd55f8e8acf for instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 on hv-cinder-85426 Aug 24 05:28:57.971809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-1559a41a-704b-469a-9c80-c55dec0e2da6 req-00584258-4942-477c-b835-6c042e9f34b7 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032317 Aug 24 05:28:57.972568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1616/3116] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:28:58.146199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-27930a92-6b39-4702-bc34-4bb0bb3f0efc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:58.146939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-27930a92-6b39-4702-bc34-4bb0bb3f0efc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:58.154081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27930a92-6b39-4702-bc34-4bb0bb3f0efc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:58.154879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27930a92-6b39-4702-bc34-4bb0bb3f0efc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:58.155534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27930a92-6b39-4702-bc34-4bb0bb3f0efc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:58.156245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27930a92-6b39-4702-bc34-4bb0bb3f0efc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:58.156703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27930a92-6b39-4702-bc34-4bb0bb3f0efc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:58.157128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-27930a92-6b39-4702-bc34-4bb0bb3f0efc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:58.338390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-27930a92-6b39-4702-bc34-4bb0bb3f0efc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:58.346880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-27930a92-6b39-4702-bc34-4bb0bb3f0efc tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.205409 Aug 24 05:28:58.347455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1501/3117] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:58 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:28:59.367936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9700ed5d-48ca-46a9-9c76-93e0473b7d68 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:28:59.368632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9700ed5d-48ca-46a9-9c76-93e0473b7d68 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:28:59.374998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9700ed5d-48ca-46a9-9c76-93e0473b7d68 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:59.375477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9700ed5d-48ca-46a9-9c76-93e0473b7d68 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:59.376033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9700ed5d-48ca-46a9-9c76-93e0473b7d68 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:59.376721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9700ed5d-48ca-46a9-9c76-93e0473b7d68 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:28:59.377169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9700ed5d-48ca-46a9-9c76-93e0473b7d68 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:28:59.377588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9700ed5d-48ca-46a9-9c76-93e0473b7d68 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:28:59.524061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9700ed5d-48ca-46a9-9c76-93e0473b7d68 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:28:59.532953 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9700ed5d-48ca-46a9-9c76-93e0473b7d68 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1364 microversion: 2.1 time: 0.169670 Aug 24 05:28:59.533521 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1617/3118] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:28:59 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:29:00.554734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3d31cb5a-6c31-4a25-82b8-8763840a97e6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:29:00.555497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3d31cb5a-6c31-4a25-82b8-8763840a97e6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:29:00.563541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d31cb5a-6c31-4a25-82b8-8763840a97e6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:29:00.564031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d31cb5a-6c31-4a25-82b8-8763840a97e6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:29:00.564469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d31cb5a-6c31-4a25-82b8-8763840a97e6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:29:00.565174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d31cb5a-6c31-4a25-82b8-8763840a97e6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:29:00.565645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d31cb5a-6c31-4a25-82b8-8763840a97e6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:29:00.566052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3d31cb5a-6c31-4a25-82b8-8763840a97e6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:29:00.703831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3d31cb5a-6c31-4a25-82b8-8763840a97e6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:29:00.711829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3d31cb5a-6c31-4a25-82b8-8763840a97e6 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1550 microversion: 2.1 time: 0.161564 Aug 24 05:29:00.712402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1502/3119] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:29:00 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1550 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:29:00.731943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dda1505a-50f2-4300-8b01-f84c833450c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:29:00.732584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dda1505a-50f2-4300-8b01-f84c833450c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:29:00.739465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dda1505a-50f2-4300-8b01-f84c833450c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:29:00.739938 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dda1505a-50f2-4300-8b01-f84c833450c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:29:00.740365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dda1505a-50f2-4300-8b01-f84c833450c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:29:00.741046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dda1505a-50f2-4300-8b01-f84c833450c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:29:00.741491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dda1505a-50f2-4300-8b01-f84c833450c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:29:00.741904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dda1505a-50f2-4300-8b01-f84c833450c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:29:00.824546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dda1505a-50f2-4300-8b01-f84c833450c4 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095905 Aug 24 05:29:00.825411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1618/3120] 10.222.0.97 () {58 vars in 1275 bytes} [Wed Aug 24 05:29:00 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:29:02.006078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-4b3f1e02-252d-4ee7-8529-574463104f89 req-7fa9ed0f-6203-45b9-9d67-54eaa42948bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "448db0f9-77b5-46a7-8c7e-98cddd6a0ec5", "tag": "cf1cd12d-535b-4621-b475-9fd55f8e8acf"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:29:02.016740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-4b3f1e02-252d-4ee7-8529-574463104f89 req-7fa9ed0f-6203-45b9-9d67-54eaa42948bb service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:29:02.017228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-4b3f1e02-252d-4ee7-8529-574463104f89 req-7fa9ed0f-6203-45b9-9d67-54eaa42948bb service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:29:02.019529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-4b3f1e02-252d-4ee7-8529-574463104f89 req-7fa9ed0f-6203-45b9-9d67-54eaa42948bb service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:29:02.021730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:29:02.031389 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-4b3f1e02-252d-4ee7-8529-574463104f89 req-7fa9ed0f-6203-45b9-9d67-54eaa42948bb service nova] Creating event network-changed:cf1cd12d-535b-4621-b475-9fd55f8e8acf for instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 on hv-cinder-85426 Aug 24 05:29:02.036683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-4b3f1e02-252d-4ee7-8529-574463104f89 req-7fa9ed0f-6203-45b9-9d67-54eaa42948bb service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034165 Aug 24 05:29:02.037534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1503/3121] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:30:12.391069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=21 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:12.392168 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=67 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:12.397021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-37f353d5-b76c-4b2a-b6cf-714385f6fc09 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:12.397677 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-37f353d5-b76c-4b2a-b6cf-714385f6fc09 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:12.405042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37f353d5-b76c-4b2a-b6cf-714385f6fc09 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:12.405517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37f353d5-b76c-4b2a-b6cf-714385f6fc09 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:12.405956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37f353d5-b76c-4b2a-b6cf-714385f6fc09 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:12.406637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37f353d5-b76c-4b2a-b6cf-714385f6fc09 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:12.407113 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37f353d5-b76c-4b2a-b6cf-714385f6fc09 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:12.407536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37f353d5-b76c-4b2a-b6cf-714385f6fc09 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:12.436498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-37f353d5-b76c-4b2a-b6cf-714385f6fc09 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/ips" status: 200 len: 148 microversion: 2.1 time: 0.048665 Aug 24 05:30:12.437083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1619/3122] 10.222.0.97 () {58 vars in 1248 bytes} [Wed Aug 24 05:30:12 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:17.132127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=25 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:17.132817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:17.137339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-979d1aa5-07f8-41dd-96bb-aaf86ce1b44e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:17.137980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-979d1aa5-07f8-41dd-96bb-aaf86ce1b44e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:17.144823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-979d1aa5-07f8-41dd-96bb-aaf86ce1b44e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:17.145296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-979d1aa5-07f8-41dd-96bb-aaf86ce1b44e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:17.145723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-979d1aa5-07f8-41dd-96bb-aaf86ce1b44e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:17.146392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-979d1aa5-07f8-41dd-96bb-aaf86ce1b44e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:17.146866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-979d1aa5-07f8-41dd-96bb-aaf86ce1b44e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:17.147282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-979d1aa5-07f8-41dd-96bb-aaf86ce1b44e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:17.169787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-979d1aa5-07f8-41dd-96bb-aaf86ce1b44e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/ips" status: 200 len: 146 microversion: 2.1 time: 0.039871 Aug 24 05:30:17.171227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1504/3123] 10.222.0.97 () {58 vars in 1248 bytes} [Wed Aug 24 05:30:17 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:35.738055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5082ff2d-3dbc-4c1a-856d-b7df4164190a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcbf72e0-2631-4959-88b3-9ff2f3ee86b7"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:35.740544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5082ff2d-3dbc-4c1a-856d-b7df4164190a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:35.746975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:35.747985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=4 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:35.750226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5082ff2d-3dbc-4c1a-856d-b7df4164190a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:35.750858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5082ff2d-3dbc-4c1a-856d-b7df4164190a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:35.751338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5082ff2d-3dbc-4c1a-856d-b7df4164190a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:35.752658 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5082ff2d-3dbc-4c1a-856d-b7df4164190a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:35.753130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5082ff2d-3dbc-4c1a-856d-b7df4164190a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:35.753553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5082ff2d-3dbc-4c1a-856d-b7df4164190a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:36.363433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5082ff2d-3dbc-4c1a-856d-b7df4164190a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "POST /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629816 Aug 24 05:30:36.364120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1620/3124] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 05:30:35 2022] POST /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:36.662717 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-7dbe5ea4-de5e-4892-a386-4e1c3aab9195 req-b1b83810-ab8d-4e77-8425-43b3c4febdf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f9cc46-e608-4e87-8a41-cbd6058576a0", "name": "network-vif-deleted", "tag": "a8ec641b-f5c0-4262-ae7a-a531d6ad11dd"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:36.668095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:36.669358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=4 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:36.676570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-7dbe5ea4-de5e-4892-a386-4e1c3aab9195 req-b1b83810-ab8d-4e77-8425-43b3c4febdf0 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:36.677012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-7dbe5ea4-de5e-4892-a386-4e1c3aab9195 req-b1b83810-ab8d-4e77-8425-43b3c4febdf0 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:36.677648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-7dbe5ea4-de5e-4892-a386-4e1c3aab9195 req-b1b83810-ab8d-4e77-8425-43b3c4febdf0 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:36.690330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-7dbe5ea4-de5e-4892-a386-4e1c3aab9195 req-b1b83810-ab8d-4e77-8425-43b3c4febdf0 service nova] Creating event network-vif-deleted:a8ec641b-f5c0-4262-ae7a-a531d6ad11dd for instance 61f9cc46-e608-4e87-8a41-cbd6058576a0 on hv-cinder-85426 Aug 24 05:30:36.695866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-7dbe5ea4-de5e-4892-a386-4e1c3aab9195 req-b1b83810-ab8d-4e77-8425-43b3c4febdf0 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036823 Aug 24 05:30:36.696804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1505/3125] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:36.924919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dfa08539-d607-4492-93ae-73723743b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1116deea-e125-4d8a-8868-af37557b162e"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:36.928066 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dfa08539-d607-4492-93ae-73723743b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:36.935554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa08539-d607-4492-93ae-73723743b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:36.936063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa08539-d607-4492-93ae-73723743b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:36.936503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa08539-d607-4492-93ae-73723743b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:36.937904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa08539-d607-4492-93ae-73723743b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:36.938358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa08539-d607-4492-93ae-73723743b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:36.939025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfa08539-d607-4492-93ae-73723743b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:37.185768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1b141368-3c81-4453-b870-94b084baf867 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:37.186478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1b141368-3c81-4453-b870-94b084baf867 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:37.194162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b141368-3c81-4453-b870-94b084baf867 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:37.194763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b141368-3c81-4453-b870-94b084baf867 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:37.195271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b141368-3c81-4453-b870-94b084baf867 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:37.196155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b141368-3c81-4453-b870-94b084baf867 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:37.196779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b141368-3c81-4453-b870-94b084baf867 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:37.197351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1b141368-3c81-4453-b870-94b084baf867 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:37.227606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1b141368-3c81-4453-b870-94b084baf867 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Going to try to terminate instance {{(pid=120557) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:30:37.320693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1b141368-3c81-4453-b870-94b084baf867 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "DELETE /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 204 len: 0 microversion: 2.1 time: 0.139291 Aug 24 05:30:37.325054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1506/3126] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:30:37 2022] DELETE /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:30:37.333777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b67ded2f-465f-4638-9de0-738695e44a96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:37.335066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b67ded2f-465f-4638-9de0-738695e44a96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:37.345209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b67ded2f-465f-4638-9de0-738695e44a96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:37.346164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b67ded2f-465f-4638-9de0-738695e44a96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:37.346947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b67ded2f-465f-4638-9de0-738695e44a96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:37.349236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b67ded2f-465f-4638-9de0-738695e44a96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:37.351448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b67ded2f-465f-4638-9de0-738695e44a96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:37.352112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b67ded2f-465f-4638-9de0-738695e44a96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:37.477365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dfa08539-d607-4492-93ae-73723743b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.557915 Aug 24 05:30:37.478036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1621/3127] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 05:30:36 2022] POST /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:37.541130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b67ded2f-465f-4638-9de0-738695e44a96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:37.550715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b67ded2f-465f-4638-9de0-738695e44a96 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1508 microversion: 2.1 time: 0.224041 Aug 24 05:30:37.551282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1507/3128] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:37 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1508 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:38.572994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-380c4863-1c05-4179-be5c-0c998edd26e8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:38.573792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-380c4863-1c05-4179-be5c-0c998edd26e8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:38.583125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380c4863-1c05-4179-be5c-0c998edd26e8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:38.583607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380c4863-1c05-4179-be5c-0c998edd26e8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:38.584032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380c4863-1c05-4179-be5c-0c998edd26e8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:38.584804 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380c4863-1c05-4179-be5c-0c998edd26e8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:38.585255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380c4863-1c05-4179-be5c-0c998edd26e8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:38.587038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-380c4863-1c05-4179-be5c-0c998edd26e8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:38.739997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-380c4863-1c05-4179-be5c-0c998edd26e8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:38.750150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-380c4863-1c05-4179-be5c-0c998edd26e8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1508 microversion: 2.1 time: 0.181171 Aug 24 05:30:38.750732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1622/3129] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:38 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:39.776423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-16d32dac-3533-4b92-b22f-b441c27cadc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:39.777058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-16d32dac-3533-4b92-b22f-b441c27cadc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:39.783457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d32dac-3533-4b92-b22f-b441c27cadc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:39.783936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d32dac-3533-4b92-b22f-b441c27cadc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:39.784367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d32dac-3533-4b92-b22f-b441c27cadc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:39.785040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d32dac-3533-4b92-b22f-b441c27cadc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:39.785519 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d32dac-3533-4b92-b22f-b441c27cadc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:39.785936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-16d32dac-3533-4b92-b22f-b441c27cadc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:39.920668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-16d32dac-3533-4b92-b22f-b441c27cadc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:39.928808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-16d32dac-3533-4b92-b22f-b441c27cadc2 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1508 microversion: 2.1 time: 0.156235 Aug 24 05:30:39.929371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1508/3130] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:39 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:40.950013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-02bb9f01-27c0-430f-b421-41a52831368c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:40.950624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-02bb9f01-27c0-430f-b421-41a52831368c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:40.957805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02bb9f01-27c0-430f-b421-41a52831368c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:40.958282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02bb9f01-27c0-430f-b421-41a52831368c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:40.958741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02bb9f01-27c0-430f-b421-41a52831368c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:40.959426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02bb9f01-27c0-430f-b421-41a52831368c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:40.959878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02bb9f01-27c0-430f-b421-41a52831368c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:40.960300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-02bb9f01-27c0-430f-b421-41a52831368c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:41.090964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-02bb9f01-27c0-430f-b421-41a52831368c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:41.098966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-02bb9f01-27c0-430f-b421-41a52831368c tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1508 microversion: 2.1 time: 0.152771 Aug 24 05:30:41.099527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1623/3131] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:40 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:42.119975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-664bbf11-2f9e-4aa4-b2d0-6b68d121913e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:42.121254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-664bbf11-2f9e-4aa4-b2d0-6b68d121913e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:42.128051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-664bbf11-2f9e-4aa4-b2d0-6b68d121913e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:42.128533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-664bbf11-2f9e-4aa4-b2d0-6b68d121913e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:42.128972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-664bbf11-2f9e-4aa4-b2d0-6b68d121913e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:42.129828 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-664bbf11-2f9e-4aa4-b2d0-6b68d121913e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:42.130280 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-664bbf11-2f9e-4aa4-b2d0-6b68d121913e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:42.130716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-664bbf11-2f9e-4aa4-b2d0-6b68d121913e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:42.339217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-664bbf11-2f9e-4aa4-b2d0-6b68d121913e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:42.347781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-664bbf11-2f9e-4aa4-b2d0-6b68d121913e tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1508 microversion: 2.1 time: 0.231873 Aug 24 05:30:42.348361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1509/3132] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:42 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:42.641908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-1f3b26cf-4e9d-490a-a78f-c7cdc5b1c1df req-fc1a3c48-db83-423f-85e2-0e8aee14dafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99653dcb-0328-453a-a720-7df80c129db8", "name": "network-vif-deleted", "tag": "08f84bc6-2ce1-403b-bf50-415ff1e16c87"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:42.653230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-1f3b26cf-4e9d-490a-a78f-c7cdc5b1c1df req-fc1a3c48-db83-423f-85e2-0e8aee14dafa service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:42.653695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-1f3b26cf-4e9d-490a-a78f-c7cdc5b1c1df req-fc1a3c48-db83-423f-85e2-0e8aee14dafa service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:42.654115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-1f3b26cf-4e9d-490a-a78f-c7cdc5b1c1df req-fc1a3c48-db83-423f-85e2-0e8aee14dafa service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:42.668189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-1f3b26cf-4e9d-490a-a78f-c7cdc5b1c1df req-fc1a3c48-db83-423f-85e2-0e8aee14dafa service nova] Creating event network-vif-deleted:08f84bc6-2ce1-403b-bf50-415ff1e16c87 for instance 99653dcb-0328-453a-a720-7df80c129db8 on hv-cinder-85426 Aug 24 05:30:42.673745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-1f3b26cf-4e9d-490a-a78f-c7cdc5b1c1df req-fc1a3c48-db83-423f-85e2-0e8aee14dafa service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035837 Aug 24 05:30:42.674678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1624/3133] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:43.368967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b08526b7-2f7d-4ed3-98c0-f528f62c5d78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:43.369585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b08526b7-2f7d-4ed3-98c0-f528f62c5d78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:43.376781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08526b7-2f7d-4ed3-98c0-f528f62c5d78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:43.377261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08526b7-2f7d-4ed3-98c0-f528f62c5d78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:43.377697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08526b7-2f7d-4ed3-98c0-f528f62c5d78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:43.378376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08526b7-2f7d-4ed3-98c0-f528f62c5d78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:43.378867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08526b7-2f7d-4ed3-98c0-f528f62c5d78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:43.379353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b08526b7-2f7d-4ed3-98c0-f528f62c5d78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:43.441429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b08526b7-2f7d-4ed3-98c0-f528f62c5d78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:43.449170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b08526b7-2f7d-4ed3-98c0-f528f62c5d78 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1293 microversion: 2.1 time: 0.083924 Aug 24 05:30:43.449734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1510/3134] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:43 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:44.472174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:44.472862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:44.478963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:44.479433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:44.479857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:44.480526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:44.480964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:44.481376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:44.511305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:44.511791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:44.512213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:44.512640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lazy-loading 'fault' on Instance uuid 99653dcb-0328-453a-a720-7df80c129db8 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:30:44.558671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:44.567111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ae8ed404-8358-42fa-971f-54b678228696 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 200 len: 1312 microversion: 2.1 time: 0.100005 Aug 24 05:30:44.575798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1625/3135] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:44 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:45.042985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6157f974-f3c7-46fe-9662-83007aa6d972 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:45.045118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6157f974-f3c7-46fe-9662-83007aa6d972 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:45.051931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6157f974-f3c7-46fe-9662-83007aa6d972 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:45.052413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6157f974-f3c7-46fe-9662-83007aa6d972 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:45.052854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6157f974-f3c7-46fe-9662-83007aa6d972 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:45.053542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6157f974-f3c7-46fe-9662-83007aa6d972 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:45.053991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6157f974-f3c7-46fe-9662-83007aa6d972 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:45.054413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6157f974-f3c7-46fe-9662-83007aa6d972 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:45.084115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6157f974-f3c7-46fe-9662-83007aa6d972 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Aug 24 05:30:45.084683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1511/3136] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:30:45 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:45.096114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5daaa06a-a487-48e3-a9fe-ff6c4bdb850c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:45.096624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5daaa06a-a487-48e3-a9fe-ff6c4bdb850c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:45.102603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5daaa06a-a487-48e3-a9fe-ff6c4bdb850c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:45.103134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5daaa06a-a487-48e3-a9fe-ff6c4bdb850c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:45.103570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5daaa06a-a487-48e3-a9fe-ff6c4bdb850c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:45.104258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5daaa06a-a487-48e3-a9fe-ff6c4bdb850c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:45.104713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5daaa06a-a487-48e3-a9fe-ff6c4bdb850c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:45.105152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5daaa06a-a487-48e3-a9fe-ff6c4bdb850c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:45.137657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5daaa06a-a487-48e3-a9fe-ff6c4bdb850c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments/fcbf72e0-2631-4959-88b3-9ff2f3ee86b7" status: 200 len: 194 microversion: 2.1 time: 0.046303 Aug 24 05:30:45.143789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1626/3137] 10.222.0.97 () {58 vars in 1413 bytes} [Wed Aug 24 05:30:45 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments/fcbf72e0-2631-4959-88b3-9ff2f3ee86b7 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:45.588242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:45.588852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: 99653dcb-0328-453a-a720-7df80c129db8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:45.594808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:45.595291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:45.595723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:45.596974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:45.597454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:45.597875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:45.611216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] HTTP exception thrown: Instance 99653dcb-0328-453a-a720-7df80c129db8 could not be found. Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Request method failure captured: Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 HTTP/1.1 Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7vgEWxIH4xlLamu9K66ml8YuLDEp_YQA2qs7UtL-6Z69FWBvRKKNvJInfMymaPcGe2WBDYhavc6QIMajs2OFq6W5mcvXNzykLs7D4t7A3-UF_eNDqrK1uKmrHM8wulHTZatXbcXJ79hUK7zHBY0hq-oxViEgUTqYJZWbuPL5XRyfU Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:30:45.613483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3c309287c4964e60a66398d9841b9c29", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 246605916c884dfab9aa75297e358d6f Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 99653dcb-0328-453a-a720-7df80c129db8 could not be found. Aug 24 05:30:45.615154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '99653dcb-0328-453a-a720-7df80c129db8'} Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99653dcb-0328-453a-a720-7df80c129db8 could not be found. Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:30:45.616233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99653dcb-0328-453a-a720-7df80c129db8 could not be found. Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99653dcb-0328-453a-a720-7df80c129db8 could not be found. Aug 24 05:30:45.618117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:30:45.619975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Returning 404 to user: Instance 99653dcb-0328-453a-a720-7df80c129db8 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:30:45.619975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-274a4202-a292-4672-9b53-bc135e8fe49b tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8" status: 404 len: 111 microversion: 2.1 time: 0.030450 Aug 24 05:30:45.619975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1512/3138] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:45 2022] GET /compute/v2.1/servers/99653dcb-0328-453a-a720-7df80c129db8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:30:45.623282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d8e60f4e-4a17-4968-b8e8-eba71b46e87d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:45.623778 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d8e60f4e-4a17-4968-b8e8-eba71b46e87d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:45.630051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e60f4e-4a17-4968-b8e8-eba71b46e87d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:45.630519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e60f4e-4a17-4968-b8e8-eba71b46e87d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:45.631008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e60f4e-4a17-4968-b8e8-eba71b46e87d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:45.631679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e60f4e-4a17-4968-b8e8-eba71b46e87d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:45.632125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e60f4e-4a17-4968-b8e8-eba71b46e87d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:45.632541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d8e60f4e-4a17-4968-b8e8-eba71b46e87d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:45.657357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d8e60f4e-4a17-4968-b8e8-eba71b46e87d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Going to try to terminate instance {{(pid=120558) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:30:45.730626 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d8e60f4e-4a17-4968-b8e8-eba71b46e87d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "DELETE /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 204 len: 0 microversion: 2.1 time: 0.110752 Aug 24 05:30:45.734407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1627/3139] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:30:45 2022] DELETE /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:30:45.740685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-24d0456a-c617-495a-8fc5-4e734f23fdb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:45.741438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-24d0456a-c617-495a-8fc5-4e734f23fdb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:45.759492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d0456a-c617-495a-8fc5-4e734f23fdb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:45.760022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d0456a-c617-495a-8fc5-4e734f23fdb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:45.760679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d0456a-c617-495a-8fc5-4e734f23fdb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:45.761505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d0456a-c617-495a-8fc5-4e734f23fdb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:45.761960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d0456a-c617-495a-8fc5-4e734f23fdb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:45.762385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-24d0456a-c617-495a-8fc5-4e734f23fdb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:45.901297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-24d0456a-c617-495a-8fc5-4e734f23fdb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:45.910006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-24d0456a-c617-495a-8fc5-4e734f23fdb8 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.174082 Aug 24 05:30:45.910576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1513/3140] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:45 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:46.510288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-103df07c-94f6-456f-8c54-89dfdf706161 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "931a0921-bab4-4816-84ab-9cdb50bbb622"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:46.512715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-103df07c-94f6-456f-8c54-89dfdf706161 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:46.519437 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103df07c-94f6-456f-8c54-89dfdf706161 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:46.519912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103df07c-94f6-456f-8c54-89dfdf706161 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:46.520344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103df07c-94f6-456f-8c54-89dfdf706161 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:46.521027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103df07c-94f6-456f-8c54-89dfdf706161 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:46.521470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103df07c-94f6-456f-8c54-89dfdf706161 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:46.521896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-103df07c-94f6-456f-8c54-89dfdf706161 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:46.889139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-103df07c-94f6-456f-8c54-89dfdf706161 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "POST /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383006 Aug 24 05:30:46.889808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1628/3141] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 05:30:46 2022] POST /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:46.931095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-68b8bd51-0218-4cf7-aab1-7a7fd16a828d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:46.931779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-68b8bd51-0218-4cf7-aab1-7a7fd16a828d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:46.938647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b8bd51-0218-4cf7-aab1-7a7fd16a828d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:46.939159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b8bd51-0218-4cf7-aab1-7a7fd16a828d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:46.939596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b8bd51-0218-4cf7-aab1-7a7fd16a828d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:46.940941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b8bd51-0218-4cf7-aab1-7a7fd16a828d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:46.941492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b8bd51-0218-4cf7-aab1-7a7fd16a828d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:46.941919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-68b8bd51-0218-4cf7-aab1-7a7fd16a828d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:47.161062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-68b8bd51-0218-4cf7-aab1-7a7fd16a828d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '246605916c884dfab9aa75297e358d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c309287c4964e60a66398d9841b9c29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:30:47.169144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-68b8bd51-0218-4cf7-aab1-7a7fd16a828d tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 200 len: 1521 microversion: 2.1 time: 0.241872 Aug 24 05:30:47.169728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1514/3142] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:46 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:30:47.499742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-7036aa18-8d7f-4ede-af7a-495d89fc8a54 req-a266becb-6ebb-4b7e-9b8e-d73ca5669461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc16ffe9-0180-4a64-b937-bfd52cacbc89", "name": "network-vif-deleted", "tag": "8db7ccd5-249a-4f20-a57f-62285a9089a4"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:47.509790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-7036aa18-8d7f-4ede-af7a-495d89fc8a54 req-a266becb-6ebb-4b7e-9b8e-d73ca5669461 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:47.510278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-7036aa18-8d7f-4ede-af7a-495d89fc8a54 req-a266becb-6ebb-4b7e-9b8e-d73ca5669461 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:47.510680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-7036aa18-8d7f-4ede-af7a-495d89fc8a54 req-a266becb-6ebb-4b7e-9b8e-d73ca5669461 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:47.523891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-7036aa18-8d7f-4ede-af7a-495d89fc8a54 req-a266becb-6ebb-4b7e-9b8e-d73ca5669461 service nova] Creating event network-vif-deleted:8db7ccd5-249a-4f20-a57f-62285a9089a4 for instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 on hv-cinder-85426 Aug 24 05:30:47.529422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-7036aa18-8d7f-4ede-af7a-495d89fc8a54 req-a266becb-6ebb-4b7e-9b8e-d73ca5669461 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033842 Aug 24 05:30:47.530369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1629/3143] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:48.190745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:48.191373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] [instance: dc16ffe9-0180-4a64-b937-bfd52cacbc89] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:48.197773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:48.198255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:48.198706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:48.199407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:48.199860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:48.200285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:48.214251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] HTTP exception thrown: Instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 could not be found. Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Request method failure captured: Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 HTTP/1.1 Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa7vgEWxIH4xlLamu9K66ml8YuLDEp_YQA2qs7UtL-6Z69FWBvRKKNvJInfMymaPcGe2WBDYhavc6QIMajs2OFq6W5mcvXNzykLs7D4t7A3-UF_eNDqrK1uKmrHM8wulHTZatXbcXJ79hUK7zHBY0hq-oxViEgUTqYJZWbuPL5XRyfU Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:30:48.215799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_3c309287c4964e60a66398d9841b9c29", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/3c309287c4964e60a66398d9841b9c29"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 3c309287c4964e60a66398d9841b9c29 Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-71049153 Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 246605916c884dfab9aa75297e358d6f Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-ServerRescueNegativeTestJSON-71049153-project Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 could not be found. Aug 24 05:30:48.217609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': 'dc16ffe9-0180-4a64-b937-bfd52cacbc89'} Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 could not be found. Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:30:48.218631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 could not be found. Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 could not be found. Aug 24 05:30:48.220337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:30:48.222590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] Returning 404 to user: Instance dc16ffe9-0180-4a64-b937-bfd52cacbc89 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:30:48.222590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-80ca64cf-7edd-4aef-9d1c-38fff3aad130 tempest-ServerRescueNegativeTestJSON-71049153 tempest-ServerRescueNegativeTestJSON-71049153-project] 10.222.0.97 "GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89" status: 404 len: 111 microversion: 2.1 time: 0.030350 Aug 24 05:30:48.222590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1515/3144] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:30:48 2022] GET /compute/v2.1/servers/dc16ffe9-0180-4a64-b937-bfd52cacbc89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:30:52.470843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1116deea-e125-4d8a-8868-af37557b162e"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:52.473923 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:52.480191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:52.480668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:52.481098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:52.481781 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:52.482224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:52.482639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:52.569836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Invalid volume: volume 1116deea-e125-4d8a-8868-af37557b162e is already attached to instances: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: POST /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments HTTP/1.1 Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 74 Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:30:52.571663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {"volumeAttachment": {"volumeId": "1116deea-e125-4d8a-8868-af37557b162e"}} Aug 24 05:30:52.573499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Invalid volume: volume 1116deea-e125-4d8a-8868-af37557b162e is already attached to instances: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'server_id': '455aaf6b-38bd-45d3-9fe4-6c3b25f0751c', 'body': {'volumeAttachment': {'volumeId': '1116deea-e125-4d8a-8868-af37557b162e'}}} Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1116deea-e125-4d8a-8868-af37557b162e is already attached to instances: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:30:52.574583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1116deea-e125-4d8a-8868-af37557b162e is already attached to instances: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:30:52.576404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:30:52.578073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:30:52.578073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:30:52.578073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:30:52.578073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1116deea-e125-4d8a-8868-af37557b162e is already attached to instances: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c Aug 24 05:30:52.578073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:30:52.578073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 400 to user: Invalid volume: volume 1116deea-e125-4d8a-8868-af37557b162e is already attached to instances: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:30:52.578073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1f9efc07-f5bc-4cc3-9815-07fcaa5cdd71 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107987 Aug 24 05:30:52.578073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1630/3145] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 05:30:52 2022] POST /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 05:30:52.641774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-90a3f237-43e1-4d37-ad85-b34bd1f0da39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:52.642314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-90a3f237-43e1-4d37-ad85-b34bd1f0da39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:52.649558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90a3f237-43e1-4d37-ad85-b34bd1f0da39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:52.650044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90a3f237-43e1-4d37-ad85-b34bd1f0da39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:52.650478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90a3f237-43e1-4d37-ad85-b34bd1f0da39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:52.651195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90a3f237-43e1-4d37-ad85-b34bd1f0da39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:52.651650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90a3f237-43e1-4d37-ad85-b34bd1f0da39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:52.652071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90a3f237-43e1-4d37-ad85-b34bd1f0da39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:52.736218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-90a3f237-43e1-4d37-ad85-b34bd1f0da39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'services' on Instance uuid 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:30:52.812135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-90a3f237-43e1-4d37-ad85-b34bd1f0da39 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments/1116deea-e125-4d8a-8868-af37557b162e" status: 202 len: 0 microversion: 2.1 time: 0.174095 Aug 24 05:30:52.812726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1516/3146] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:30:52 2022] DELETE /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments/1116deea-e125-4d8a-8868-af37557b162e => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:30:52.822636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c5fed69c-1645-4c83-ab46-301cc8f4b669 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:52.825232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c5fed69c-1645-4c83-ab46-301cc8f4b669 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:52.833342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5fed69c-1645-4c83-ab46-301cc8f4b669 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:52.834336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5fed69c-1645-4c83-ab46-301cc8f4b669 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:52.834780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5fed69c-1645-4c83-ab46-301cc8f4b669 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:52.835592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5fed69c-1645-4c83-ab46-301cc8f4b669 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:52.837239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5fed69c-1645-4c83-ab46-301cc8f4b669 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:52.837901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c5fed69c-1645-4c83-ab46-301cc8f4b669 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:52.868039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:52.873332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c5fed69c-1645-4c83-ab46-301cc8f4b669 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055465 Aug 24 05:30:52.873904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1631/3147] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:30:52 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:53.890313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8f1bf318-7a9a-42bd-bfbb-30f7028edca4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:53.899240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8f1bf318-7a9a-42bd-bfbb-30f7028edca4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:53.911352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1bf318-7a9a-42bd-bfbb-30f7028edca4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:53.912215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1bf318-7a9a-42bd-bfbb-30f7028edca4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:53.912723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1bf318-7a9a-42bd-bfbb-30f7028edca4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:53.913495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1bf318-7a9a-42bd-bfbb-30f7028edca4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:53.914017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1bf318-7a9a-42bd-bfbb-30f7028edca4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:53.914510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8f1bf318-7a9a-42bd-bfbb-30f7028edca4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:53.958092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8f1bf318-7a9a-42bd-bfbb-30f7028edca4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074545 Aug 24 05:30:53.958873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1517/3148] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:30:53 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:54.974214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4f6ab187-f2bc-42f5-b548-4451791f4141 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:54.978508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4f6ab187-f2bc-42f5-b548-4451791f4141 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:54.996985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f6ab187-f2bc-42f5-b548-4451791f4141 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:54.997835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f6ab187-f2bc-42f5-b548-4451791f4141 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:54.998653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f6ab187-f2bc-42f5-b548-4451791f4141 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:55.000088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f6ab187-f2bc-42f5-b548-4451791f4141 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:55.000790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f6ab187-f2bc-42f5-b548-4451791f4141 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:55.001622 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f6ab187-f2bc-42f5-b548-4451791f4141 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:55.043843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4f6ab187-f2bc-42f5-b548-4451791f4141 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075353 Aug 24 05:30:55.044560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1632/3149] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:30:54 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:56.075004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-034ff37b-1bc3-4681-b7af-34489f438870 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:56.080925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-034ff37b-1bc3-4681-b7af-34489f438870 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:56.090231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-034ff37b-1bc3-4681-b7af-34489f438870 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:56.091078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-034ff37b-1bc3-4681-b7af-34489f438870 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:56.091716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-034ff37b-1bc3-4681-b7af-34489f438870 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:56.092692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-034ff37b-1bc3-4681-b7af-34489f438870 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:56.093327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-034ff37b-1bc3-4681-b7af-34489f438870 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:56.093929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-034ff37b-1bc3-4681-b7af-34489f438870 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:56.148802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-034ff37b-1bc3-4681-b7af-34489f438870 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096523 Aug 24 05:30:56.149399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1518/3150] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:30:56 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:57.163676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-130786e6-0c27-4eda-b1ef-609ff56e8226 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:57.168094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-130786e6-0c27-4eda-b1ef-609ff56e8226 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:57.177473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-130786e6-0c27-4eda-b1ef-609ff56e8226 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:57.178051 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-130786e6-0c27-4eda-b1ef-609ff56e8226 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:57.178644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-130786e6-0c27-4eda-b1ef-609ff56e8226 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:57.179379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-130786e6-0c27-4eda-b1ef-609ff56e8226 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:57.179831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-130786e6-0c27-4eda-b1ef-609ff56e8226 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:57.180281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-130786e6-0c27-4eda-b1ef-609ff56e8226 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:57.219304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-130786e6-0c27-4eda-b1ef-609ff56e8226 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061739 Aug 24 05:30:57.220076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1633/3151] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:30:57 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:57.499564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5aeabcde-9735-4dbb-a462-4096a254c804 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Action: 'create', calling method: .version_select at 0x7f35904eba60>, body: {"keypair": {"name": "tempest-keypair-1761409279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEoorRQNiBeCumF2K5gW43qd0rYsR/j6arUbFf/LykK3bWLdTJs/1KhIATjkRjly6VE0U4YoU6U2wVt5bj2nkT2Yweh9awDxomfbAIKrfPukwuVZ5vUVPIZ+oh6iBFXmBw=="}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:30:57.516712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-5aeabcde-9735-4dbb-a462-4096a254c804 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Getting quotas for project 721b72380f284f80a5e56aac69688224. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:30:57.520776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-5aeabcde-9735-4dbb-a462-4096a254c804 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Getting quotas for user 0549cf43ea544faba1e7a2d8fe2f6a27 and project 721b72380f284f80a5e56aac69688224. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:30:57.543370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5aeabcde-9735-4dbb-a462-4096a254c804 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.297672 Aug 24 05:30:57.544352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1519/3152] 10.222.0.97 () {62 vars in 1200 bytes} [Wed Aug 24 05:30:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 299 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 05:30:58.233215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d76e75d7-a041-42bd-90bb-a0b62efc7854 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:58.241114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d76e75d7-a041-42bd-90bb-a0b62efc7854 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:58.259416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d76e75d7-a041-42bd-90bb-a0b62efc7854 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:58.262179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d76e75d7-a041-42bd-90bb-a0b62efc7854 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:58.262959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d76e75d7-a041-42bd-90bb-a0b62efc7854 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:58.264207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d76e75d7-a041-42bd-90bb-a0b62efc7854 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:58.265512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d76e75d7-a041-42bd-90bb-a0b62efc7854 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:58.266041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d76e75d7-a041-42bd-90bb-a0b62efc7854 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:58.338479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d76e75d7-a041-42bd-90bb-a0b62efc7854 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110151 Aug 24 05:30:58.345305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1634/3153] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:30:58 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:58.789698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4dc1bba4-7902-4c60-8b54-3d1c1ab67fb1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:58.793041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4dc1bba4-7902-4c60-8b54-3d1c1ab67fb1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:58.800951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4dc1bba4-7902-4c60-8b54-3d1c1ab67fb1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:58.802331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4dc1bba4-7902-4c60-8b54-3d1c1ab67fb1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:58.803153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4dc1bba4-7902-4c60-8b54-3d1c1ab67fb1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:58.803986 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4dc1bba4-7902-4c60-8b54-3d1c1ab67fb1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:58.804555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4dc1bba4-7902-4c60-8b54-3d1c1ab67fb1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:58.805086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4dc1bba4-7902-4c60-8b54-3d1c1ab67fb1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:58.849202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4dc1bba4-7902-4c60-8b54-3d1c1ab67fb1 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063982 Aug 24 05:30:58.850302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1520/3154] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:30:58 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:58.997341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ff26ba0f-baed-4e09-bbf8-56b2689a874d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:58.997830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ff26ba0f-baed-4e09-bbf8-56b2689a874d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:59.005244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff26ba0f-baed-4e09-bbf8-56b2689a874d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:59.005970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff26ba0f-baed-4e09-bbf8-56b2689a874d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:59.006405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff26ba0f-baed-4e09-bbf8-56b2689a874d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:59.007956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff26ba0f-baed-4e09-bbf8-56b2689a874d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:59.008594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff26ba0f-baed-4e09-bbf8-56b2689a874d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:59.009112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ff26ba0f-baed-4e09-bbf8-56b2689a874d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:59.051119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ff26ba0f-baed-4e09-bbf8-56b2689a874d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments/fcbf72e0-2631-4959-88b3-9ff2f3ee86b7" status: 200 len: 194 microversion: 2.1 time: 0.057821 Aug 24 05:30:59.052367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1635/3155] 10.222.0.97 () {58 vars in 1413 bytes} [Wed Aug 24 05:30:58 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments/fcbf72e0-2631-4959-88b3-9ff2f3ee86b7 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:30:59.064733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4cbc1d43-fa8a-461a-b827-27e74c7de190 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:59.064733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4cbc1d43-fa8a-461a-b827-27e74c7de190 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:59.070858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cbc1d43-fa8a-461a-b827-27e74c7de190 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:59.071488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cbc1d43-fa8a-461a-b827-27e74c7de190 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:59.072341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cbc1d43-fa8a-461a-b827-27e74c7de190 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:59.073299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cbc1d43-fa8a-461a-b827-27e74c7de190 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:59.073988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cbc1d43-fa8a-461a-b827-27e74c7de190 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:59.074510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4cbc1d43-fa8a-461a-b827-27e74c7de190 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:59.176057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-4cbc1d43-fa8a-461a-b827-27e74c7de190 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lazy-loading 'services' on Instance uuid 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:30:59.179608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:30:59.286311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4cbc1d43-fa8a-461a-b827-27e74c7de190 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "DELETE /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments/fcbf72e0-2631-4959-88b3-9ff2f3ee86b7" status: 202 len: 0 microversion: 2.1 time: 0.227185 Aug 24 05:30:59.294603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1521/3156] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:30:59 2022] DELETE /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments/fcbf72e0-2631-4959-88b3-9ff2f3ee86b7 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:30:59.356003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c1e5286d-2ed1-4514-bfc2-8f6e575638de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:30:59.359981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c1e5286d-2ed1-4514-bfc2-8f6e575638de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:30:59.386836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e5286d-2ed1-4514-bfc2-8f6e575638de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:59.387671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e5286d-2ed1-4514-bfc2-8f6e575638de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:59.388119 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e5286d-2ed1-4514-bfc2-8f6e575638de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:59.388822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e5286d-2ed1-4514-bfc2-8f6e575638de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:30:59.389273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e5286d-2ed1-4514-bfc2-8f6e575638de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:30:59.389700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1e5286d-2ed1-4514-bfc2-8f6e575638de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:30:59.467352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c1e5286d-2ed1-4514-bfc2-8f6e575638de tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117233 Aug 24 05:30:59.468228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1636/3157] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:30:59 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:30:59.884143 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1886577055", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd1b9fe7-5c01-40a1-bd69-d32f9fba19ee"}], "security_groups": [{"name": "tempest-securitygroup--1489492658"}], "key_name": "tempest-keypair-1761409279", "user_data": "}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:00.021367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] validate_networks() for [('cd1b9fe7-5c01-40a1-bd69-d32f9fba19ee', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:31:00.480753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-037bdad7-9e90-40f2-83aa-d053e7a2c153 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:00.483025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-037bdad7-9e90-40f2-83aa-d053e7a2c153 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:00.496261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037bdad7-9e90-40f2-83aa-d053e7a2c153 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:00.496748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037bdad7-9e90-40f2-83aa-d053e7a2c153 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:00.497179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037bdad7-9e90-40f2-83aa-d053e7a2c153 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:00.497869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037bdad7-9e90-40f2-83aa-d053e7a2c153 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:00.498314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037bdad7-9e90-40f2-83aa-d053e7a2c153 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:00.506863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-037bdad7-9e90-40f2-83aa-d053e7a2c153 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:00.561992 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-037bdad7-9e90-40f2-83aa-d053e7a2c153 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.085167 Aug 24 05:31:00.572169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1637/3158] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:31:00 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 24 05:31:00.593491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:31:00.593977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:31:00.594407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:31:00.600140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:31:00.600811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:31:00.615763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:00.616543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:00.617136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:00.618778 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:00.619415 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:00.620667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:00.656576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:31:00.656830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:31:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c (ip 10.222.0.97) !!! Aug 24 05:31:00.662824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0580134c-6e3f-4d6c-890d-dbe792f0aa92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:00.664438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0580134c-6e3f-4d6c-890d-dbe792f0aa92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:00.677806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0580134c-6e3f-4d6c-890d-dbe792f0aa92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:00.678305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0580134c-6e3f-4d6c-890d-dbe792f0aa92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:00.684362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0580134c-6e3f-4d6c-890d-dbe792f0aa92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:00.685350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0580134c-6e3f-4d6c-890d-dbe792f0aa92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:00.685832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0580134c-6e3f-4d6c-890d-dbe792f0aa92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:00.686266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0580134c-6e3f-4d6c-890d-dbe792f0aa92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:00.699005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Getting quotas for project 721b72380f284f80a5e56aac69688224. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:31:00.717116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Getting quotas for user 0549cf43ea544faba1e7a2d8fe2f6a27 and project 721b72380f284f80a5e56aac69688224. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:31:00.722885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0580134c-6e3f-4d6c-890d-dbe792f0aa92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Going to try to terminate instance {{(pid=120558) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:31:00.747345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:31:00.749855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:31:00.834912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-59068e3e-cb05-48c9-a22c-17c93cdb7284 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.959270 Aug 24 05:31:00.836472 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1522/3159] 10.222.0.97 () {62 vars in 1188 bytes} [Wed Aug 24 05:30:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 24 05:31:00.849004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b0efebf8-87fa-4685-91a4-27c44cef89a9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:00.861861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b0efebf8-87fa-4685-91a4-27c44cef89a9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:00.883210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0580134c-6e3f-4d6c-890d-dbe792f0aa92 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 204 len: 0 microversion: 2.1 time: 0.226742 Aug 24 05:31:00.884349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1638/3160] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:31:00 2022] DELETE /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:31:00.920928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-96f1d428-8c42-4acb-b4d3-88165f26b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:00.924256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-96f1d428-8c42-4acb-b4d3-88165f26b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:00.943117 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-96f1d428-8c42-4acb-b4d3-88165f26b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:00.944542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-96f1d428-8c42-4acb-b4d3-88165f26b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:00.945274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-96f1d428-8c42-4acb-b4d3-88165f26b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:00.948123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-96f1d428-8c42-4acb-b4d3-88165f26b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:00.951327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-96f1d428-8c42-4acb-b4d3-88165f26b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:00.953155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-96f1d428-8c42-4acb-b4d3-88165f26b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:00.988300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b0efebf8-87fa-4685-91a4-27c44cef89a9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:01.003453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b0efebf8-87fa-4685-91a4-27c44cef89a9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:01.007644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b0efebf8-87fa-4685-91a4-27c44cef89a9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:01.010764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b0efebf8-87fa-4685-91a4-27c44cef89a9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1282 microversion: 2.20 time: 0.166625 Aug 24 05:31:01.012271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1523/3161] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:00 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:31:01.317319 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-96f1d428-8c42-4acb-b4d3-88165f26b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:01.328178 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-96f1d428-8c42-4acb-b4d3-88165f26b4af tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1681 microversion: 2.1 time: 0.429838 Aug 24 05:31:01.328717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1639/3162] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:00 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1681 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:01.571564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cd91ce18-faf0-4b5f-ba04-67036ad673a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:01.572328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cd91ce18-faf0-4b5f-ba04-67036ad673a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:01.581727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd91ce18-faf0-4b5f-ba04-67036ad673a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:01.582538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd91ce18-faf0-4b5f-ba04-67036ad673a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:01.583181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd91ce18-faf0-4b5f-ba04-67036ad673a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:01.584227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd91ce18-faf0-4b5f-ba04-67036ad673a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:01.584686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd91ce18-faf0-4b5f-ba04-67036ad673a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:01.585110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cd91ce18-faf0-4b5f-ba04-67036ad673a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:01.617419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cd91ce18-faf0-4b5f-ba04-67036ad673a7 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments/931a0921-bab4-4816-84ab-9cdb50bbb622" status: 200 len: 194 microversion: 2.1 time: 0.050213 Aug 24 05:31:01.618465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1524/3163] 10.222.0.97 () {58 vars in 1413 bytes} [Wed Aug 24 05:31:01 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments/931a0921-bab4-4816-84ab-9cdb50bbb622 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:01.643284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-89764019-9a0b-474f-b739-09c07df61cfb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:01.644392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-89764019-9a0b-474f-b739-09c07df61cfb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:01.653001 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89764019-9a0b-474f-b739-09c07df61cfb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:01.655755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89764019-9a0b-474f-b739-09c07df61cfb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:01.659218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89764019-9a0b-474f-b739-09c07df61cfb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:01.660566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89764019-9a0b-474f-b739-09c07df61cfb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:01.662545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89764019-9a0b-474f-b739-09c07df61cfb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:01.663210 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-89764019-9a0b-474f-b739-09c07df61cfb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:01.863458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-89764019-9a0b-474f-b739-09c07df61cfb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lazy-loading 'services' on Instance uuid 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:31:01.981506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-89764019-9a0b-474f-b739-09c07df61cfb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "DELETE /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments/931a0921-bab4-4816-84ab-9cdb50bbb622" status: 202 len: 0 microversion: 2.1 time: 0.356464 Aug 24 05:31:01.982857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1640/3164] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:31:01 2022] DELETE /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments/931a0921-bab4-4816-84ab-9cdb50bbb622 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:31:02.037386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:02.038478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:02.053253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:02.054162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:02.055176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:02.056811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:02.057724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:02.058330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:02.184131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:02.206465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:02.216145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:02.222396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4fa14073-0778-4adf-be45-63becf26236d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1286 microversion: 2.20 time: 0.186677 Aug 24 05:31:02.223983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1525/3165] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:02 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1286 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:02.355023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fc9bbcde-6f2c-4252-8d50-b14a66992f9d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:02.356898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fc9bbcde-6f2c-4252-8d50-b14a66992f9d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:02.374215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc9bbcde-6f2c-4252-8d50-b14a66992f9d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:02.379085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc9bbcde-6f2c-4252-8d50-b14a66992f9d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:02.386095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc9bbcde-6f2c-4252-8d50-b14a66992f9d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:02.388285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc9bbcde-6f2c-4252-8d50-b14a66992f9d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:02.388788 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc9bbcde-6f2c-4252-8d50-b14a66992f9d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:02.389232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fc9bbcde-6f2c-4252-8d50-b14a66992f9d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:02.621071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fc9bbcde-6f2c-4252-8d50-b14a66992f9d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:02.638273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fc9bbcde-6f2c-4252-8d50-b14a66992f9d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1681 microversion: 2.1 time: 0.289071 Aug 24 05:31:02.640961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1641/3166] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:02 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1681 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:03.258807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:03.259511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:03.276627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:03.277369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:03.277810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:03.279516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:03.279974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:03.280625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:03.375347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:03.397787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:03.399803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:03.400945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b21a1df3-e85a-462b-bf2a-94926b0f1689 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1334 microversion: 2.20 time: 0.149685 Aug 24 05:31:03.402002 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1526/3167] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:03 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1334 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:03.666764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-58d36e26-e1c5-4656-a237-d458513639a0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:03.667464 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-58d36e26-e1c5-4656-a237-d458513639a0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:03.681551 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58d36e26-e1c5-4656-a237-d458513639a0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:03.682532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58d36e26-e1c5-4656-a237-d458513639a0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:03.683581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58d36e26-e1c5-4656-a237-d458513639a0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:03.685140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58d36e26-e1c5-4656-a237-d458513639a0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:03.690774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58d36e26-e1c5-4656-a237-d458513639a0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:03.691485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58d36e26-e1c5-4656-a237-d458513639a0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:03.940569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-58d36e26-e1c5-4656-a237-d458513639a0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:03.955970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-58d36e26-e1c5-4656-a237-d458513639a0 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1681 microversion: 2.1 time: 0.294637 Aug 24 05:31:03.958128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1642/3168] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:03 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1681 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:04.403737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fb6ed96f-87a9-475c-8d12-910dbfe1d309 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:04.406117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fb6ed96f-87a9-475c-8d12-910dbfe1d309 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:04.412972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6ed96f-87a9-475c-8d12-910dbfe1d309 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.413750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6ed96f-87a9-475c-8d12-910dbfe1d309 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.414368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6ed96f-87a9-475c-8d12-910dbfe1d309 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.415332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6ed96f-87a9-475c-8d12-910dbfe1d309 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.415953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6ed96f-87a9-475c-8d12-910dbfe1d309 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.416565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fb6ed96f-87a9-475c-8d12-910dbfe1d309 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.425308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:04.426330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:04.439229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.440676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.441365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.442263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.443611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.445706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.474765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fb6ed96f-87a9-475c-8d12-910dbfe1d309 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082803 Aug 24 05:31:04.475649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1527/3169] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:31:04 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:31:04.566334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:04.578232 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:04.583662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:04.588267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4a994095-900a-4fb6-8a2d-92a40793091f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1340 microversion: 2.20 time: 0.166677 Aug 24 05:31:04.589811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1643/3170] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:04 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1340 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:31:04.623776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-143957a3-5f01-43fe-b8a0-7c9eb6377c8d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:04.626013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-143957a3-5f01-43fe-b8a0-7c9eb6377c8d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:04.633118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-143957a3-5f01-43fe-b8a0-7c9eb6377c8d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.633911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-143957a3-5f01-43fe-b8a0-7c9eb6377c8d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.634538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-143957a3-5f01-43fe-b8a0-7c9eb6377c8d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.635458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-143957a3-5f01-43fe-b8a0-7c9eb6377c8d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.637023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-143957a3-5f01-43fe-b8a0-7c9eb6377c8d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.637652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-143957a3-5f01-43fe-b8a0-7c9eb6377c8d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.672890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-143957a3-5f01-43fe-b8a0-7c9eb6377c8d tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053031 Aug 24 05:31:04.686814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1528/3171] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:31:04 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:31:04.754775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-728ac1e2-33c1-4217-94eb-a87fcfdf7c9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:04.754775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-728ac1e2-33c1-4217-94eb-a87fcfdf7c9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:04.761591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728ac1e2-33c1-4217-94eb-a87fcfdf7c9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.762076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728ac1e2-33c1-4217-94eb-a87fcfdf7c9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.762512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728ac1e2-33c1-4217-94eb-a87fcfdf7c9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.763261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728ac1e2-33c1-4217-94eb-a87fcfdf7c9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.763868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728ac1e2-33c1-4217-94eb-a87fcfdf7c9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.764843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-728ac1e2-33c1-4217-94eb-a87fcfdf7c9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.796782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-728ac1e2-33c1-4217-94eb-a87fcfdf7c9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Going to try to terminate instance {{(pid=120558) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:31:04.853183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:04.900322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-728ac1e2-33c1-4217-94eb-a87fcfdf7c9e tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "DELETE /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 204 len: 0 microversion: 2.1 time: 0.150767 Aug 24 05:31:04.900997 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1644/3172] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:31:04 2022] DELETE /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:31:04.911242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f3301fad-fa5e-4774-a336-93a4fa77654b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:04.912422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f3301fad-fa5e-4774-a336-93a4fa77654b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:04.924050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3301fad-fa5e-4774-a336-93a4fa77654b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.926028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3301fad-fa5e-4774-a336-93a4fa77654b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.926488 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3301fad-fa5e-4774-a336-93a4fa77654b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.927575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3301fad-fa5e-4774-a336-93a4fa77654b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.927815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3301fad-fa5e-4774-a336-93a4fa77654b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.928242 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f3301fad-fa5e-4774-a336-93a4fa77654b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.979174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-df03801c-2f0d-40a4-89ec-5897c11efc78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:04.979880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-df03801c-2f0d-40a4-89ec-5897c11efc78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:04.985934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df03801c-2f0d-40a4-89ec-5897c11efc78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.987236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df03801c-2f0d-40a4-89ec-5897c11efc78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.987501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df03801c-2f0d-40a4-89ec-5897c11efc78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:04.988204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df03801c-2f0d-40a4-89ec-5897c11efc78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:04.988654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df03801c-2f0d-40a4-89ec-5897c11efc78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:04.989073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-df03801c-2f0d-40a4-89ec-5897c11efc78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:05.133863 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-df03801c-2f0d-40a4-89ec-5897c11efc78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:05.146279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-df03801c-2f0d-40a4-89ec-5897c11efc78 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1681 microversion: 2.1 time: 0.171487 Aug 24 05:31:05.147203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1645/3173] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:04 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:31:05.383880 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f3301fad-fa5e-4774-a336-93a4fa77654b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:05.395043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f3301fad-fa5e-4774-a336-93a4fa77654b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1675 microversion: 2.1 time: 0.487198 Aug 24 05:31:05.395043 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1529/3174] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:04 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1675 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:31:05.618886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:05.619585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:05.641176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:05.641883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:05.643164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:05.644368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:05.647231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:05.647231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:05.854031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:05.871378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:05.876562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:05.880892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f0530827-3cfb-427b-85df-43190d925af7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1340 microversion: 2.20 time: 0.269492 Aug 24 05:31:05.881483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1646/3175] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:05 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1340 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:05.958745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-a6051a2f-90ee-43a4-8696-8b2c13da2efc req-93cfa582-36dc-47c6-a144-4f8cc521f5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "455aaf6b-38bd-45d3-9fe4-6c3b25f0751c", "name": "network-vif-deleted", "tag": "e197b6e5-a95b-4e87-8f42-63627a372213"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:05.998267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-a6051a2f-90ee-43a4-8696-8b2c13da2efc req-93cfa582-36dc-47c6-a144-4f8cc521f5a0 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:05.999049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-a6051a2f-90ee-43a4-8696-8b2c13da2efc req-93cfa582-36dc-47c6-a144-4f8cc521f5a0 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:05.999947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-a6051a2f-90ee-43a4-8696-8b2c13da2efc req-93cfa582-36dc-47c6-a144-4f8cc521f5a0 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:06.032287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-a6051a2f-90ee-43a4-8696-8b2c13da2efc req-93cfa582-36dc-47c6-a144-4f8cc521f5a0 service nova] Creating event network-vif-deleted:e197b6e5-a95b-4e87-8f42-63627a372213 for instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c on hv-cinder-85426 Aug 24 05:31:06.039883 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-a6051a2f-90ee-43a4-8696-8b2c13da2efc req-93cfa582-36dc-47c6-a144-4f8cc521f5a0 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088398 Aug 24 05:31:06.044512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1530/3176] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:06.172892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-958871c7-c0ea-4e1a-b6db-8485f8a084e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:06.173499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-958871c7-c0ea-4e1a-b6db-8485f8a084e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:06.177398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=3 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:06.190537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-958871c7-c0ea-4e1a-b6db-8485f8a084e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:06.192321 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-958871c7-c0ea-4e1a-b6db-8485f8a084e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:06.192801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-958871c7-c0ea-4e1a-b6db-8485f8a084e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:06.194145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-958871c7-c0ea-4e1a-b6db-8485f8a084e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:06.196916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-958871c7-c0ea-4e1a-b6db-8485f8a084e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:06.197361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-958871c7-c0ea-4e1a-b6db-8485f8a084e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:06.295329 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-958871c7-c0ea-4e1a-b6db-8485f8a084e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:06.304539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-958871c7-c0ea-4e1a-b6db-8485f8a084e1 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1613 microversion: 2.1 time: 0.138970 Aug 24 05:31:06.319293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1647/3177] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:06 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1613 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:06.418831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3c65ae7e-29e3-422e-b256-e87c552aa2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:06.419711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3c65ae7e-29e3-422e-b256-e87c552aa2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:06.441337 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c65ae7e-29e3-422e-b256-e87c552aa2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:06.442165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c65ae7e-29e3-422e-b256-e87c552aa2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:06.444791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c65ae7e-29e3-422e-b256-e87c552aa2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:06.448920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c65ae7e-29e3-422e-b256-e87c552aa2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:06.449649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c65ae7e-29e3-422e-b256-e87c552aa2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:06.450912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c65ae7e-29e3-422e-b256-e87c552aa2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:06.745157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c65ae7e-29e3-422e-b256-e87c552aa2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:06.762518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3c65ae7e-29e3-422e-b256-e87c552aa2da tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1675 microversion: 2.1 time: 0.349420 Aug 24 05:31:06.780531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1531/3178] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:06 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1675 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:06.909078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:06.910060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:06.921756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:06.923407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:06.929775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:06.930830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:06.931475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:06.932072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:07.239123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:07.250300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:07.255480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:07.258245 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d0d8a6ee-77be-4f10-a98b-10e6585127a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1408 microversion: 2.20 time: 0.354946 Aug 24 05:31:07.259708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1648/3179] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:06 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1408 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:07.327948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:07.329383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:07.338317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:07.340197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:07.340947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:07.348477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:07.350964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:07.352402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:07.353237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:07.453847 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:07.459157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:07.460589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:07.460589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'fault' on Instance uuid 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:31:07.583513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:07.594304 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b2b49916-9041-45f5-8b8c-19d660085622 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 200 len: 1332 microversion: 2.1 time: 0.269935 Aug 24 05:31:07.610680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1532/3180] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:07 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 1332 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:07.787097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9eb16594-86c9-4205-8aeb-e2ed1bcde3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:07.788145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9eb16594-86c9-4205-8aeb-e2ed1bcde3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:07.806194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9eb16594-86c9-4205-8aeb-e2ed1bcde3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:07.806794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9eb16594-86c9-4205-8aeb-e2ed1bcde3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:07.807153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9eb16594-86c9-4205-8aeb-e2ed1bcde3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:07.809493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9eb16594-86c9-4205-8aeb-e2ed1bcde3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:07.811345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9eb16594-86c9-4205-8aeb-e2ed1bcde3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:07.811789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9eb16594-86c9-4205-8aeb-e2ed1bcde3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:08.089245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-a68e1ed5-3a16-4b6f-ac1f-eb79886c84dd req-d2b5a223-ad4a-459b-952f-b1d5a486db4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "342b0ec6-3c25-4b72-bcb1-88878f3d85e8", "tag": "e783a71b-b500-4cdb-96c0-ecd825b2a9c5"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:08.105082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-a68e1ed5-3a16-4b6f-ac1f-eb79886c84dd req-d2b5a223-ad4a-459b-952f-b1d5a486db4d service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:08.108099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-a68e1ed5-3a16-4b6f-ac1f-eb79886c84dd req-d2b5a223-ad4a-459b-952f-b1d5a486db4d service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:08.108642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-a68e1ed5-3a16-4b6f-ac1f-eb79886c84dd req-d2b5a223-ad4a-459b-952f-b1d5a486db4d service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:08.137235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-a68e1ed5-3a16-4b6f-ac1f-eb79886c84dd req-d2b5a223-ad4a-459b-952f-b1d5a486db4d service nova] Creating event network-changed:e783a71b-b500-4cdb-96c0-ecd825b2a9c5 for instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 on hv-cinder-85426 Aug 24 05:31:08.149755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-a68e1ed5-3a16-4b6f-ac1f-eb79886c84dd req-d2b5a223-ad4a-459b-952f-b1d5a486db4d service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062758 Aug 24 05:31:08.151097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1533/3181] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:31:08.174524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9eb16594-86c9-4205-8aeb-e2ed1bcde3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:08.192444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9eb16594-86c9-4205-8aeb-e2ed1bcde3ff tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1675 microversion: 2.1 time: 0.409959 Aug 24 05:31:08.193283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1649/3182] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:07 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1675 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:08.286759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:08.287470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:08.298428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:08.300343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:08.301159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:08.302140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:08.302878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:08.303552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:08.630360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:08.630854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:08.644221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:08.644766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:08.645271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:08.646039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:08.646710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:08.647143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:08.672578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:31:08.673690 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c HTTP/1.1 Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:31:08.680260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:31:08.681885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '455aaf6b-38bd-45d3-9fe4-6c3b25f0751c'} Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:31:08.683177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:31:08.686785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:08.690126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:31:08.690126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3ec8a819-101a-4f5f-9dff-4ff91d0a7047 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 404 len: 111 microversion: 2.1 time: 0.056274 Aug 24 05:31:08.691776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1650/3183] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:08 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:31:08.695022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:08.695409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0ee93ff1-be64-40d8-a9cc-bb623f4a4f60 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '.version_select at 0x7f359020a820>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:08.696804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:08.697968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0572249d-e0ee-4694-857e-4467303c77bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1408 microversion: 2.20 time: 0.416277 Aug 24 05:31:08.702257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1534/3184] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:08 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1408 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:08.748359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:31:08.748517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:31:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-keypair-1234920889 (ip 10.222.0.97) !!! Aug 24 05:31:08.779000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0ee93ff1-be64-40d8-a9cc-bb623f4a4f60 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234920889" status: 202 len: 0 microversion: 2.1 time: 0.087152 Aug 24 05:31:08.780028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1651/3185] 10.222.0.97 () {58 vars in 1221 bytes} [Wed Aug 24 05:31:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234920889 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:31:09.219540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-159c6302-4161-4d1f-b0d4-1daa7f3132cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:09.220426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-159c6302-4161-4d1f-b0d4-1daa7f3132cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:09.230048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159c6302-4161-4d1f-b0d4-1daa7f3132cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:09.230549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159c6302-4161-4d1f-b0d4-1daa7f3132cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:09.231014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159c6302-4161-4d1f-b0d4-1daa7f3132cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:09.231716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159c6302-4161-4d1f-b0d4-1daa7f3132cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:09.232164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159c6302-4161-4d1f-b0d4-1daa7f3132cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:09.232589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-159c6302-4161-4d1f-b0d4-1daa7f3132cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:09.361785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-159c6302-4161-4d1f-b0d4-1daa7f3132cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:09.370329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-159c6302-4161-4d1f-b0d4-1daa7f3132cb tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1607 microversion: 2.1 time: 0.154550 Aug 24 05:31:09.372522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1535/3186] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:09 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1607 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:09.728567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:09.730128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:09.747458 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:09.748405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:09.749111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:09.750527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:09.751298 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:09.753124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:10.009802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:10.021872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:10.025520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:10.027434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b92c964d-ad95-4f5a-abab-83cefcf3064e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1408 microversion: 2.20 time: 0.306038 Aug 24 05:31:10.028213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1652/3187] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:09 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:10.324971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-35d22ecc-90f9-49bc-ba1e-b62376cf3ab4 req-d5afbb4a-a8ec-4b8e-8c33-921c6fd2964f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "448db0f9-77b5-46a7-8c7e-98cddd6a0ec5", "name": "network-vif-deleted", "tag": "cf1cd12d-535b-4621-b475-9fd55f8e8acf"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:10.349626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-35d22ecc-90f9-49bc-ba1e-b62376cf3ab4 req-d5afbb4a-a8ec-4b8e-8c33-921c6fd2964f service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:10.350107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-35d22ecc-90f9-49bc-ba1e-b62376cf3ab4 req-d5afbb4a-a8ec-4b8e-8c33-921c6fd2964f service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:10.350543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-35d22ecc-90f9-49bc-ba1e-b62376cf3ab4 req-d5afbb4a-a8ec-4b8e-8c33-921c6fd2964f service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:10.387205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-35d22ecc-90f9-49bc-ba1e-b62376cf3ab4 req-d5afbb4a-a8ec-4b8e-8c33-921c6fd2964f service nova] Creating event network-vif-deleted:cf1cd12d-535b-4621-b475-9fd55f8e8acf for instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 on hv-cinder-85426 Aug 24 05:31:10.393469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d3ba0de5-b3d4-44f2-803a-f0c40f4999ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:10.394090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d3ba0de5-b3d4-44f2-803a-f0c40f4999ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:10.405466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3ba0de5-b3d4-44f2-803a-f0c40f4999ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:10.406238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3ba0de5-b3d4-44f2-803a-f0c40f4999ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:10.409091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3ba0de5-b3d4-44f2-803a-f0c40f4999ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:10.409985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3ba0de5-b3d4-44f2-803a-f0c40f4999ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:10.416337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3ba0de5-b3d4-44f2-803a-f0c40f4999ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:10.417136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d3ba0de5-b3d4-44f2-803a-f0c40f4999ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:10.419170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-35d22ecc-90f9-49bc-ba1e-b62376cf3ab4 req-d5afbb4a-a8ec-4b8e-8c33-921c6fd2964f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094936 Aug 24 05:31:10.424779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1536/3188] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:31:10.464946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-14d95fa7-6d4c-4a75-8986-d032e8e8f04a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: .version_select at 0x7f359030aca0>, body: {"keypair": {"name": "tempest-keypair-261288509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ3B4rfpP+jx6JAyYhsLMDe9S48C4G+OxeLNnl3Xycf5dstFcMHmTjtA1u75sB57YbpIRp5HmEYRTCX0cRuI2eciYbSpMBbugkuPrP9KQ+Pz9/MwwIa1qODaHQAD2yGc3A=="}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:10.491654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-14d95fa7-6d4c-4a75-8986-d032e8e8f04a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:31:10.498120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-14d95fa7-6d4c-4a75-8986-d032e8e8f04a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for user 4bc6971289b943aebec90909ffb8096a and project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:31:10.534038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-14d95fa7-6d4c-4a75-8986-d032e8e8f04a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073527 Aug 24 05:31:10.535257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1537/3189] 10.222.0.97 () {60 vars in 1159 bytes} [Wed Aug 24 05:31:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:10.744049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d3ba0de5-b3d4-44f2-803a-f0c40f4999ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c6fb51f911e40338628bd734299c0d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2394a6093e241469dd0900c8efad29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:10.757167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d3ba0de5-b3d4-44f2-803a-f0c40f4999ad tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 200 len: 1607 microversion: 2.1 time: 0.367540 Aug 24 05:31:10.757760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1653/3190] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:10 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 1607 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:31:11.055633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:11.056712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:11.066807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:11.073593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:11.087607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:11.087990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:11.089786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:11.091266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:11.095135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:11.682021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:11.701596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:11.708380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:11.711151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b58fe2ae-1d93-4b26-9958-6c86638ff815 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1408 microversion: 2.20 time: 0.660159 Aug 24 05:31:11.712826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1538/3191] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:11 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1408 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:11.778671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:11.780152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:11.789577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:11.790656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:11.791372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:11.792278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:11.792933 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:11.793664 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:11.810561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] HTTP exception thrown: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Request method failure captured: Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 HTTP/1.1 Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76K6tTKXFohuuiO2EKYttHDRC8Xf9uncFLHsa0picGs8ZtJlIo1Lq1TniLEifuHi7Rt6tcpwyI2KTAKeRZy32uXuWe6bediFw5Ws4ntNLXRZy6WJThzAxiX-WYxtQGtHSUdg9h0abv0ZcsxV6au86cPER1xy2hqoCsRpIHmqTJeh4 Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: c2394a6093e241469dd0900c8efad29c Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:31:11.812436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_c2394a6093e241469dd0900c8efad29c", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: c2394a6093e241469dd0900c8efad29c Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeTestJSON-1059081725-project Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 5c6fb51f911e40338628bd734299c0d0 Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeTestJSON-1059081725-project Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:11.814954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '448db0f9-77b5-46a7-8c7e-98cddd6a0ec5'} Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:31:11.815891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:11.817587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:11.825600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Returning 404 to user: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:31:11.826751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0192d98c-9516-4c92-b730-d7c149bdc21b tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 404 len: 111 microversion: 2.1 time: 0.052128 Aug 24 05:31:11.828854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1654/3192] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:11 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:31:11.838124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1ea2a591-b130-43f2-a9e0-60254e351491 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '.version_select at 0x7f359062c790>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:11.891380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1ea2a591-b130-43f2-a9e0-60254e351491 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704441748" status: 202 len: 0 microversion: 2.1 time: 0.057314 Aug 24 05:31:11.898569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1539/3193] 10.222.0.97 () {58 vars in 1221 bytes} [Wed Aug 24 05:31:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1704441748 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:31:12.740461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:12.741479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:12.754258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:12.755038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:12.755739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:12.756848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:12.757617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:12.758209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:12.933410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:12.947983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:12.952124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:12.954357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-839a7cb9-785d-4ab0-a499-c768ff5af445 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1408 microversion: 2.20 time: 0.223478 Aug 24 05:31:12.957112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1655/3194] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:12 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1408 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:13.230550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1369383309", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b192333e-49cd-4bbd-809a-5981852bd697"}], "security_groups": [{"name": "tempest-securitygroup--1354956398"}], "key_name": "tempest-keypair-261288509", "user_data": "}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:13.448934 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] validate_networks() for [('b192333e-49cd-4bbd-809a-5981852bd697', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:31:13.916481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:31:13.917185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:31:13.918000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:31:13.918714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:31:13.919433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:31:13.933531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:13.934114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:13.934739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:13.935553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:13.936235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:13.936700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:13.955748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:31:13.959782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Getting quotas for user 4bc6971289b943aebec90909ffb8096a and project 42f2c35fc0e4453eba1a25d2b6311bc5. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:31:13.974092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:31:13.977442 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:31:13.979279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:13.979882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:13.989270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:13.989745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:13.990171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:13.990883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:13.991539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:13.995462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:14.038282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-242389c5-2797-467c-8ea4-4b634d519fd8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.812732 Aug 24 05:31:14.045171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1540/3195] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 05:31:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:31:14.055066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-af875889-55ff-4a7e-acde-e9588a17d408 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:14.056080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-af875889-55ff-4a7e-acde-e9588a17d408 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:14.129235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-af875889-55ff-4a7e-acde-e9588a17d408 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:14.138976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-af875889-55ff-4a7e-acde-e9588a17d408 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1241 microversion: 2.1 time: 0.090202 Aug 24 05:31:14.156240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1541/3196] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:14 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:14.207170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:14.222332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:14.227152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:14.228577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4fa5ab42-e411-4701-b08f-b481146cdf4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1408 microversion: 2.20 time: 0.254589 Aug 24 05:31:14.239003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1656/3197] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:13 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1408 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:14.376421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-ee6c0e4d-f42e-4f2f-bcdb-1b8a5d675ecf req-61c77153-e330-41f4-9970-7cc5c36ebeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342b0ec6-3c25-4b72-bcb1-88878f3d85e8", "name": "network-vif-plugged", "status": "completed", "tag": "e783a71b-b500-4cdb-96c0-ecd825b2a9c5"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:14.392058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-ee6c0e4d-f42e-4f2f-bcdb-1b8a5d675ecf req-61c77153-e330-41f4-9970-7cc5c36ebeb1 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:14.393626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-ee6c0e4d-f42e-4f2f-bcdb-1b8a5d675ecf req-61c77153-e330-41f4-9970-7cc5c36ebeb1 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:14.394368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-ee6c0e4d-f42e-4f2f-bcdb-1b8a5d675ecf req-61c77153-e330-41f4-9970-7cc5c36ebeb1 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:14.413569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-ee6c0e4d-f42e-4f2f-bcdb-1b8a5d675ecf req-61c77153-e330-41f4-9970-7cc5c36ebeb1 service nova] Creating event network-vif-plugged:e783a71b-b500-4cdb-96c0-ecd825b2a9c5 for instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 on hv-cinder-85426 Aug 24 05:31:14.419532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-ee6c0e4d-f42e-4f2f-bcdb-1b8a5d675ecf req-61c77153-e330-41f4-9970-7cc5c36ebeb1 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047072 Aug 24 05:31:14.420819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1542/3198] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:15.174514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-62d8bf3f-d88c-44b8-9413-bb578e95abed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:15.176214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-62d8bf3f-d88c-44b8-9413-bb578e95abed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:15.184601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62d8bf3f-d88c-44b8-9413-bb578e95abed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.185161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62d8bf3f-d88c-44b8-9413-bb578e95abed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.185755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62d8bf3f-d88c-44b8-9413-bb578e95abed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.186709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62d8bf3f-d88c-44b8-9413-bb578e95abed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.187751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62d8bf3f-d88c-44b8-9413-bb578e95abed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.188703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-62d8bf3f-d88c-44b8-9413-bb578e95abed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.255484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:15.256285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:15.276973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.277471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.277910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.279871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.280346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.283729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.286914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-62d8bf3f-d88c-44b8-9413-bb578e95abed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:15.303643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-62d8bf3f-d88c-44b8-9413-bb578e95abed tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1245 microversion: 2.1 time: 0.147042 Aug 24 05:31:15.319177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1657/3199] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:15 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1245 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:15.490926 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:15.499794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:15.501232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:15.502981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e37c4e0d-abdf-4322-9f70-14bae30394e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1408 microversion: 2.20 time: 0.252619 Aug 24 05:31:15.503772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1543/3200] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:15 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1408 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:31:15.737627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:15.737783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:15.757341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.757832 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.758269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.759314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.759766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.760192 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.775916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] HTTP exception thrown: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Request method failure captured: Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 HTTP/1.1 Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76K6tTKXFohuuiO2EKYttHDRC8Xf9uncFLHsa0picGs8ZtJlIo1Lq1TniLEifuHi7Rt6tcpwyI2KTAKeRZy32uXuWe6bediFw5Ws4ntNLXRZy6WJThzAxiX-WYxtQGtHSUdg9h0abv0ZcsxV6au86cPER1xy2hqoCsRpIHmqTJeh4 Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: c2394a6093e241469dd0900c8efad29c Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:31:15.777608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_c2394a6093e241469dd0900c8efad29c", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: c2394a6093e241469dd0900c8efad29c Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeTestJSON-1059081725-project Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 5c6fb51f911e40338628bd734299c0d0 Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeTestJSON-1059081725-project Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:15.779520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '448db0f9-77b5-46a7-8c7e-98cddd6a0ec5'} Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:31:15.780421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:15.781903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:15.785691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Returning 404 to user: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:31:15.786806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2b8e9ccc-d4db-4389-a6e5-1eaa1892fb7a tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "DELETE /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 404 len: 111 microversion: 2.1 time: 0.059338 Aug 24 05:31:15.796542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:15.798487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:15.806944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1658/3201] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:31:15 2022] DELETE /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:31:15.810987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.811757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.812434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.813366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:15.814061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:15.815014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:15.834420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] HTTP exception thrown: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Request method failure captured: Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 HTTP/1.1 Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76K6tTKXFohuuiO2EKYttHDRC8Xf9uncFLHsa0picGs8ZtJlIo1Lq1TniLEifuHi7Rt6tcpwyI2KTAKeRZy32uXuWe6bediFw5Ws4ntNLXRZy6WJThzAxiX-WYxtQGtHSUdg9h0abv0ZcsxV6au86cPER1xy2hqoCsRpIHmqTJeh4 Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: c2394a6093e241469dd0900c8efad29c Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:31:15.837548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_c2394a6093e241469dd0900c8efad29c", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: c2394a6093e241469dd0900c8efad29c Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeTestJSON-1059081725-project Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 5c6fb51f911e40338628bd734299c0d0 Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeTestJSON-1059081725-project Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:15.839247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '448db0f9-77b5-46a7-8c7e-98cddd6a0ec5'} Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:31:15.840125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. Aug 24 05:31:15.841577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:31:15.846079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Returning 404 to user: Instance 448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:31:15.848860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-059608d8-0c98-4ecf-82e3-d98a932d9931 tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5" status: 404 len: 111 microversion: 2.1 time: 0.055972 Aug 24 05:31:15.852834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1544/3202] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:15 2022] GET /compute/v2.1/servers/448db0f9-77b5-46a7-8c7e-98cddd6a0ec5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:31:16.328041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9777ff37-64fb-4d63-aacd-542b7f6b510c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:16.329070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9777ff37-64fb-4d63-aacd-542b7f6b510c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:16.336514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9777ff37-64fb-4d63-aacd-542b7f6b510c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:16.337129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9777ff37-64fb-4d63-aacd-542b7f6b510c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:16.337839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9777ff37-64fb-4d63-aacd-542b7f6b510c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:16.338972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9777ff37-64fb-4d63-aacd-542b7f6b510c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:16.339670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9777ff37-64fb-4d63-aacd-542b7f6b510c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:16.340346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9777ff37-64fb-4d63-aacd-542b7f6b510c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:16.424197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9777ff37-64fb-4d63-aacd-542b7f6b510c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:16.435291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9777ff37-64fb-4d63-aacd-542b7f6b510c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1293 microversion: 2.1 time: 0.113495 Aug 24 05:31:16.436191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1659/3203] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:16 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:16.529184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:16.529859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:16.543073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:16.543637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:16.544171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:16.544992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:16.547231 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:16.548903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:16.771882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:16.785434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:16.787871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:16.789428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3e4feb7e-b76f-4652-ab93-2a92f0dd18d9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1408 microversion: 2.20 time: 0.265469 Aug 24 05:31:16.790772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1545/3204] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:16 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:17.056396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:17.057207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:17.069223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:17.069982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:17.073827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:17.075049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:17.076623 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:17.078957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:17.107186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] HTTP exception thrown: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Request method failure captured: Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa HTTP/1.1 Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76K6tTKXFohuuiO2EKYttHDRC8Xf9uncFLHsa0picGs8ZtJlIo1Lq1TniLEifuHi7Rt6tcpwyI2KTAKeRZy32uXuWe6bediFw5Ws4ntNLXRZy6WJThzAxiX-WYxtQGtHSUdg9h0abv0ZcsxV6au86cPER1xy2hqoCsRpIHmqTJeh4 Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: c2394a6093e241469dd0900c8efad29c Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:31:17.109414 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_c2394a6093e241469dd0900c8efad29c", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: c2394a6093e241469dd0900c8efad29c Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeTestJSON-1059081725-project Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 5c6fb51f911e40338628bd734299c0d0 Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeTestJSON-1059081725-project Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. Aug 24 05:31:17.111898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '598c5040-751c-4914-906d-031f0abe36aa'} Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:31:17.112990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. Aug 24 05:31:17.114830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:31:17.128588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Returning 404 to user: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:31:17.131315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e0770fd9-82ee-4554-9c72-49391899508c tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "DELETE /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 404 len: 111 microversion: 2.1 time: 0.079401 Aug 24 05:31:17.135135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1660/3205] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:31:17 2022] DELETE /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:31:17.143014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:17.144115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] [instance: 598c5040-751c-4914-906d-031f0abe36aa] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:17.154428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:17.156308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:17.161487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:17.163589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:17.164710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:17.165826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:17.217145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] HTTP exception thrown: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Request method failure captured: Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa HTTP/1.1 Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76K6tTKXFohuuiO2EKYttHDRC8Xf9uncFLHsa0picGs8ZtJlIo1Lq1TniLEifuHi7Rt6tcpwyI2KTAKeRZy32uXuWe6bediFw5Ws4ntNLXRZy6WJThzAxiX-WYxtQGtHSUdg9h0abv0ZcsxV6au86cPER1xy2hqoCsRpIHmqTJeh4 Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: c2394a6093e241469dd0900c8efad29c Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:31:17.219291 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_c2394a6093e241469dd0900c8efad29c", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/c2394a6093e241469dd0900c8efad29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: c2394a6093e241469dd0900c8efad29c Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1059081725 Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeTestJSON-1059081725-project Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 5c6fb51f911e40338628bd734299c0d0 Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeTestJSON-1059081725-project Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. Aug 24 05:31:17.221423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '598c5040-751c-4914-906d-031f0abe36aa'} Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:31:17.222272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. Aug 24 05:31:17.225768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:31:17.233631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] Returning 404 to user: Instance 598c5040-751c-4914-906d-031f0abe36aa could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:31:17.234516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0a264b10-dc3e-4c75-b4b6-af46348f2a2f tempest-AttachVolumeTestJSON-1059081725 tempest-AttachVolumeTestJSON-1059081725-project] 10.222.0.97 "GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa" status: 404 len: 111 microversion: 2.1 time: 0.098309 Aug 24 05:31:17.235114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1546/3206] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:17 2022] GET /compute/v2.1/servers/598c5040-751c-4914-906d-031f0abe36aa => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:31:17.461529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-31ddeea7-4460-4779-a331-98d609e08a4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:17.462835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-31ddeea7-4460-4779-a331-98d609e08a4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:17.469886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ddeea7-4460-4779-a331-98d609e08a4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:17.470713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ddeea7-4460-4779-a331-98d609e08a4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:17.471516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ddeea7-4460-4779-a331-98d609e08a4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:17.472395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ddeea7-4460-4779-a331-98d609e08a4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:17.473015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ddeea7-4460-4779-a331-98d609e08a4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:17.473596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-31ddeea7-4460-4779-a331-98d609e08a4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:17.588095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-31ddeea7-4460-4779-a331-98d609e08a4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:17.601035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-31ddeea7-4460-4779-a331-98d609e08a4b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1299 microversion: 2.1 time: 0.143486 Aug 24 05:31:17.603516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1661/3207] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:17 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:17.814128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:17.815917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:17.827619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:17.828669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:17.830310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:17.831759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:17.832901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:17.834021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:17.849975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:18.120036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:18.136613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:18.138526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:18.139991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-623d7938-0763-49e1-b12b-1636ff0470bf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1601 microversion: 2.20 time: 0.331773 Aug 24 05:31:18.140738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1547/3208] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:31:17 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1601 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:31:18.167440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a3ee0be0-9dcb-4190-89fa-661d7b132310 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:18.168538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a3ee0be0-9dcb-4190-89fa-661d7b132310 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:18.182071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3ee0be0-9dcb-4190-89fa-661d7b132310 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:18.183111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3ee0be0-9dcb-4190-89fa-661d7b132310 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:18.184969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3ee0be0-9dcb-4190-89fa-661d7b132310 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:18.189493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3ee0be0-9dcb-4190-89fa-661d7b132310 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:18.191041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3ee0be0-9dcb-4190-89fa-661d7b132310 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:18.191680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3ee0be0-9dcb-4190-89fa-661d7b132310 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:18.442183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a3ee0be0-9dcb-4190-89fa-661d7b132310 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.278741 Aug 24 05:31:18.443586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1662/3209] 10.222.0.97 () {60 vars in 1316 bytes} [Wed Aug 24 05:31:18 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-interface => generated 285 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:31:18.625781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-33e345b5-62a0-43f7-8fba-765c425f5974 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:18.628599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-33e345b5-62a0-43f7-8fba-765c425f5974 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:18.638990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33e345b5-62a0-43f7-8fba-765c425f5974 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:18.639723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33e345b5-62a0-43f7-8fba-765c425f5974 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:18.640343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33e345b5-62a0-43f7-8fba-765c425f5974 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:18.641707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33e345b5-62a0-43f7-8fba-765c425f5974 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:18.642948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33e345b5-62a0-43f7-8fba-765c425f5974 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:18.643760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33e345b5-62a0-43f7-8fba-765c425f5974 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:19.578398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-33e345b5-62a0-43f7-8fba-765c425f5974 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:19.593020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-33e345b5-62a0-43f7-8fba-765c425f5974 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.970885 Aug 24 05:31:19.619169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1548/3210] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:18 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:20.564058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-29790008-3ce0-4801-937f-36040c563331 req-11085454-e99d-4107-b884-ba99c711bf9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34713cf1-5790-4036-bd9d-e127e3957b1c", "tag": "2c0fe4f3-d326-448a-92a9-52b3b0c9c901"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:20.588687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-29790008-3ce0-4801-937f-36040c563331 req-11085454-e99d-4107-b884-ba99c711bf9f service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:20.589488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-29790008-3ce0-4801-937f-36040c563331 req-11085454-e99d-4107-b884-ba99c711bf9f service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:20.590115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-29790008-3ce0-4801-937f-36040c563331 req-11085454-e99d-4107-b884-ba99c711bf9f service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:20.619209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cdb533d8-80c6-490b-be15-bd8c1722310f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:20.619892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cdb533d8-80c6-490b-be15-bd8c1722310f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:20.623654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-29790008-3ce0-4801-937f-36040c563331 req-11085454-e99d-4107-b884-ba99c711bf9f service nova] Creating event network-changed:2c0fe4f3-d326-448a-92a9-52b3b0c9c901 for instance 34713cf1-5790-4036-bd9d-e127e3957b1c on hv-cinder-85426 Aug 24 05:31:20.630594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-29790008-3ce0-4801-937f-36040c563331 req-11085454-e99d-4107-b884-ba99c711bf9f service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082033 Aug 24 05:31:20.631853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1663/3211] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:20.633929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdb533d8-80c6-490b-be15-bd8c1722310f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:20.634483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdb533d8-80c6-490b-be15-bd8c1722310f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:20.635174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdb533d8-80c6-490b-be15-bd8c1722310f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:20.636079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdb533d8-80c6-490b-be15-bd8c1722310f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:20.636705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdb533d8-80c6-490b-be15-bd8c1722310f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:20.637310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cdb533d8-80c6-490b-be15-bd8c1722310f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:21.063904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cdb533d8-80c6-490b-be15-bd8c1722310f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:21.081107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cdb533d8-80c6-490b-be15-bd8c1722310f tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.466417 Aug 24 05:31:21.096533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1549/3212] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:20 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:22.107200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f832f85d-5d4f-45d1-ae0b-dc832464e368 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:22.107725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f832f85d-5d4f-45d1-ae0b-dc832464e368 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:22.128048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f832f85d-5d4f-45d1-ae0b-dc832464e368 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:22.130803 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f832f85d-5d4f-45d1-ae0b-dc832464e368 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:22.131541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f832f85d-5d4f-45d1-ae0b-dc832464e368 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:22.134850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f832f85d-5d4f-45d1-ae0b-dc832464e368 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:22.135526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f832f85d-5d4f-45d1-ae0b-dc832464e368 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:22.137076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f832f85d-5d4f-45d1-ae0b-dc832464e368 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:22.410700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f832f85d-5d4f-45d1-ae0b-dc832464e368 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:22.424748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f832f85d-5d4f-45d1-ae0b-dc832464e368 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.324033 Aug 24 05:31:22.428607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1664/3213] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:22 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:22.837907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-ba423aa3-c983-4c67-8bb1-7d72db802940 req-7d6a841b-bc12-492d-9954-f706b0526dbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "342b0ec6-3c25-4b72-bcb1-88878f3d85e8", "tag": "e783a71b-b500-4cdb-96c0-ecd825b2a9c5"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:22.862300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-ba423aa3-c983-4c67-8bb1-7d72db802940 req-7d6a841b-bc12-492d-9954-f706b0526dbf service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:22.862856 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-ba423aa3-c983-4c67-8bb1-7d72db802940 req-7d6a841b-bc12-492d-9954-f706b0526dbf service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:22.863554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-ba423aa3-c983-4c67-8bb1-7d72db802940 req-7d6a841b-bc12-492d-9954-f706b0526dbf service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:22.881990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-ba423aa3-c983-4c67-8bb1-7d72db802940 req-7d6a841b-bc12-492d-9954-f706b0526dbf service nova] Creating event network-changed:e783a71b-b500-4cdb-96c0-ecd825b2a9c5 for instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 on hv-cinder-85426 Aug 24 05:31:22.931349 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-ba423aa3-c983-4c67-8bb1-7d72db802940 req-7d6a841b-bc12-492d-9954-f706b0526dbf service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097198 Aug 24 05:31:22.935079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1550/3214] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:23.452559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b19345b5-689d-40d3-8b23-fddcfb890e7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:23.453854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b19345b5-689d-40d3-8b23-fddcfb890e7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:23.462647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b19345b5-689d-40d3-8b23-fddcfb890e7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:23.463448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b19345b5-689d-40d3-8b23-fddcfb890e7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:23.464074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b19345b5-689d-40d3-8b23-fddcfb890e7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:23.465006 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b19345b5-689d-40d3-8b23-fddcfb890e7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:23.465697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b19345b5-689d-40d3-8b23-fddcfb890e7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:23.466437 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b19345b5-689d-40d3-8b23-fddcfb890e7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:23.655437 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b19345b5-689d-40d3-8b23-fddcfb890e7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:23.660214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:23.664859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b19345b5-689d-40d3-8b23-fddcfb890e7c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.219398 Aug 24 05:31:23.665904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1665/3215] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:23 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:24.686716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-33034934-512c-46fd-8c45-2e4b3e6a24b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:24.693270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-33034934-512c-46fd-8c45-2e4b3e6a24b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:24.706024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:24.707073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=24 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:24.709515 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33034934-512c-46fd-8c45-2e4b3e6a24b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:24.710246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33034934-512c-46fd-8c45-2e4b3e6a24b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:24.710972 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33034934-512c-46fd-8c45-2e4b3e6a24b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:24.712491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33034934-512c-46fd-8c45-2e4b3e6a24b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:24.713178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33034934-512c-46fd-8c45-2e4b3e6a24b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:24.713851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33034934-512c-46fd-8c45-2e4b3e6a24b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:25.278086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-33034934-512c-46fd-8c45-2e4b3e6a24b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:25.287550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-33034934-512c-46fd-8c45-2e4b3e6a24b3 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.605783 Aug 24 05:31:25.294914 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1551/3216] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:24 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:26.317407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5ce51000-1999-4019-8b4b-c9bff76e4661 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:26.325151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-9f73d55d-371c-4e46-b166-818dfffaa15c req-18cbda52-9078-4261-b411-601683d101fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34713cf1-5790-4036-bd9d-e127e3957b1c", "name": "network-vif-plugged", "status": "completed", "tag": "2c0fe4f3-d326-448a-92a9-52b3b0c9c901"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:26.331886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5ce51000-1999-4019-8b4b-c9bff76e4661 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:26.346396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ce51000-1999-4019-8b4b-c9bff76e4661 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:26.350741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-9f73d55d-371c-4e46-b166-818dfffaa15c req-18cbda52-9078-4261-b411-601683d101fb service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:26.351309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ce51000-1999-4019-8b4b-c9bff76e4661 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:26.351995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ce51000-1999-4019-8b4b-c9bff76e4661 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:26.352887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ce51000-1999-4019-8b4b-c9bff76e4661 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:26.354080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ce51000-1999-4019-8b4b-c9bff76e4661 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:26.354381 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-9f73d55d-371c-4e46-b166-818dfffaa15c req-18cbda52-9078-4261-b411-601683d101fb service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:26.355056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-9f73d55d-371c-4e46-b166-818dfffaa15c req-18cbda52-9078-4261-b411-601683d101fb service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:26.355680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ce51000-1999-4019-8b4b-c9bff76e4661 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:26.388602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-9f73d55d-371c-4e46-b166-818dfffaa15c req-18cbda52-9078-4261-b411-601683d101fb service nova] Creating event network-vif-plugged:2c0fe4f3-d326-448a-92a9-52b3b0c9c901 for instance 34713cf1-5790-4036-bd9d-e127e3957b1c on hv-cinder-85426 Aug 24 05:31:26.466438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-9f73d55d-371c-4e46-b166-818dfffaa15c req-18cbda52-9078-4261-b411-601683d101fb service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145279 Aug 24 05:31:26.477361 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1552/3217] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:26.582194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ce51000-1999-4019-8b4b-c9bff76e4661 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:26.589995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5ce51000-1999-4019-8b4b-c9bff76e4661 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.277549 Aug 24 05:31:26.590839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1666/3218] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:26 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:27.177152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a54ca973-aa2c-4832-af99-6ce378d2deea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Action: 'create', calling method: .version_select at 0x7f359062c160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1558069474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9P4FptpHomXKiMI4bczV9bUXSR3xOnpCS9C8Nu1bzx3G4FPDMMZmRn8eSAPPjL57u+Lfb0lM/jIo1snGJF8S82mdK8S2MBcAp30IyVuNidx+KuSjFqHo/ayMphZjOLyw=="}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:27.193766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-a54ca973-aa2c-4832-af99-6ce378d2deea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Getting quotas for project ecdf03c1545c4bc3a2a74507d8b9aa47. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:31:27.197697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-a54ca973-aa2c-4832-af99-6ce378d2deea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Getting quotas for user d973e98445c44fa5a5f9eecbb393d8c7 and project ecdf03c1545c4bc3a2a74507d8b9aa47. Resources: {'key_pairs'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:31:27.223618 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a54ca973-aa2c-4832-af99-6ce378d2deea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051220 Aug 24 05:31:27.224312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1553/3219] 10.222.0.97 () {60 vars in 1159 bytes} [Wed Aug 24 05:31:27 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:27.345920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-289706721", "imageRef": "cc096b56-b1f4-43e3-8909-83a0bc6515df", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1558069474", "networks": [{"uuid": "b82462e9-670e-4971-bcb6-02cbc32088bb"}]}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:27.398672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.network.neutron [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] validate_networks() for [('b82462e9-670e-4971-bcb6-02cbc32088bb', None, None, None, None, None)] {{(pid=120558) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:31:27.611829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-71644b91-a9b2-4f4a-811d-bf482a09bfe4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:27.612482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-71644b91-a9b2-4f4a-811d-bf482a09bfe4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:27.619128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-71644b91-a9b2-4f4a-811d-bf482a09bfe4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:27.619607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-71644b91-a9b2-4f4a-811d-bf482a09bfe4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:27.620131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-71644b91-a9b2-4f4a-811d-bf482a09bfe4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:27.620818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-71644b91-a9b2-4f4a-811d-bf482a09bfe4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:27.621270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-71644b91-a9b2-4f4a-811d-bf482a09bfe4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:27.621687 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-71644b91-a9b2-4f4a-811d-bf482a09bfe4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:27.765036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-71644b91-a9b2-4f4a-811d-bf482a09bfe4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:27.772948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-71644b91-a9b2-4f4a-811d-bf482a09bfe4 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.165098 Aug 24 05:31:27.773522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1554/3220] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:27 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:31:27.783370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Flavor limits 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:31:27.783370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Image limits 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:31:27.783370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Flavor pref 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:31:27.783370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Image pref 0:0:0 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:31:27.783370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.virt.hardware [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120558) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:31:27.786713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:27.787194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:27.787620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:27.788323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:27.788763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:27.789183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:27.805562 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Getting quotas for project ecdf03c1545c4bc3a2a74507d8b9aa47. Resources: {'instances', 'ram', 'cores'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:31:27.809711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Getting quotas for user d973e98445c44fa5a5f9eecbb393d8c7 and project ecdf03c1545c4bc3a2a74507d8b9aa47. Resources: {'instances', 'ram', 'cores'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:31:27.820471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Going to run 1 instances... {{(pid=120558) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:31:27.822667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cc096b56-b1f4-43e3-8909-83a0bc6515df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120558) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:31:27.870172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6f634c83-094e-4526-aadf-cfbe0be1c6a6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.529252 Aug 24 05:31:27.876303 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1667/3221] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 05:31:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:31:27.881684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-62302f5c-a9ef-452c-8dfb-12c6f96351d4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:27.882297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-62302f5c-a9ef-452c-8dfb-12c6f96351d4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:27.940305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-62302f5c-a9ef-452c-8dfb-12c6f96351d4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:27.947333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-62302f5c-a9ef-452c-8dfb-12c6f96351d4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1258 microversion: 2.1 time: 0.069591 Aug 24 05:31:27.947903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1555/3222] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:27 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:28.794131 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c2e28547-5822-4468-8a89-c489e567583c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:28.794758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c2e28547-5822-4468-8a89-c489e567583c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:28.801999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2e28547-5822-4468-8a89-c489e567583c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:28.802468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2e28547-5822-4468-8a89-c489e567583c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:28.802927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2e28547-5822-4468-8a89-c489e567583c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:28.803599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2e28547-5822-4468-8a89-c489e567583c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:28.804038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2e28547-5822-4468-8a89-c489e567583c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:28.804450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2e28547-5822-4468-8a89-c489e567583c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:28.939255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c2e28547-5822-4468-8a89-c489e567583c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:28.946879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c2e28547-5822-4468-8a89-c489e567583c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.157179 Aug 24 05:31:28.947444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1668/3223] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:28 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:28.968301 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2e41d9a9-b51d-4330-8143-4168571ca19c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:28.968913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2e41d9a9-b51d-4330-8143-4168571ca19c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:28.976037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e41d9a9-b51d-4330-8143-4168571ca19c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:28.976514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e41d9a9-b51d-4330-8143-4168571ca19c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:28.976947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e41d9a9-b51d-4330-8143-4168571ca19c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:28.977634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e41d9a9-b51d-4330-8143-4168571ca19c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:28.978082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e41d9a9-b51d-4330-8143-4168571ca19c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:28.978503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e41d9a9-b51d-4330-8143-4168571ca19c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:29.040881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2e41d9a9-b51d-4330-8143-4168571ca19c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:29.049026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2e41d9a9-b51d-4330-8143-4168571ca19c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1262 microversion: 2.1 time: 0.083925 Aug 24 05:31:29.049674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1556/3224] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:28 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:29.967539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-09c08056-a198-4a7a-94d1-e9020b034c81 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:29.968155 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-09c08056-a198-4a7a-94d1-e9020b034c81 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:29.974728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09c08056-a198-4a7a-94d1-e9020b034c81 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:29.975214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09c08056-a198-4a7a-94d1-e9020b034c81 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:29.975653 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09c08056-a198-4a7a-94d1-e9020b034c81 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:29.976333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09c08056-a198-4a7a-94d1-e9020b034c81 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:29.976784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09c08056-a198-4a7a-94d1-e9020b034c81 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:29.977207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-09c08056-a198-4a7a-94d1-e9020b034c81 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:30.070058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ebf4c2dc-5c40-473f-8372-64dc29e4d31d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:30.070700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ebf4c2dc-5c40-473f-8372-64dc29e4d31d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:30.077675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebf4c2dc-5c40-473f-8372-64dc29e4d31d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:30.078256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebf4c2dc-5c40-473f-8372-64dc29e4d31d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:30.078798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebf4c2dc-5c40-473f-8372-64dc29e4d31d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:30.079560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebf4c2dc-5c40-473f-8372-64dc29e4d31d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:30.080084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebf4c2dc-5c40-473f-8372-64dc29e4d31d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:30.080711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ebf4c2dc-5c40-473f-8372-64dc29e4d31d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:30.106886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-09c08056-a198-4a7a-94d1-e9020b034c81 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:30.115527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-09c08056-a198-4a7a-94d1-e9020b034c81 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.151841 Aug 24 05:31:30.116110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1669/3225] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:29 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:30.143194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ebf4c2dc-5c40-473f-8372-64dc29e4d31d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:30.151087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ebf4c2dc-5c40-473f-8372-64dc29e4d31d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1262 microversion: 2.1 time: 0.085011 Aug 24 05:31:30.151644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1557/3226] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:30 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:31:31.137455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-27298c8d-029d-4dea-ba3e-51ac49ad3e66 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:31.137991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-27298c8d-029d-4dea-ba3e-51ac49ad3e66 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:31.145238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27298c8d-029d-4dea-ba3e-51ac49ad3e66 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:31.145716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27298c8d-029d-4dea-ba3e-51ac49ad3e66 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:31.146152 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27298c8d-029d-4dea-ba3e-51ac49ad3e66 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:31.146869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27298c8d-029d-4dea-ba3e-51ac49ad3e66 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:31.147322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27298c8d-029d-4dea-ba3e-51ac49ad3e66 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:31.147748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27298c8d-029d-4dea-ba3e-51ac49ad3e66 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:31.172319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dfe028c7-a1ea-458a-8749-a7a3344c8efa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:31.172942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dfe028c7-a1ea-458a-8749-a7a3344c8efa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:31.179673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfe028c7-a1ea-458a-8749-a7a3344c8efa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:31.180151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfe028c7-a1ea-458a-8749-a7a3344c8efa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:31.180584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfe028c7-a1ea-458a-8749-a7a3344c8efa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:31.181269 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfe028c7-a1ea-458a-8749-a7a3344c8efa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:31.181754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfe028c7-a1ea-458a-8749-a7a3344c8efa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:31.182176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dfe028c7-a1ea-458a-8749-a7a3344c8efa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:31.244450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dfe028c7-a1ea-458a-8749-a7a3344c8efa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:31.252598 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dfe028c7-a1ea-458a-8749-a7a3344c8efa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1262 microversion: 2.1 time: 0.083899 Aug 24 05:31:31.253184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1558/3227] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:31 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:31:31.285074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-27298c8d-029d-4dea-ba3e-51ac49ad3e66 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:31.292665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-27298c8d-029d-4dea-ba3e-51ac49ad3e66 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.159143 Aug 24 05:31:31.293221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1670/3228] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:31 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:32.274797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2bb80dc3-ff6a-42df-8512-1115700ca717 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:32.275415 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2bb80dc3-ff6a-42df-8512-1115700ca717 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:32.281910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bb80dc3-ff6a-42df-8512-1115700ca717 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:32.282426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bb80dc3-ff6a-42df-8512-1115700ca717 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:32.282911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bb80dc3-ff6a-42df-8512-1115700ca717 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:32.283731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bb80dc3-ff6a-42df-8512-1115700ca717 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:32.284189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bb80dc3-ff6a-42df-8512-1115700ca717 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:32.284756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2bb80dc3-ff6a-42df-8512-1115700ca717 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:32.313697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5e4b4cba-a964-44a4-8d92-cd97e1d1cc5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:32.314292 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5e4b4cba-a964-44a4-8d92-cd97e1d1cc5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:32.321943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e4b4cba-a964-44a4-8d92-cd97e1d1cc5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:32.322410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e4b4cba-a964-44a4-8d92-cd97e1d1cc5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:32.322878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e4b4cba-a964-44a4-8d92-cd97e1d1cc5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:32.323555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e4b4cba-a964-44a4-8d92-cd97e1d1cc5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:32.324070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e4b4cba-a964-44a4-8d92-cd97e1d1cc5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:32.324484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e4b4cba-a964-44a4-8d92-cd97e1d1cc5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:32.351673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2bb80dc3-ff6a-42df-8512-1115700ca717 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:32.359499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2bb80dc3-ff6a-42df-8512-1115700ca717 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1310 microversion: 2.1 time: 0.089308 Aug 24 05:31:32.360063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1559/3229] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:32 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:32.459512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5e4b4cba-a964-44a4-8d92-cd97e1d1cc5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:32.467400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5e4b4cba-a964-44a4-8d92-cd97e1d1cc5c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1367 microversion: 2.1 time: 0.157621 Aug 24 05:31:32.468257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1671/3230] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:32 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:31:33.381608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3173d3d8-15a2-436e-bfa4-407c24924b9b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:33.382565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3173d3d8-15a2-436e-bfa4-407c24924b9b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:33.388394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:33.390502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3173d3d8-15a2-436e-bfa4-407c24924b9b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:33.391014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3173d3d8-15a2-436e-bfa4-407c24924b9b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:33.391449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3173d3d8-15a2-436e-bfa4-407c24924b9b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:33.392145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3173d3d8-15a2-436e-bfa4-407c24924b9b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:33.393098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3173d3d8-15a2-436e-bfa4-407c24924b9b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:33.393520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3173d3d8-15a2-436e-bfa4-407c24924b9b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:33.466368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3173d3d8-15a2-436e-bfa4-407c24924b9b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:33.475060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3173d3d8-15a2-436e-bfa4-407c24924b9b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1316 microversion: 2.1 time: 0.097616 Aug 24 05:31:33.475623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1560/3231] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:33 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1316 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:33.489456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ea7039c4-5856-44b8-b617-6529659551fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:33.490100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ea7039c4-5856-44b8-b617-6529659551fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:33.496785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea7039c4-5856-44b8-b617-6529659551fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:33.497264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea7039c4-5856-44b8-b617-6529659551fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:33.497807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea7039c4-5856-44b8-b617-6529659551fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:33.498372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea7039c4-5856-44b8-b617-6529659551fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:33.498852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea7039c4-5856-44b8-b617-6529659551fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:33.499273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ea7039c4-5856-44b8-b617-6529659551fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:33.632134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ea7039c4-5856-44b8-b617-6529659551fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:33.639996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ea7039c4-5856-44b8-b617-6529659551fb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1556 microversion: 2.1 time: 0.154615 Aug 24 05:31:33.640843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1672/3232] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:33 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:33.661171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-44cf6fa6-1600-4479-8b55-1633a07c8fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:33.661663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-44cf6fa6-1600-4479-8b55-1633a07c8fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:33.667682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44cf6fa6-1600-4479-8b55-1633a07c8fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:33.668160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44cf6fa6-1600-4479-8b55-1633a07c8fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:33.668589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44cf6fa6-1600-4479-8b55-1633a07c8fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:33.669269 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44cf6fa6-1600-4479-8b55-1633a07c8fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:33.669724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44cf6fa6-1600-4479-8b55-1633a07c8fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:33.670125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44cf6fa6-1600-4479-8b55-1633a07c8fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:33.793906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-44cf6fa6-1600-4479-8b55-1633a07c8fea tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.136632 Aug 24 05:31:33.794537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1561/3233] 10.222.0.97 () {58 vars in 1275 bytes} [Wed Aug 24 05:31:33 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:34.496130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-07534a2b-f1da-4724-ae13-62829c65cf06 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:34.496715 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-07534a2b-f1da-4724-ae13-62829c65cf06 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:34.509509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07534a2b-f1da-4724-ae13-62829c65cf06 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:34.510019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07534a2b-f1da-4724-ae13-62829c65cf06 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:34.510468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07534a2b-f1da-4724-ae13-62829c65cf06 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:34.511240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07534a2b-f1da-4724-ae13-62829c65cf06 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:34.511684 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07534a2b-f1da-4724-ae13-62829c65cf06 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:34.512115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-07534a2b-f1da-4724-ae13-62829c65cf06 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:34.778499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-07534a2b-f1da-4724-ae13-62829c65cf06 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:34.794003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-07534a2b-f1da-4724-ae13-62829c65cf06 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.301705 Aug 24 05:31:34.794502 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1673/3234] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:34 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:31:34.824372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-9193d6d7-2411-453c-9831-f7c26f5fd700 req-5ae71543-9aac-4d67-babd-b5c6c63e1543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb9a2e3-49ff-4ce5-9009-4dbbdedaa574", "tag": "fe225cc9-367b-4a79-bdcf-67de3b667c45"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:34.835679 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-9193d6d7-2411-453c-9831-f7c26f5fd700 req-5ae71543-9aac-4d67-babd-b5c6c63e1543 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:34.836451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-9193d6d7-2411-453c-9831-f7c26f5fd700 req-5ae71543-9aac-4d67-babd-b5c6c63e1543 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:34.836876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-9193d6d7-2411-453c-9831-f7c26f5fd700 req-5ae71543-9aac-4d67-babd-b5c6c63e1543 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:34.849613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-9193d6d7-2411-453c-9831-f7c26f5fd700 req-5ae71543-9aac-4d67-babd-b5c6c63e1543 service nova] Creating event network-changed:fe225cc9-367b-4a79-bdcf-67de3b667c45 for instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 on hv-cinder-85426 Aug 24 05:31:34.855545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-9193d6d7-2411-453c-9831-f7c26f5fd700 req-5ae71543-9aac-4d67-babd-b5c6c63e1543 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035773 Aug 24 05:31:34.856722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1562/3235] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:34.931148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-a4d559ba-a448-40d2-ba22-83ca4cee8afb req-41f10523-d410-416f-b192-9c3dd9312a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34713cf1-5790-4036-bd9d-e127e3957b1c", "tag": "2c0fe4f3-d326-448a-92a9-52b3b0c9c901"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:31:34.941314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-a4d559ba-a448-40d2-ba22-83ca4cee8afb req-41f10523-d410-416f-b192-9c3dd9312a66 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:34.941780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-a4d559ba-a448-40d2-ba22-83ca4cee8afb req-41f10523-d410-416f-b192-9c3dd9312a66 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:34.942199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-a4d559ba-a448-40d2-ba22-83ca4cee8afb req-41f10523-d410-416f-b192-9c3dd9312a66 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:34.953122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-a4d559ba-a448-40d2-ba22-83ca4cee8afb req-41f10523-d410-416f-b192-9c3dd9312a66 service nova] Creating event network-changed:2c0fe4f3-d326-448a-92a9-52b3b0c9c901 for instance 34713cf1-5790-4036-bd9d-e127e3957b1c on hv-cinder-85426 Aug 24 05:31:34.959097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-a4d559ba-a448-40d2-ba22-83ca4cee8afb req-41f10523-d410-416f-b192-9c3dd9312a66 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031452 Aug 24 05:31:34.959688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1674/3236] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:31:35.819166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7f02765d-ba0a-4c7e-b697-6316bc98a2e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:35.820187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7f02765d-ba0a-4c7e-b697-6316bc98a2e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:35.827623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f02765d-ba0a-4c7e-b697-6316bc98a2e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:35.828274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f02765d-ba0a-4c7e-b697-6316bc98a2e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:35.828667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f02765d-ba0a-4c7e-b697-6316bc98a2e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:35.829437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f02765d-ba0a-4c7e-b697-6316bc98a2e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:35.829967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f02765d-ba0a-4c7e-b697-6316bc98a2e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:35.831261 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7f02765d-ba0a-4c7e-b697-6316bc98a2e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:36.033800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7f02765d-ba0a-4c7e-b697-6316bc98a2e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:36.042913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7f02765d-ba0a-4c7e-b697-6316bc98a2e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.228967 Aug 24 05:31:36.043357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1563/3237] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:35 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:37.066471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e05989c7-b643-4abc-9cc5-8c9578a61668 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:37.067194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e05989c7-b643-4abc-9cc5-8c9578a61668 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:37.069115 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:37.074509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e05989c7-b643-4abc-9cc5-8c9578a61668 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:37.075019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e05989c7-b643-4abc-9cc5-8c9578a61668 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:37.075456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e05989c7-b643-4abc-9cc5-8c9578a61668 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:37.076132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e05989c7-b643-4abc-9cc5-8c9578a61668 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:37.076583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e05989c7-b643-4abc-9cc5-8c9578a61668 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:37.077002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e05989c7-b643-4abc-9cc5-8c9578a61668 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:37.210985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e05989c7-b643-4abc-9cc5-8c9578a61668 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:37.218583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e05989c7-b643-4abc-9cc5-8c9578a61668 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.157472 Aug 24 05:31:37.219180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1675/3238] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:37 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:38.239635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7ea0b405-7f82-47ed-af65-d0ef9ef37beb tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:38.240923 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7ea0b405-7f82-47ed-af65-d0ef9ef37beb tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:38.243228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=6 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:38.248797 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ea0b405-7f82-47ed-af65-d0ef9ef37beb tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:38.249423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ea0b405-7f82-47ed-af65-d0ef9ef37beb tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:38.249864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ea0b405-7f82-47ed-af65-d0ef9ef37beb tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:38.250941 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ea0b405-7f82-47ed-af65-d0ef9ef37beb tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:38.251470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ea0b405-7f82-47ed-af65-d0ef9ef37beb tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:38.252283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7ea0b405-7f82-47ed-af65-d0ef9ef37beb tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:38.525221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7ea0b405-7f82-47ed-af65-d0ef9ef37beb tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:38.535506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7ea0b405-7f82-47ed-af65-d0ef9ef37beb tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.299924 Aug 24 05:31:38.536079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1564/3239] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:38 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:39.561769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7ca35171-ce67-432f-8a1e-9f9ba9ee0a72 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:39.562387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7ca35171-ce67-432f-8a1e-9f9ba9ee0a72 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:39.564266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:39.564917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=6 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:39.572068 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ca35171-ce67-432f-8a1e-9f9ba9ee0a72 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:39.572553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ca35171-ce67-432f-8a1e-9f9ba9ee0a72 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:39.572987 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ca35171-ce67-432f-8a1e-9f9ba9ee0a72 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:39.573668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ca35171-ce67-432f-8a1e-9f9ba9ee0a72 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:39.574120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ca35171-ce67-432f-8a1e-9f9ba9ee0a72 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:39.574538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ca35171-ce67-432f-8a1e-9f9ba9ee0a72 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:39.757293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7ca35171-ce67-432f-8a1e-9f9ba9ee0a72 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:39.764910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7ca35171-ce67-432f-8a1e-9f9ba9ee0a72 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.207325 Aug 24 05:31:39.765471 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1676/3240] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:39 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:40.786078 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b4b481c8-829b-4201-b431-08348dccfece tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:40.786708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b4b481c8-829b-4201-b431-08348dccfece tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:40.794720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4b481c8-829b-4201-b431-08348dccfece tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:40.794720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4b481c8-829b-4201-b431-08348dccfece tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:40.794720 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4b481c8-829b-4201-b431-08348dccfece tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:40.796706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4b481c8-829b-4201-b431-08348dccfece tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:40.796706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4b481c8-829b-4201-b431-08348dccfece tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:40.796706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4b481c8-829b-4201-b431-08348dccfece tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:40.936854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b4b481c8-829b-4201-b431-08348dccfece tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:40.946205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b4b481c8-829b-4201-b431-08348dccfece tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.164728 Aug 24 05:31:40.947589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1565/3241] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:40 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:41.968295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fb550f81-fbc7-4306-a50a-68b210ca61d0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:41.968940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fb550f81-fbc7-4306-a50a-68b210ca61d0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:41.976166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb550f81-fbc7-4306-a50a-68b210ca61d0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:41.976683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb550f81-fbc7-4306-a50a-68b210ca61d0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:41.977120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb550f81-fbc7-4306-a50a-68b210ca61d0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:41.977816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb550f81-fbc7-4306-a50a-68b210ca61d0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:41.978265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb550f81-fbc7-4306-a50a-68b210ca61d0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:41.978704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fb550f81-fbc7-4306-a50a-68b210ca61d0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:42.124783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fb550f81-fbc7-4306-a50a-68b210ca61d0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:42.133700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fb550f81-fbc7-4306-a50a-68b210ca61d0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.169630 Aug 24 05:31:42.134286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1677/3242] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:41 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:43.158615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-56a2b2e7-bc3d-40b9-acac-837c146abefa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:43.159254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-56a2b2e7-bc3d-40b9-acac-837c146abefa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:43.166014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56a2b2e7-bc3d-40b9-acac-837c146abefa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:43.166499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56a2b2e7-bc3d-40b9-acac-837c146abefa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:43.166967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56a2b2e7-bc3d-40b9-acac-837c146abefa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:43.167657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56a2b2e7-bc3d-40b9-acac-837c146abefa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:43.168201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56a2b2e7-bc3d-40b9-acac-837c146abefa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:43.168575 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-56a2b2e7-bc3d-40b9-acac-837c146abefa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:43.314796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-56a2b2e7-bc3d-40b9-acac-837c146abefa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:43.323608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-56a2b2e7-bc3d-40b9-acac-837c146abefa tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.169012 Aug 24 05:31:43.324185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1566/3243] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:43 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:44.345015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1fbf1f07-7118-4a51-a49e-60cc1f470cac tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:44.345744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1fbf1f07-7118-4a51-a49e-60cc1f470cac tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:44.352488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fbf1f07-7118-4a51-a49e-60cc1f470cac tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:44.352961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fbf1f07-7118-4a51-a49e-60cc1f470cac tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:44.353395 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fbf1f07-7118-4a51-a49e-60cc1f470cac tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:44.354086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fbf1f07-7118-4a51-a49e-60cc1f470cac tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:44.354537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fbf1f07-7118-4a51-a49e-60cc1f470cac tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:44.354983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1fbf1f07-7118-4a51-a49e-60cc1f470cac tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:44.496916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1fbf1f07-7118-4a51-a49e-60cc1f470cac tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:44.509725 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1fbf1f07-7118-4a51-a49e-60cc1f470cac tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.165388 Aug 24 05:31:44.511185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1678/3244] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:44 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:45.531298 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5834ee16-e367-47db-9cce-9f30cf55dd71 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:45.531892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5834ee16-e367-47db-9cce-9f30cf55dd71 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:45.538541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5834ee16-e367-47db-9cce-9f30cf55dd71 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:45.539044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5834ee16-e367-47db-9cce-9f30cf55dd71 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:45.539482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5834ee16-e367-47db-9cce-9f30cf55dd71 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:45.540155 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5834ee16-e367-47db-9cce-9f30cf55dd71 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:45.540600 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5834ee16-e367-47db-9cce-9f30cf55dd71 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:45.541019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5834ee16-e367-47db-9cce-9f30cf55dd71 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:45.671983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5834ee16-e367-47db-9cce-9f30cf55dd71 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:45.679746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5834ee16-e367-47db-9cce-9f30cf55dd71 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.152288 Aug 24 05:31:45.680311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1567/3245] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:45 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:46.701452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9a6ce0aa-df31-4ae2-b6a0-c9ba10850bab tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:46.702053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9a6ce0aa-df31-4ae2-b6a0-c9ba10850bab tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:46.708075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a6ce0aa-df31-4ae2-b6a0-c9ba10850bab tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:46.708546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a6ce0aa-df31-4ae2-b6a0-c9ba10850bab tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:46.708977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a6ce0aa-df31-4ae2-b6a0-c9ba10850bab tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:46.709646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a6ce0aa-df31-4ae2-b6a0-c9ba10850bab tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:46.710197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a6ce0aa-df31-4ae2-b6a0-c9ba10850bab tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:46.710584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9a6ce0aa-df31-4ae2-b6a0-c9ba10850bab tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:46.838892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9a6ce0aa-df31-4ae2-b6a0-c9ba10850bab tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:46.846430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9a6ce0aa-df31-4ae2-b6a0-c9ba10850bab tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.148944 Aug 24 05:31:46.847032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1679/3246] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:46 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:47.868128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6da4b6b5-3749-43e5-8968-cbbb8a8e43bc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:47.868716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6da4b6b5-3749-43e5-8968-cbbb8a8e43bc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:47.875169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6da4b6b5-3749-43e5-8968-cbbb8a8e43bc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:47.875643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6da4b6b5-3749-43e5-8968-cbbb8a8e43bc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:47.876075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6da4b6b5-3749-43e5-8968-cbbb8a8e43bc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:47.876752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6da4b6b5-3749-43e5-8968-cbbb8a8e43bc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:47.877200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6da4b6b5-3749-43e5-8968-cbbb8a8e43bc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:47.877616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6da4b6b5-3749-43e5-8968-cbbb8a8e43bc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:47.881516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:48.004102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6da4b6b5-3749-43e5-8968-cbbb8a8e43bc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:48.011713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6da4b6b5-3749-43e5-8968-cbbb8a8e43bc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.147463 Aug 24 05:31:48.012268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1568/3247] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:47 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:49.033171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3aaef8bf-323b-46af-92f9-422640e1695d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:49.033711 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3aaef8bf-323b-46af-92f9-422640e1695d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:49.040756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3aaef8bf-323b-46af-92f9-422640e1695d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:49.041228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3aaef8bf-323b-46af-92f9-422640e1695d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:49.041655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3aaef8bf-323b-46af-92f9-422640e1695d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:49.042334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3aaef8bf-323b-46af-92f9-422640e1695d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:49.042816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3aaef8bf-323b-46af-92f9-422640e1695d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:49.043236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3aaef8bf-323b-46af-92f9-422640e1695d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:49.177070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3aaef8bf-323b-46af-92f9-422640e1695d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:49.185167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3aaef8bf-323b-46af-92f9-422640e1695d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.155919 Aug 24 05:31:49.185735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1680/3248] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:49 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:50.205562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-501ba0f0-44a0-455f-af26-3c821625aae5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:50.206208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-501ba0f0-44a0-455f-af26-3c821625aae5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:50.213391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-501ba0f0-44a0-455f-af26-3c821625aae5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:50.213882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-501ba0f0-44a0-455f-af26-3c821625aae5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:50.214316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-501ba0f0-44a0-455f-af26-3c821625aae5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:50.216698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-501ba0f0-44a0-455f-af26-3c821625aae5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:50.217178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-501ba0f0-44a0-455f-af26-3c821625aae5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:50.217632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-501ba0f0-44a0-455f-af26-3c821625aae5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:50.359133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-501ba0f0-44a0-455f-af26-3c821625aae5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:50.367565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-501ba0f0-44a0-455f-af26-3c821625aae5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.165841 Aug 24 05:31:50.368375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1569/3249] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:50 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:51.389293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5e3022e2-f120-4d22-a762-344feb8f2f6d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:51.390180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5e3022e2-f120-4d22-a762-344feb8f2f6d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:51.397631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e3022e2-f120-4d22-a762-344feb8f2f6d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:51.398505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e3022e2-f120-4d22-a762-344feb8f2f6d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:51.399046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e3022e2-f120-4d22-a762-344feb8f2f6d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:51.399820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e3022e2-f120-4d22-a762-344feb8f2f6d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:51.400351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e3022e2-f120-4d22-a762-344feb8f2f6d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:51.400860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5e3022e2-f120-4d22-a762-344feb8f2f6d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:51.532905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5e3022e2-f120-4d22-a762-344feb8f2f6d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:51.540829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5e3022e2-f120-4d22-a762-344feb8f2f6d tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.155492 Aug 24 05:31:51.541392 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1681/3250] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:51 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:52.561800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fec5f581-ea27-4728-964c-c756f411e7e6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:52.562444 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fec5f581-ea27-4728-964c-c756f411e7e6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:52.569785 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fec5f581-ea27-4728-964c-c756f411e7e6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:52.570262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fec5f581-ea27-4728-964c-c756f411e7e6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:52.570736 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fec5f581-ea27-4728-964c-c756f411e7e6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:52.571416 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fec5f581-ea27-4728-964c-c756f411e7e6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:52.571867 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fec5f581-ea27-4728-964c-c756f411e7e6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:52.572296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fec5f581-ea27-4728-964c-c756f411e7e6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:52.703663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fec5f581-ea27-4728-964c-c756f411e7e6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:52.712025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fec5f581-ea27-4728-964c-c756f411e7e6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.154388 Aug 24 05:31:52.712577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1570/3251] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:52 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:53.732528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8d70c144-ffbf-45cf-8c4b-69c7930e91de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:53.733175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8d70c144-ffbf-45cf-8c4b-69c7930e91de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:53.739808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d70c144-ffbf-45cf-8c4b-69c7930e91de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:53.740283 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d70c144-ffbf-45cf-8c4b-69c7930e91de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:53.740818 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d70c144-ffbf-45cf-8c4b-69c7930e91de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:53.741964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d70c144-ffbf-45cf-8c4b-69c7930e91de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:53.741964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d70c144-ffbf-45cf-8c4b-69c7930e91de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:53.742419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8d70c144-ffbf-45cf-8c4b-69c7930e91de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:53.890133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8d70c144-ffbf-45cf-8c4b-69c7930e91de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:53.899023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8d70c144-ffbf-45cf-8c4b-69c7930e91de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.170273 Aug 24 05:31:53.904375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1682/3252] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:53 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:54.919897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-14429724-3b79-4216-b069-a623afffb009 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:54.920612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-14429724-3b79-4216-b069-a623afffb009 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:54.927286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14429724-3b79-4216-b069-a623afffb009 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:54.927916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14429724-3b79-4216-b069-a623afffb009 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:54.928669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14429724-3b79-4216-b069-a623afffb009 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:54.929430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14429724-3b79-4216-b069-a623afffb009 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:54.929970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14429724-3b79-4216-b069-a623afffb009 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:54.930842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14429724-3b79-4216-b069-a623afffb009 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:55.067480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-14429724-3b79-4216-b069-a623afffb009 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:55.076008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-14429724-3b79-4216-b069-a623afffb009 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.160323 Aug 24 05:31:55.076572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1571/3253] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:54 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:56.097311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fa84a212-6068-43ac-8c13-3c1d983d50bd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:56.097922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fa84a212-6068-43ac-8c13-3c1d983d50bd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:56.104961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa84a212-6068-43ac-8c13-3c1d983d50bd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:56.105439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa84a212-6068-43ac-8c13-3c1d983d50bd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:56.105869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa84a212-6068-43ac-8c13-3c1d983d50bd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:56.106587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa84a212-6068-43ac-8c13-3c1d983d50bd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:56.107050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa84a212-6068-43ac-8c13-3c1d983d50bd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:56.107470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa84a212-6068-43ac-8c13-3c1d983d50bd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:56.235444 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fa84a212-6068-43ac-8c13-3c1d983d50bd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:56.238791 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:31:56.243893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fa84a212-6068-43ac-8c13-3c1d983d50bd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.150500 Aug 24 05:31:56.244451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1683/3254] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:56 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:57.265049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-395e60a8-66d8-4e4b-b685-8504d8e6667e tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:57.265586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-395e60a8-66d8-4e4b-b685-8504d8e6667e tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:57.272171 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395e60a8-66d8-4e4b-b685-8504d8e6667e tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:57.272646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395e60a8-66d8-4e4b-b685-8504d8e6667e tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:57.273079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395e60a8-66d8-4e4b-b685-8504d8e6667e tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:57.273757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395e60a8-66d8-4e4b-b685-8504d8e6667e tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:57.274205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395e60a8-66d8-4e4b-b685-8504d8e6667e tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:57.274632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-395e60a8-66d8-4e4b-b685-8504d8e6667e tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:57.406781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-395e60a8-66d8-4e4b-b685-8504d8e6667e tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:57.414946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-395e60a8-66d8-4e4b-b685-8504d8e6667e tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.153830 Aug 24 05:31:57.415509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1572/3255] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:57 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:58.436549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ecc661ca-423e-420e-9d93-d2a3b699d82a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:58.437103 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ecc661ca-423e-420e-9d93-d2a3b699d82a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:58.443943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecc661ca-423e-420e-9d93-d2a3b699d82a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:58.444415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecc661ca-423e-420e-9d93-d2a3b699d82a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:58.444844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecc661ca-423e-420e-9d93-d2a3b699d82a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:58.445518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecc661ca-423e-420e-9d93-d2a3b699d82a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:58.445968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecc661ca-423e-420e-9d93-d2a3b699d82a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:58.446383 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ecc661ca-423e-420e-9d93-d2a3b699d82a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:58.573296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ecc661ca-423e-420e-9d93-d2a3b699d82a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:58.580929 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ecc661ca-423e-420e-9d93-d2a3b699d82a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.148642 Aug 24 05:31:58.581492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1684/3256] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:58 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:31:59.601940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b36b5a9b-785b-48d1-9da3-e42bc645c65f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:31:59.602658 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b36b5a9b-785b-48d1-9da3-e42bc645c65f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:31:59.609119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36b5a9b-785b-48d1-9da3-e42bc645c65f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:59.609593 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36b5a9b-785b-48d1-9da3-e42bc645c65f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:59.610087 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36b5a9b-785b-48d1-9da3-e42bc645c65f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:59.610804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36b5a9b-785b-48d1-9da3-e42bc645c65f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:31:59.611250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36b5a9b-785b-48d1-9da3-e42bc645c65f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:31:59.611669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b36b5a9b-785b-48d1-9da3-e42bc645c65f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:31:59.738451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b36b5a9b-785b-48d1-9da3-e42bc645c65f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:31:59.746711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b36b5a9b-785b-48d1-9da3-e42bc645c65f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.149182 Aug 24 05:31:59.747274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1573/3257] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:31:59 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:00.768075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5c0c3e92-abee-47f5-bb10-c0a73ab53386 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:00.768672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5c0c3e92-abee-47f5-bb10-c0a73ab53386 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:00.775086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c0c3e92-abee-47f5-bb10-c0a73ab53386 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:00.775556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c0c3e92-abee-47f5-bb10-c0a73ab53386 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:00.775982 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c0c3e92-abee-47f5-bb10-c0a73ab53386 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:00.776651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c0c3e92-abee-47f5-bb10-c0a73ab53386 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:00.777094 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c0c3e92-abee-47f5-bb10-c0a73ab53386 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:00.777505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5c0c3e92-abee-47f5-bb10-c0a73ab53386 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:00.913410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5c0c3e92-abee-47f5-bb10-c0a73ab53386 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:00.921158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5c0c3e92-abee-47f5-bb10-c0a73ab53386 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.157053 Aug 24 05:32:00.921726 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1685/3258] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:00 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:01.943090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-af830e8c-131a-48ec-b24b-5f74e04fb121 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:01.943621 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-af830e8c-131a-48ec-b24b-5f74e04fb121 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:01.950026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af830e8c-131a-48ec-b24b-5f74e04fb121 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:01.950491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af830e8c-131a-48ec-b24b-5f74e04fb121 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:01.950951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af830e8c-131a-48ec-b24b-5f74e04fb121 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:01.951620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af830e8c-131a-48ec-b24b-5f74e04fb121 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:01.952062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af830e8c-131a-48ec-b24b-5f74e04fb121 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:01.952475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-af830e8c-131a-48ec-b24b-5f74e04fb121 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:02.083031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-af830e8c-131a-48ec-b24b-5f74e04fb121 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:02.090709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-af830e8c-131a-48ec-b24b-5f74e04fb121 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.151712 Aug 24 05:32:02.091276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1574/3259] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:01 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:03.111915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e6fd362b-ca46-45d6-988f-ffcdf3adaf7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:03.112520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e6fd362b-ca46-45d6-988f-ffcdf3adaf7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:03.119211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6fd362b-ca46-45d6-988f-ffcdf3adaf7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:03.119706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6fd362b-ca46-45d6-988f-ffcdf3adaf7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:03.120137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6fd362b-ca46-45d6-988f-ffcdf3adaf7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:03.120807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6fd362b-ca46-45d6-988f-ffcdf3adaf7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:03.121252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6fd362b-ca46-45d6-988f-ffcdf3adaf7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:03.121667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6fd362b-ca46-45d6-988f-ffcdf3adaf7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:03.251197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e6fd362b-ca46-45d6-988f-ffcdf3adaf7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:03.260014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e6fd362b-ca46-45d6-988f-ffcdf3adaf7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.151938 Aug 24 05:32:03.260585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1686/3260] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:03 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:04.281249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-32419134-46fb-4fb1-854b-951fbbf5bd70 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:04.281864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-32419134-46fb-4fb1-854b-951fbbf5bd70 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:04.284319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=30 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:04.290328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32419134-46fb-4fb1-854b-951fbbf5bd70 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:04.290952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32419134-46fb-4fb1-854b-951fbbf5bd70 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:04.291396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32419134-46fb-4fb1-854b-951fbbf5bd70 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:04.292089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32419134-46fb-4fb1-854b-951fbbf5bd70 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:04.292657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32419134-46fb-4fb1-854b-951fbbf5bd70 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:04.293091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-32419134-46fb-4fb1-854b-951fbbf5bd70 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:04.420939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-32419134-46fb-4fb1-854b-951fbbf5bd70 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:04.429588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-32419134-46fb-4fb1-854b-951fbbf5bd70 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.152205 Aug 24 05:32:04.430150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1575/3261] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:04 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:05.449573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a4b4df43-1310-4910-a3d2-aad4ee270b8a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:05.450190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a4b4df43-1310-4910-a3d2-aad4ee270b8a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:05.456560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b4df43-1310-4910-a3d2-aad4ee270b8a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:05.457032 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b4df43-1310-4910-a3d2-aad4ee270b8a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:05.457454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b4df43-1310-4910-a3d2-aad4ee270b8a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:05.458121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b4df43-1310-4910-a3d2-aad4ee270b8a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:05.458561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b4df43-1310-4910-a3d2-aad4ee270b8a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:05.459612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4b4df43-1310-4910-a3d2-aad4ee270b8a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:05.592798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a4b4df43-1310-4910-a3d2-aad4ee270b8a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:05.600542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a4b4df43-1310-4910-a3d2-aad4ee270b8a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.154978 Aug 24 05:32:05.601100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1687/3262] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:05 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:06.621067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-19d97f93-113f-46d8-917b-e1fa9f80d004 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:06.622085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-19d97f93-113f-46d8-917b-e1fa9f80d004 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:06.628829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19d97f93-113f-46d8-917b-e1fa9f80d004 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:06.629317 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19d97f93-113f-46d8-917b-e1fa9f80d004 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:06.629746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19d97f93-113f-46d8-917b-e1fa9f80d004 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:06.630441 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19d97f93-113f-46d8-917b-e1fa9f80d004 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:06.630920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19d97f93-113f-46d8-917b-e1fa9f80d004 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:06.631343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-19d97f93-113f-46d8-917b-e1fa9f80d004 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:06.767944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-19d97f93-113f-46d8-917b-e1fa9f80d004 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:06.776464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-19d97f93-113f-46d8-917b-e1fa9f80d004 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.159866 Aug 24 05:32:06.777025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1576/3263] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:06 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:07.797306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d5fb0f9a-c9f1-4152-a8d9-f1bd3340d61c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:07.797915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d5fb0f9a-c9f1-4152-a8d9-f1bd3340d61c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:07.800328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=26 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:07.805887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5fb0f9a-c9f1-4152-a8d9-f1bd3340d61c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:07.806361 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5fb0f9a-c9f1-4152-a8d9-f1bd3340d61c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:07.806828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5fb0f9a-c9f1-4152-a8d9-f1bd3340d61c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:07.807771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5fb0f9a-c9f1-4152-a8d9-f1bd3340d61c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:07.808221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5fb0f9a-c9f1-4152-a8d9-f1bd3340d61c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:07.808636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d5fb0f9a-c9f1-4152-a8d9-f1bd3340d61c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:07.938058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d5fb0f9a-c9f1-4152-a8d9-f1bd3340d61c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:07.945779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d5fb0f9a-c9f1-4152-a8d9-f1bd3340d61c tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.152330 Aug 24 05:32:07.946340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1688/3264] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:07 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:08.965639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f52bcfe3-83c3-4bde-8298-0cf6b80ba35b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:08.966252 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f52bcfe3-83c3-4bde-8298-0cf6b80ba35b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:08.972295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f52bcfe3-83c3-4bde-8298-0cf6b80ba35b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:08.972772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f52bcfe3-83c3-4bde-8298-0cf6b80ba35b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:08.973206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f52bcfe3-83c3-4bde-8298-0cf6b80ba35b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:08.973893 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f52bcfe3-83c3-4bde-8298-0cf6b80ba35b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:08.974346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f52bcfe3-83c3-4bde-8298-0cf6b80ba35b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:08.974800 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f52bcfe3-83c3-4bde-8298-0cf6b80ba35b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:09.101753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f52bcfe3-83c3-4bde-8298-0cf6b80ba35b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:09.109991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f52bcfe3-83c3-4bde-8298-0cf6b80ba35b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.148408 Aug 24 05:32:09.110557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1577/3265] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:08 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:10.131592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-729aed54-1fb5-41e7-aa27-20232f7ec6b9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:10.132247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-729aed54-1fb5-41e7-aa27-20232f7ec6b9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:10.138865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729aed54-1fb5-41e7-aa27-20232f7ec6b9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:10.139346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729aed54-1fb5-41e7-aa27-20232f7ec6b9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:10.139779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729aed54-1fb5-41e7-aa27-20232f7ec6b9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:10.140462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729aed54-1fb5-41e7-aa27-20232f7ec6b9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:10.140912 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729aed54-1fb5-41e7-aa27-20232f7ec6b9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:10.141335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-729aed54-1fb5-41e7-aa27-20232f7ec6b9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:10.275848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-729aed54-1fb5-41e7-aa27-20232f7ec6b9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:10.283365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-729aed54-1fb5-41e7-aa27-20232f7ec6b9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.155685 Aug 24 05:32:10.283922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1689/3266] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:10 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:11.305433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-05abcec0-b464-4a5a-a22f-3a6d29f369dc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:11.306068 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-05abcec0-b464-4a5a-a22f-3a6d29f369dc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:11.313018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05abcec0-b464-4a5a-a22f-3a6d29f369dc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:11.313492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05abcec0-b464-4a5a-a22f-3a6d29f369dc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:11.313918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05abcec0-b464-4a5a-a22f-3a6d29f369dc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:11.314592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05abcec0-b464-4a5a-a22f-3a6d29f369dc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:11.315070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05abcec0-b464-4a5a-a22f-3a6d29f369dc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:11.315490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-05abcec0-b464-4a5a-a22f-3a6d29f369dc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:11.444253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-05abcec0-b464-4a5a-a22f-3a6d29f369dc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:11.452908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-05abcec0-b464-4a5a-a22f-3a6d29f369dc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.151323 Aug 24 05:32:11.453467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1578/3267] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:11 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:12.475141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-75c7187a-5992-4ebd-a377-3e7c57fcc865 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:12.475655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-75c7187a-5992-4ebd-a377-3e7c57fcc865 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:12.483979 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75c7187a-5992-4ebd-a377-3e7c57fcc865 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:12.484466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75c7187a-5992-4ebd-a377-3e7c57fcc865 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:12.485202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75c7187a-5992-4ebd-a377-3e7c57fcc865 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:12.485925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75c7187a-5992-4ebd-a377-3e7c57fcc865 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:12.486465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75c7187a-5992-4ebd-a377-3e7c57fcc865 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:12.487102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-75c7187a-5992-4ebd-a377-3e7c57fcc865 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:12.619125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-75c7187a-5992-4ebd-a377-3e7c57fcc865 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:12.627850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-75c7187a-5992-4ebd-a377-3e7c57fcc865 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.156712 Aug 24 05:32:12.628423 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1690/3268] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:12 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:13.648454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-faf3bcf1-8771-498b-8962-b53c5f378e54 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:13.649019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-faf3bcf1-8771-498b-8962-b53c5f378e54 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:13.655729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-faf3bcf1-8771-498b-8962-b53c5f378e54 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:13.656257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-faf3bcf1-8771-498b-8962-b53c5f378e54 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:13.656689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-faf3bcf1-8771-498b-8962-b53c5f378e54 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:13.657412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-faf3bcf1-8771-498b-8962-b53c5f378e54 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:13.657871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-faf3bcf1-8771-498b-8962-b53c5f378e54 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:13.658372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-faf3bcf1-8771-498b-8962-b53c5f378e54 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:13.797788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-faf3bcf1-8771-498b-8962-b53c5f378e54 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:13.805541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-faf3bcf1-8771-498b-8962-b53c5f378e54 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.161144 Aug 24 05:32:13.806104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1579/3269] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:13 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:13.867054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-a77715ea-4079-4e71-bbf3-fcc44d025d08 req-435af9b9-1e82-40bd-bbd5-210bbfc88353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb9a2e3-49ff-4ce5-9009-4dbbdedaa574", "name": "network-vif-plugged", "status": "completed", "tag": "fe225cc9-367b-4a79-bdcf-67de3b667c45"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:32:13.882491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-a77715ea-4079-4e71-bbf3-fcc44d025d08 req-435af9b9-1e82-40bd-bbd5-210bbfc88353 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:13.882990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-a77715ea-4079-4e71-bbf3-fcc44d025d08 req-435af9b9-1e82-40bd-bbd5-210bbfc88353 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:13.883422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-a77715ea-4079-4e71-bbf3-fcc44d025d08 req-435af9b9-1e82-40bd-bbd5-210bbfc88353 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:13.894949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-a77715ea-4079-4e71-bbf3-fcc44d025d08 req-435af9b9-1e82-40bd-bbd5-210bbfc88353 service nova] Creating event network-vif-plugged:fe225cc9-367b-4a79-bdcf-67de3b667c45 for instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 on hv-cinder-85426 Aug 24 05:32:13.900188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-a77715ea-4079-4e71-bbf3-fcc44d025d08 req-435af9b9-1e82-40bd-bbd5-210bbfc88353 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036799 Aug 24 05:32:13.900839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1691/3270] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:32:14.826814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c7461748-6a3d-4c88-a01c-0bb47ff06202 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:14.827430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c7461748-6a3d-4c88-a01c-0bb47ff06202 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:14.833538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7461748-6a3d-4c88-a01c-0bb47ff06202 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:14.834020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7461748-6a3d-4c88-a01c-0bb47ff06202 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:14.834454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7461748-6a3d-4c88-a01c-0bb47ff06202 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:14.835173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7461748-6a3d-4c88-a01c-0bb47ff06202 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:14.835629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7461748-6a3d-4c88-a01c-0bb47ff06202 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:14.836047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c7461748-6a3d-4c88-a01c-0bb47ff06202 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:14.973498 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c7461748-6a3d-4c88-a01c-0bb47ff06202 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:14.981346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c7461748-6a3d-4c88-a01c-0bb47ff06202 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1358 microversion: 2.1 time: 0.158866 Aug 24 05:32:14.982037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1580/3271] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:14 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:16.004071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fbe594af-a0d6-4cc7-b8f8-2256849a42dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:16.005235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fbe594af-a0d6-4cc7-b8f8-2256849a42dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:16.012116 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbe594af-a0d6-4cc7-b8f8-2256849a42dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:16.012678 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbe594af-a0d6-4cc7-b8f8-2256849a42dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:16.013671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbe594af-a0d6-4cc7-b8f8-2256849a42dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:16.014372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbe594af-a0d6-4cc7-b8f8-2256849a42dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:16.014861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbe594af-a0d6-4cc7-b8f8-2256849a42dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:16.015284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fbe594af-a0d6-4cc7-b8f8-2256849a42dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:16.145816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fbe594af-a0d6-4cc7-b8f8-2256849a42dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:16.153704 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fbe594af-a0d6-4cc7-b8f8-2256849a42dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1548 microversion: 2.1 time: 0.154862 Aug 24 05:32:16.154271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1692/3272] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:15 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:16.173691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fd6573e7-69e0-4108-a226-9d88461921ea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:16.174333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fd6573e7-69e0-4108-a226-9d88461921ea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:16.180680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd6573e7-69e0-4108-a226-9d88461921ea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:16.181161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd6573e7-69e0-4108-a226-9d88461921ea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:16.181599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd6573e7-69e0-4108-a226-9d88461921ea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:16.182277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd6573e7-69e0-4108-a226-9d88461921ea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:16.183024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd6573e7-69e0-4108-a226-9d88461921ea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:16.183449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd6573e7-69e0-4108-a226-9d88461921ea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:16.327622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fd6573e7-69e0-4108-a226-9d88461921ea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:16.336003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fd6573e7-69e0-4108-a226-9d88461921ea tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1548 microversion: 2.1 time: 0.166334 Aug 24 05:32:16.336562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1581/3273] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:16 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:16.356019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:16.360687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:16.361436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Searching by: {'deleted': False, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47'} {{(pid=120558) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 05:32:16.367975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:16.368442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:16.368867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:16.369575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:16.370020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:16.370434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:16.458121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.multi_cell_list [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120558) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 05:32:16.553120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-293566c0-6e91-4d49-87b4-ca8a900bc3ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200666 Aug 24 05:32:16.553618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1693/3274] 10.222.0.97 () {58 vars in 1125 bytes} [Wed Aug 24 05:32:16 2022] GET /compute/v2.1/servers => generated 342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:32:16.565588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-58e78832-6e60-488e-b6ac-c25da8f656e4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:16.566202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-58e78832-6e60-488e-b6ac-c25da8f656e4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:16.572176 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58e78832-6e60-488e-b6ac-c25da8f656e4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:16.572656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58e78832-6e60-488e-b6ac-c25da8f656e4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:16.573094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58e78832-6e60-488e-b6ac-c25da8f656e4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:16.573776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58e78832-6e60-488e-b6ac-c25da8f656e4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:16.574228 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58e78832-6e60-488e-b6ac-c25da8f656e4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:16.574643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-58e78832-6e60-488e-b6ac-c25da8f656e4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:16.708843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-58e78832-6e60-488e-b6ac-c25da8f656e4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:16.716495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-58e78832-6e60-488e-b6ac-c25da8f656e4 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1548 microversion: 2.1 time: 0.154783 Aug 24 05:32:16.717054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1582/3275] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:16 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:18.276386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-25ce5a8e-3077-4b34-bd99-de5c49db5047 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a86bd392-c592-4e30-a351-79ae086946c3"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:32:18.278587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-25ce5a8e-3077-4b34-bd99-de5c49db5047 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:18.285662 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25ce5a8e-3077-4b34-bd99-de5c49db5047 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:18.286141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25ce5a8e-3077-4b34-bd99-de5c49db5047 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:18.286576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25ce5a8e-3077-4b34-bd99-de5c49db5047 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:18.287291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25ce5a8e-3077-4b34-bd99-de5c49db5047 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:18.287738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25ce5a8e-3077-4b34-bd99-de5c49db5047 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:18.288158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-25ce5a8e-3077-4b34-bd99-de5c49db5047 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:18.580926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-25ce5a8e-3077-4b34-bd99-de5c49db5047 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "POST /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308387 Aug 24 05:32:18.581553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1694/3276] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 05:32:18 2022] POST /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:32:26.183628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c4dbba21-5e4e-48c3-a18e-ff35518a0e57 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:26.184241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c4dbba21-5e4e-48c3-a18e-ff35518a0e57 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:26.191743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4dbba21-5e4e-48c3-a18e-ff35518a0e57 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:26.192226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4dbba21-5e4e-48c3-a18e-ff35518a0e57 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:26.192664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4dbba21-5e4e-48c3-a18e-ff35518a0e57 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:26.193348 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4dbba21-5e4e-48c3-a18e-ff35518a0e57 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:26.193807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4dbba21-5e4e-48c3-a18e-ff35518a0e57 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:26.194227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c4dbba21-5e4e-48c3-a18e-ff35518a0e57 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:26.196830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=89 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:26.325150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c4dbba21-5e4e-48c3-a18e-ff35518a0e57 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:26.333601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c4dbba21-5e4e-48c3-a18e-ff35518a0e57 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1594 microversion: 2.1 time: 0.154061 Aug 24 05:32:26.334164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1583/3277] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:26 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:32:28.314385 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:28.315234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=13 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:28.320000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-b98453eb-4d44-4914-ad33-958fff6995f1 req-e22402a7-3264-4b3c-b57f-cf947cd99524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb9a2e3-49ff-4ce5-9009-4dbbdedaa574", "tag": "fe225cc9-367b-4a79-bdcf-67de3b667c45"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:32:28.332628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-b98453eb-4d44-4914-ad33-958fff6995f1 req-e22402a7-3264-4b3c-b57f-cf947cd99524 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:28.333274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-b98453eb-4d44-4914-ad33-958fff6995f1 req-e22402a7-3264-4b3c-b57f-cf947cd99524 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:28.333829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-b98453eb-4d44-4914-ad33-958fff6995f1 req-e22402a7-3264-4b3c-b57f-cf947cd99524 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:28.346279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-b98453eb-4d44-4914-ad33-958fff6995f1 req-e22402a7-3264-4b3c-b57f-cf947cd99524 service nova] Creating event network-changed:fe225cc9-367b-4a79-bdcf-67de3b667c45 for instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 on hv-cinder-85426 Aug 24 05:32:28.352255 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-b98453eb-4d44-4914-ad33-958fff6995f1 req-e22402a7-3264-4b3c-b57f-cf947cd99524 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039726 Aug 24 05:32:28.356492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1695/3278] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:32:29.500521 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8bb27829-4ec9-41d5-8c57-09ea3ac73d53 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-847934577"}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:32:29.501453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8bb27829-4ec9-41d5-8c57-09ea3ac73d53 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:29.514223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bb27829-4ec9-41d5-8c57-09ea3ac73d53 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:29.514838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bb27829-4ec9-41d5-8c57-09ea3ac73d53 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:29.515350 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bb27829-4ec9-41d5-8c57-09ea3ac73d53 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:29.516135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bb27829-4ec9-41d5-8c57-09ea3ac73d53 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:29.517299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bb27829-4ec9-41d5-8c57-09ea3ac73d53 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:29.518088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bb27829-4ec9-41d5-8c57-09ea3ac73d53 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:29.675527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.network.security_group_api [None req-8bb27829-4ec9-41d5-8c57-09ea3ac73d53 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Adding security group c03b451f-825a-43fe-bf1b-22a156dd7d93 to port fe225cc9-367b-4a79-bdcf-67de3b667c45 Aug 24 05:32:30.022274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8bb27829-4ec9-41d5-8c57-09ea3ac73d53 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "POST /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/action" status: 202 len: 0 microversion: 2.1 time: 0.526793 Aug 24 05:32:30.022916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1584/3279] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 05:32:29 2022] POST /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:32:30.031792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9fbee430-ddac-47ce-8bb4-e34d6cc497dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:32:30.033312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9fbee430-ddac-47ce-8bb4-e34d6cc497dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:32:30.039516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fbee430-ddac-47ce-8bb4-e34d6cc497dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:30.040060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fbee430-ddac-47ce-8bb4-e34d6cc497dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:30.040485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fbee430-ddac-47ce-8bb4-e34d6cc497dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:30.041189 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fbee430-ddac-47ce-8bb4-e34d6cc497dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:30.041635 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fbee430-ddac-47ce-8bb4-e34d6cc497dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:30.042050 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9fbee430-ddac-47ce-8bb4-e34d6cc497dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:30.043201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-4fa9dbc7-a96d-4520-ad1a-4c7eb93520ef req-4496c11b-298c-4af0-aa35-ab1558e5554e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb9a2e3-49ff-4ce5-9009-4dbbdedaa574", "tag": "fe225cc9-367b-4a79-bdcf-67de3b667c45"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:32:30.046721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:32:30.053812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-4fa9dbc7-a96d-4520-ad1a-4c7eb93520ef req-4496c11b-298c-4af0-aa35-ab1558e5554e service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:32:30.055178 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-4fa9dbc7-a96d-4520-ad1a-4c7eb93520ef req-4496c11b-298c-4af0-aa35-ab1558e5554e service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:32:30.055811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-4fa9dbc7-a96d-4520-ad1a-4c7eb93520ef req-4496c11b-298c-4af0-aa35-ab1558e5554e service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:32:30.068669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-4fa9dbc7-a96d-4520-ad1a-4c7eb93520ef req-4496c11b-298c-4af0-aa35-ab1558e5554e service nova] Creating event network-changed:fe225cc9-367b-4a79-bdcf-67de3b667c45 for instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 on hv-cinder-85426 Aug 24 05:32:30.075352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-4fa9dbc7-a96d-4520-ad1a-4c7eb93520ef req-4496c11b-298c-4af0-aa35-ab1558e5554e service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036488 Aug 24 05:32:30.076509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1585/3280] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:32:30.218254 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9fbee430-ddac-47ce-8bb4-e34d6cc497dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:32:30.226909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9fbee430-ddac-47ce-8bb4-e34d6cc497dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1758 microversion: 2.1 time: 0.199630 Aug 24 05:32:30.228040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1696/3281] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:32:30 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:10.564770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=21 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:10.565503 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=11 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:10.569579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b64ead94-6174-4ffd-8aa3-677035e99329 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:10.570166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b64ead94-6174-4ffd-8aa3-677035e99329 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:10.577048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64ead94-6174-4ffd-8aa3-677035e99329 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:10.577523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64ead94-6174-4ffd-8aa3-677035e99329 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:10.577953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64ead94-6174-4ffd-8aa3-677035e99329 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:10.578625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64ead94-6174-4ffd-8aa3-677035e99329 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:10.579098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64ead94-6174-4ffd-8aa3-677035e99329 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:10.579514 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b64ead94-6174-4ffd-8aa3-677035e99329 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:10.603151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b64ead94-6174-4ffd-8aa3-677035e99329 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/ips" status: 200 len: 153 microversion: 2.20 time: 0.040219 Aug 24 05:33:10.603715 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1586/3282] 10.222.0.97 () {60 vars in 1289 bytes} [Wed Aug 24 05:33:10 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/ips => generated 153 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:33:12.590627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-834b8342-e704-4e0b-ba92-b88befa8f858 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:12.591218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-834b8342-e704-4e0b-ba92-b88befa8f858 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:12.593560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=4 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:12.594200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=5 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:12.599879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-834b8342-e704-4e0b-ba92-b88befa8f858 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:12.600355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-834b8342-e704-4e0b-ba92-b88befa8f858 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:12.600783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-834b8342-e704-4e0b-ba92-b88befa8f858 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:12.601463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-834b8342-e704-4e0b-ba92-b88befa8f858 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:12.601935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-834b8342-e704-4e0b-ba92-b88befa8f858 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:12.602322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-834b8342-e704-4e0b-ba92-b88befa8f858 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:12.625348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-834b8342-e704-4e0b-ba92-b88befa8f858 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lazy-loading 'flavor' on Instance uuid 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:33:12.811218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-834b8342-e704-4e0b-ba92-b88befa8f858 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "POST /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/action" status: 202 len: 0 microversion: 2.20 time: 0.224240 Aug 24 05:33:12.811905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1697/3283] 10.222.0.97 () {62 vars in 1319 bytes} [Wed Aug 24 05:33:12 2022] POST /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 24 05:33:12.820839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:12.821452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:12.827892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:12.828422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:12.828896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:12.829665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:12.830122 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:12.830548 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:12.968869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:12.977674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:12.979219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:12.980374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0e3888a5-454d-4ada-b18c-1b1391fe7a76 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.164133 Aug 24 05:33:12.980928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1587/3284] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:12 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:14.005469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:14.006166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:14.013208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:14.013687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:14.014118 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:14.014864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:14.015310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:14.015729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:14.148748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:14.156797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:14.158288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:14.159451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-372a98f1-f8ef-4b49-b5dc-be8071af1c62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.158865 Aug 24 05:33:14.160010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1698/3285] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:13 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:15.181988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:15.182532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:15.189324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:15.189803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:15.190236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:15.190951 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:15.191407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:15.192375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:15.323203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:15.331378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:15.333608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:15.334779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c8020a16-e395-455e-a1f0-66b8c85c8e01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.157293 Aug 24 05:33:15.335326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1588/3286] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:15 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:16.358289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:16.358916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:16.365782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:16.366263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:16.366722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:16.367408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:16.367857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:16.368278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:16.497696 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:16.505819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:16.507345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:16.508488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f1de8a39-2e88-419d-b08d-d4b6c7f8787c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.154127 Aug 24 05:33:16.509043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1699/3287] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:16 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:17.530998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:17.531634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:17.538151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:17.538623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:17.539094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:17.539773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:17.540217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:17.540636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:17.671629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:17.680576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:17.682080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:17.683525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-637a5e41-39a0-437b-a4a9-4eb00e893f1d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.156451 Aug 24 05:33:17.684074 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1589/3288] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:17 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:18.706538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:18.707240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:18.713812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:18.714288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:18.714739 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:18.715422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:18.715870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:18.716290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:18.848875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:18.857135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:18.858629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:18.859796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-290665e0-0636-4ffc-84fc-9c14384a4c4c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.157160 Aug 24 05:33:18.860357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1700/3289] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:18 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:19.883000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:19.883604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:19.890055 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:19.890530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:19.890997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:19.891672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:19.892114 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:19.892531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:20.021660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:20.029878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:20.031443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:20.032572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3c473408-6107-4956-b418-68472556cec3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.154130 Aug 24 05:33:20.033115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1590/3290] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:19 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:20.343534 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a8cbbcc9-e0e6-4dd9-b768-22e117d05a8b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:20.344030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a8cbbcc9-e0e6-4dd9-b768-22e117d05a8b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:20.350520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8cbbcc9-e0e6-4dd9-b768-22e117d05a8b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:20.351026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8cbbcc9-e0e6-4dd9-b768-22e117d05a8b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:20.351460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8cbbcc9-e0e6-4dd9-b768-22e117d05a8b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:20.352136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8cbbcc9-e0e6-4dd9-b768-22e117d05a8b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:20.352582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8cbbcc9-e0e6-4dd9-b768-22e117d05a8b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:20.352999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8cbbcc9-e0e6-4dd9-b768-22e117d05a8b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:20.376584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a8cbbcc9-e0e6-4dd9-b768-22e117d05a8b tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/ips" status: 200 len: 149 microversion: 2.1 time: 0.284383 Aug 24 05:33:20.377140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1701/3291] 10.222.0.97 () {58 vars in 1248 bytes} [Wed Aug 24 05:33:20 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/ips => generated 149 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:33:21.055608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:21.056219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:21.062987 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:21.063466 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:21.063904 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:21.064581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:21.065034 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:21.065455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:21.197799 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:21.206136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:21.207832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:21.209006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2afd7dc9-1bad-4d09-a97f-88967999c3af tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.157822 Aug 24 05:33:21.209558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1591/3292] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:21 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:21.701844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a987d0b0-f4c7-4b37-b6c6-fd24bce84c91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65527666-0a29-44f8-8800-6938e602a4ee"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:21.704527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a987d0b0-f4c7-4b37-b6c6-fd24bce84c91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:21.712019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a987d0b0-f4c7-4b37-b6c6-fd24bce84c91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:21.712491 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a987d0b0-f4c7-4b37-b6c6-fd24bce84c91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:21.712951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a987d0b0-f4c7-4b37-b6c6-fd24bce84c91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:21.713636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a987d0b0-f4c7-4b37-b6c6-fd24bce84c91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:21.714080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a987d0b0-f4c7-4b37-b6c6-fd24bce84c91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:21.714503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a987d0b0-f4c7-4b37-b6c6-fd24bce84c91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:21.975008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a987d0b0-f4c7-4b37-b6c6-fd24bce84c91 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "POST /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276941 Aug 24 05:33:21.975611 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1702/3293] 10.222.0.97 () {60 vars in 1323 bytes} [Wed Aug 24 05:33:21 2022] POST /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:33:22.231760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:22.232364 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:22.238811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:22.239949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:22.240445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:22.241130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:22.241582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:22.242005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:22.370295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:22.378474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:22.380684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:22.381842 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2cb644ac-73c5-48ad-9413-a0b83291bda6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.154045 Aug 24 05:33:22.382397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1592/3294] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:22 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:33:23.405760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:23.406391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:23.413110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:23.413578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:23.414003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:23.414672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:23.415133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:23.415544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:23.547246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:23.556029 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:23.557508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:23.558925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-679dfa46-6150-4351-a849-cf93ef4e9286 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.158134 Aug 24 05:33:23.559482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1703/3295] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:23 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:24.581815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:24.582426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:24.588950 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:24.589432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:24.589864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:24.590546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:24.591028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:24.591459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:24.718346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:24.727094 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:24.728594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:24.729753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5044b49e-4eb9-4b58-bdff-6f708a9c05a4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.151925 Aug 24 05:33:24.730310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1593/3296] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:24 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:25.753233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:25.753839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:25.760910 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:25.761387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:25.761817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:25.762494 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:25.762962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:25.763381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:25.890596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:25.899683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:25.901186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:25.902353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5ee536c5-5fe0-412a-862f-4b8eda6a6ef8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1747 microversion: 2.20 time: 0.153101 Aug 24 05:33:25.902952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1704/3297] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:25 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1747 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:33:26.925843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:26.926480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:26.933924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:26.934405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:26.934873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:26.935559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:26.936010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:26.936431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:27.068534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:27.076719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:27.078223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:27.079422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a25f5ff0-bf46-40df-8399-e90ecc94c165 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1747 microversion: 2.20 time: 0.157520 Aug 24 05:33:27.079991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1594/3298] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:26 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:28.103364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:28.103975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:28.110377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:28.110893 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:28.111331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:28.112014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:28.112463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:28.112883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:28.249036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:28.257372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:28.259015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:28.260313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a098c616-018c-4583-8fab-7733046d669a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1747 microversion: 2.20 time: 0.162560 Aug 24 05:33:28.261046 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1705/3299] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:28 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1747 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:29.283927 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:29.284443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:29.290907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:29.291373 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:29.291795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:29.292459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:29.292903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:29.293340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:29.421885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:29.430511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:29.432044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:29.434309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5f2493cc-3313-412b-ad7e-65e902c91764 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1747 microversion: 2.20 time: 0.154320 Aug 24 05:33:29.435183 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1595/3300] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:29 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:29.593252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2e446bc3-476d-45fc-96e8-1490fc502544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:29.594048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2e446bc3-476d-45fc-96e8-1490fc502544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:29.601761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e446bc3-476d-45fc-96e8-1490fc502544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:29.602233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e446bc3-476d-45fc-96e8-1490fc502544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:29.602771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e446bc3-476d-45fc-96e8-1490fc502544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:29.603375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e446bc3-476d-45fc-96e8-1490fc502544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:29.603813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e446bc3-476d-45fc-96e8-1490fc502544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:29.604257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2e446bc3-476d-45fc-96e8-1490fc502544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:29.683505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-2e446bc3-476d-45fc-96e8-1490fc502544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'services' on Instance uuid 34713cf1-5790-4036-bd9d-e127e3957b1c {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:33:29.754851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2e446bc3-476d-45fc-96e8-1490fc502544 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-volume_attachments/65527666-0a29-44f8-8800-6938e602a4ee" status: 202 len: 0 microversion: 2.1 time: 0.166029 Aug 24 05:33:29.755445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1706/3301] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:33:29 2022] DELETE /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-volume_attachments/65527666-0a29-44f8-8800-6938e602a4ee => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:33:29.764827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c2f0d21d-ceb3-430b-912f-6efb1f69b136 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:29.767006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c2f0d21d-ceb3-430b-912f-6efb1f69b136 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:29.773271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2f0d21d-ceb3-430b-912f-6efb1f69b136 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:29.773790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2f0d21d-ceb3-430b-912f-6efb1f69b136 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:29.774227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2f0d21d-ceb3-430b-912f-6efb1f69b136 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:29.775031 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2f0d21d-ceb3-430b-912f-6efb1f69b136 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:29.775482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2f0d21d-ceb3-430b-912f-6efb1f69b136 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:29.775903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2f0d21d-ceb3-430b-912f-6efb1f69b136 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:29.806131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c2f0d21d-ceb3-430b-912f-6efb1f69b136 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045503 Aug 24 05:33:29.806594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1596/3302] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:33:29 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:33:30.142072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-2c2df5c4-1722-4f7a-91ad-ccb4fc708f3e req-2f1a5dfb-6396-487b-bb3e-d1ce00bc1821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342b0ec6-3c25-4b72-bcb1-88878f3d85e8", "name": "network-vif-plugged", "status": "completed", "tag": "e783a71b-b500-4cdb-96c0-ecd825b2a9c5"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:30.152362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-2c2df5c4-1722-4f7a-91ad-ccb4fc708f3e req-2f1a5dfb-6396-487b-bb3e-d1ce00bc1821 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:30.152841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-2c2df5c4-1722-4f7a-91ad-ccb4fc708f3e req-2f1a5dfb-6396-487b-bb3e-d1ce00bc1821 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:30.153279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-2c2df5c4-1722-4f7a-91ad-ccb4fc708f3e req-2f1a5dfb-6396-487b-bb3e-d1ce00bc1821 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:30.164894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-2c2df5c4-1722-4f7a-91ad-ccb4fc708f3e req-2f1a5dfb-6396-487b-bb3e-d1ce00bc1821 service nova] Creating event network-vif-plugged:e783a71b-b500-4cdb-96c0-ecd825b2a9c5 for instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 on hv-cinder-85426 Aug 24 05:33:30.169642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-2c2df5c4-1722-4f7a-91ad-ccb4fc708f3e req-2f1a5dfb-6396-487b-bb3e-d1ce00bc1821 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031704 Aug 24 05:33:30.170234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1707/3303] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:33:30.457331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:30.457929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:30.464481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:30.464956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:30.465425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:30.466101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:30.466546 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:30.467013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:30.605319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:30.613910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:30.616383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:30.617580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d1be6064-17bf-4df9-be18-79e1b5f8d738 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1747 microversion: 2.20 time: 0.164190 Aug 24 05:33:30.618144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1597/3304] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:30 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1747 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:30.820060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b11021d0-9467-4b10-b67c-7b5931f058b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:30.822409 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b11021d0-9467-4b10-b67c-7b5931f058b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:30.828651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b11021d0-9467-4b10-b67c-7b5931f058b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:30.829136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b11021d0-9467-4b10-b67c-7b5931f058b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:30.829565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b11021d0-9467-4b10-b67c-7b5931f058b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:30.830246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b11021d0-9467-4b10-b67c-7b5931f058b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:30.830742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b11021d0-9467-4b10-b67c-7b5931f058b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:30.831159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b11021d0-9467-4b10-b67c-7b5931f058b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:30.861750 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b11021d0-9467-4b10-b67c-7b5931f058b2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047142 Aug 24 05:33:30.862297 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1708/3305] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:33:30 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:33:31.641397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:31.642006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:31.648787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:31.649265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:31.649703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:31.650385 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:31.650873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:31.651296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:31.784200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:31.792614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:31.794140 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:31.795323 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0ab69dfb-57b6-463c-a924-c3df3150e725 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1747 microversion: 2.20 time: 0.157834 Aug 24 05:33:31.795877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1598/3306] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:31 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:31.873775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2bf5303b-8c46-4545-9070-1204b2c1c542 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:31.875909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2bf5303b-8c46-4545-9070-1204b2c1c542 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:31.883349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf5303b-8c46-4545-9070-1204b2c1c542 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:31.883821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf5303b-8c46-4545-9070-1204b2c1c542 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:31.884248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf5303b-8c46-4545-9070-1204b2c1c542 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:31.884915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf5303b-8c46-4545-9070-1204b2c1c542 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:31.885354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf5303b-8c46-4545-9070-1204b2c1c542 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:31.885763 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2bf5303b-8c46-4545-9070-1204b2c1c542 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:31.919802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2bf5303b-8c46-4545-9070-1204b2c1c542 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049765 Aug 24 05:33:31.920273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1709/3307] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:33:31 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:33:31.982218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6d5b8237-ec2b-4a9d-9af4-3472eb793663 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:31.982734 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6d5b8237-ec2b-4a9d-9af4-3472eb793663 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:31.988560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d5b8237-ec2b-4a9d-9af4-3472eb793663 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:31.989050 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d5b8237-ec2b-4a9d-9af4-3472eb793663 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:31.989458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d5b8237-ec2b-4a9d-9af4-3472eb793663 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:31.990895 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d5b8237-ec2b-4a9d-9af4-3472eb793663 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:31.991558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d5b8237-ec2b-4a9d-9af4-3472eb793663 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:31.991977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6d5b8237-ec2b-4a9d-9af4-3472eb793663 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:32.017219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6d5b8237-ec2b-4a9d-9af4-3472eb793663 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Going to try to terminate instance {{(pid=120557) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:33:32.095532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6d5b8237-ec2b-4a9d-9af4-3472eb793663 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 204 len: 0 microversion: 2.1 time: 0.116750 Aug 24 05:33:32.096119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1599/3308] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:33:31 2022] DELETE /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:32.105075 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bc2d5f0e-c481-49c0-8106-feaa6079150e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:32.105685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bc2d5f0e-c481-49c0-8106-feaa6079150e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:32.111599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc2d5f0e-c481-49c0-8106-feaa6079150e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:32.112070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc2d5f0e-c481-49c0-8106-feaa6079150e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:32.112499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc2d5f0e-c481-49c0-8106-feaa6079150e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:32.113179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc2d5f0e-c481-49c0-8106-feaa6079150e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:32.113625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc2d5f0e-c481-49c0-8106-feaa6079150e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:32.114041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bc2d5f0e-c481-49c0-8106-feaa6079150e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:32.131995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:32.249073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bc2d5f0e-c481-49c0-8106-feaa6079150e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:32.257632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bc2d5f0e-c481-49c0-8106-feaa6079150e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1681 microversion: 2.1 time: 0.156365 Aug 24 05:33:32.258201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1710/3309] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:32 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:32.820490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:32.821370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:32.829000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:32.829483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:32.829921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:32.830612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:32.831095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:32.831518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:32.962322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:32.970558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:32.972097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:32.973246 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b7be4ca7-cce3-4a38-b094-fd0ae89e4f53 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1747 microversion: 2.20 time: 0.158081 Aug 24 05:33:32.973791 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1600/3310] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:32 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1747 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:33.280044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bd2c9f00-429f-4032-8fe0-92a9a3acf08d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:33.280656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-bd2c9f00-429f-4032-8fe0-92a9a3acf08d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:33.287865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd2c9f00-429f-4032-8fe0-92a9a3acf08d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:33.288330 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd2c9f00-429f-4032-8fe0-92a9a3acf08d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:33.288757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd2c9f00-429f-4032-8fe0-92a9a3acf08d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:33.289620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd2c9f00-429f-4032-8fe0-92a9a3acf08d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:33.290065 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd2c9f00-429f-4032-8fe0-92a9a3acf08d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:33.290480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-bd2c9f00-429f-4032-8fe0-92a9a3acf08d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:33.419509 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-bd2c9f00-429f-4032-8fe0-92a9a3acf08d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:33.427009 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bd2c9f00-429f-4032-8fe0-92a9a3acf08d tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1681 microversion: 2.1 time: 0.150849 Aug 24 05:33:33.428154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1711/3311] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:33 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:33.996614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:33.998844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:34.005910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:34.006620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:34.007299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:34.008184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:34.008649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:34.009076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:34.013509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:34.218955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:34.228712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:34.230278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:34.231522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cb8f73b8-9e46-41a0-9f9c-3f183b0bb3fb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.238729 Aug 24 05:33:34.232270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1601/3312] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:33 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:34.449553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-af444dc2-4c3a-4327-9941-7dca2f7cdb0c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:34.450190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-af444dc2-4c3a-4327-9941-7dca2f7cdb0c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:34.456732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af444dc2-4c3a-4327-9941-7dca2f7cdb0c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:34.457243 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af444dc2-4c3a-4327-9941-7dca2f7cdb0c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:34.457683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af444dc2-4c3a-4327-9941-7dca2f7cdb0c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:34.458421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af444dc2-4c3a-4327-9941-7dca2f7cdb0c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:34.459546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af444dc2-4c3a-4327-9941-7dca2f7cdb0c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:34.460135 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af444dc2-4c3a-4327-9941-7dca2f7cdb0c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:34.624489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-af444dc2-4c3a-4327-9941-7dca2f7cdb0c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:34.635856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-af444dc2-4c3a-4327-9941-7dca2f7cdb0c tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1681 microversion: 2.1 time: 0.189749 Aug 24 05:33:34.637548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1712/3313] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:34 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:35.258610 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:35.259324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:35.265567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:35.266268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:35.266900 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:35.267587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:35.268190 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:35.268609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:35.607376 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:35.617033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:35.618905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:35.622093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5026dfd0-6c0a-4f40-a786-e3e1f8d636bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.367937 Aug 24 05:33:35.623330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1602/3314] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:35 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:35.657484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b0939925-af13-4c22-b2ec-e6ad3e3da835 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:35.658784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b0939925-af13-4c22-b2ec-e6ad3e3da835 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:35.668975 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0939925-af13-4c22-b2ec-e6ad3e3da835 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:35.669621 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0939925-af13-4c22-b2ec-e6ad3e3da835 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:35.670355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0939925-af13-4c22-b2ec-e6ad3e3da835 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:35.671413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0939925-af13-4c22-b2ec-e6ad3e3da835 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:35.672014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0939925-af13-4c22-b2ec-e6ad3e3da835 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:35.672618 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b0939925-af13-4c22-b2ec-e6ad3e3da835 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:35.797580 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b0939925-af13-4c22-b2ec-e6ad3e3da835 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:35.806120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b0939925-af13-4c22-b2ec-e6ad3e3da835 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1613 microversion: 2.1 time: 0.152387 Aug 24 05:33:35.806447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1713/3315] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:35 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1613 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:36.179393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-65c7fff7-3099-4516-9504-84abc0fedb6d req-e28fd16d-d239-4cf7-a536-ccc27c248d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34713cf1-5790-4036-bd9d-e127e3957b1c", "name": "network-vif-deleted", "tag": "2c0fe4f3-d326-448a-92a9-52b3b0c9c901"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:36.192670 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-65c7fff7-3099-4516-9504-84abc0fedb6d req-e28fd16d-d239-4cf7-a536-ccc27c248d52 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:36.193776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-65c7fff7-3099-4516-9504-84abc0fedb6d req-e28fd16d-d239-4cf7-a536-ccc27c248d52 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:36.194148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-65c7fff7-3099-4516-9504-84abc0fedb6d req-e28fd16d-d239-4cf7-a536-ccc27c248d52 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:36.207109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-65c7fff7-3099-4516-9504-84abc0fedb6d req-e28fd16d-d239-4cf7-a536-ccc27c248d52 service nova] Creating event network-vif-deleted:2c0fe4f3-d326-448a-92a9-52b3b0c9c901 for instance 34713cf1-5790-4036-bd9d-e127e3957b1c on hv-cinder-85426 Aug 24 05:33:36.213471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-65c7fff7-3099-4516-9504-84abc0fedb6d req-e28fd16d-d239-4cf7-a536-ccc27c248d52 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037981 Aug 24 05:33:36.214073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1603/3316] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:33:36.651805 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:36.652888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:36.660486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:36.661762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:36.663156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:36.664085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:36.664737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:36.665367 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:36.831100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:36.832680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:36.847920 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:36.861310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:36.863792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:36.864481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:36.866584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:36.871476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:36.872210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:36.877547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:36.881579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:36.882870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e6e6236b-98e6-46de-ac41-89b0c14589bd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.237821 Aug 24 05:33:36.886777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1714/3317] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:36 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:36.943850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:36.945192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:36.945868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:36.946482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lazy-loading 'fault' on Instance uuid 34713cf1-5790-4036-bd9d-e127e3957b1c {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:33:36.993697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4bc6971289b943aebec90909ffb8096a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42f2c35fc0e4453eba1a25d2b6311bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:37.004269 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-579f38da-f2ae-424e-8975-8ef6760c60ee tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 200 len: 1331 microversion: 2.1 time: 0.178500 Aug 24 05:33:37.005471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1604/3318] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:36 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 1331 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:37.918538 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:37.920121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:37.928834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:37.930056 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:37.930728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:37.931537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:37.932198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:37.932826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:38.032976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:38.034208 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:38.041329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:38.042038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:38.042643 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:38.043518 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:38.044181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:38.044754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:38.062810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c HTTP/1.1 Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:33:38.064758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:38.066217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '34713cf1-5790-4036-bd9d-e127e3957b1c'} Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:38.067082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:38.068943 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:38.070073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:38.070073 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-03e36f3e-8e17-44a4-88a6-561d9ea3b5f8 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 404 len: 111 microversion: 2.1 time: 0.043263 Aug 24 05:33:38.070886 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1605/3319] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:38 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:33:38.075635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-67fd198b-d73c-4e63-8ece-09f9528c486e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '.version_select at 0x7f359013d9d0>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:38.088676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:38.098967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-67fd198b-d73c-4e63-8ece-09f9528c486e tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-261288509" status: 202 len: 0 microversion: 2.1 time: 0.026726 Aug 24 05:33:38.099889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1606/3320] 10.222.0.97 () {58 vars in 1218 bytes} [Wed Aug 24 05:33:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-261288509 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:33:38.100885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:38.103368 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:38.105634 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2eb3e3e7-c4a9-4e0c-8050-7035986ef3d3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.190909 Aug 24 05:33:38.118940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1715/3321] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:37 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:33:39.133174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:39.133703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:39.140764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:39.141248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:39.141942 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:39.142631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:39.143184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:39.143607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:39.271955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:39.280939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:39.282632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:39.283853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7da89070-6424-4c70-bfb7-67b046f19ac7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.155185 Aug 24 05:33:39.284399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1607/3322] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:39 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:39.924743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:39.925977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:39.933843 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:39.934413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:39.935201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:39.936248 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:39.936793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:39.937277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:39.952156 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c HTTP/1.1 Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:33:39.953802 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:39.955003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '34713cf1-5790-4036-bd9d-e127e3957b1c'} Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:39.955578 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:39.956550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:39.957510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:39.957510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e5a07580-d4e2-4565-889a-c28a2d6b70ad tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 404 len: 111 microversion: 2.1 time: 0.034234 Aug 24 05:33:39.957510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1716/3323] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:33:39 2022] DELETE /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:33:39.965275 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:39.965882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 34713cf1-5790-4036-bd9d-e127e3957b1c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:39.972582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:39.973060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:39.973485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:39.974169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:39.974612 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:39.975737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:39.992510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c HTTP/1.1 Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:33:39.994054 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:39.995478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '34713cf1-5790-4036-bd9d-e127e3957b1c'} Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:39.996234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. Aug 24 05:33:39.997273 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:39.998153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance 34713cf1-5790-4036-bd9d-e127e3957b1c could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:39.999166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0d858762-237e-47f7-bb12-e9c158d178bb tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c" status: 404 len: 111 microversion: 2.1 time: 0.038600 Aug 24 05:33:40.000201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1608/3324] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:39 2022] GET /compute/v2.1/servers/34713cf1-5790-4036-bd9d-e127e3957b1c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:33:40.310741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:40.311297 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:40.318362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:40.319799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:40.320571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:40.321306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:40.321925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:40.322350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:40.488510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:40.505808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:40.508549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:40.509971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9673e36e-7b74-4a2d-b6f9-61d234bd911d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.205928 Aug 24 05:33:40.510540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1717/3325] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:40 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:41.153781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:41.154352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:41.157266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:41.163160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:41.163954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:41.164387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:41.165096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:41.165544 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:41.165968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:41.182340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c HTTP/1.1 Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:33:41.184150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:33:41.185307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '455aaf6b-38bd-45d3-9fe4-6c3b25f0751c'} Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:41.185891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:33:41.190529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.191745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:41.191745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-48e54151-d089-46d1-9ebd-79288f7198f2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 404 len: 111 microversion: 2.1 time: 0.035577 Aug 24 05:33:41.191745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1609/3326] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:33:41 2022] DELETE /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 05:33:41.195771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:41.196388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:41.203300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:41.204054 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:41.204692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:41.205388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:41.205991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:41.206560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:41.225518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c HTTP/1.1 Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:33:41.227088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:33:41.228241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '455aaf6b-38bd-45d3-9fe4-6c3b25f0751c'} Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:41.228944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. Aug 24 05:33:41.229947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.230850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance 455aaf6b-38bd-45d3-9fe4-6c3b25f0751c could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:41.230850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8a11785b-5b79-4884-b0f7-622ab99edc64 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c" status: 404 len: 111 microversion: 2.1 time: 0.038132 Aug 24 05:33:41.232124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1718/3327] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:41 2022] GET /compute/v2.1/servers/455aaf6b-38bd-45d3-9fe4-6c3b25f0751c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:33:41.237892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:41.238413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:41.246953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:41.247657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:41.248214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:41.249111 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:41.249570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:41.249997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:41.265363 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd HTTP/1.1 Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:33:41.266985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:33:41.268152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd'} Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:41.268768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:33:41.269746 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.270890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:41.270890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8b9b3150-83c7-4446-94df-a2053012c1c2 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 404 len: 111 microversion: 2.1 time: 0.035252 Aug 24 05:33:41.270890 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1610/3328] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:33:41 2022] DELETE /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:33:41.277680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:41.278576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:41.284526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:41.284999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:41.285422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:41.286093 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:41.286532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:41.286964 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:41.301099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd HTTP/1.1 Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:33:41.302579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:33:41.304532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd'} Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:41.305121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. Aug 24 05:33:41.306072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:41.307167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance 6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:41.307167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b3c30c0e-539f-497b-92ea-64a6f00fe10a tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd" status: 404 len: 111 microversion: 2.1 time: 0.031187 Aug 24 05:33:41.307167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1719/3329] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:41 2022] GET /compute/v2.1/servers/6c53e0fa-bf63-43c0-b7bd-c8c2f242e5bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:33:41.536387 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:41.537367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:41.544573 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:41.545287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:41.545930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:41.546630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:41.547113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:41.547595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:41.701645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:41.711016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:41.712509 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:41.713863 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b7e74489-ba77-4b31-a367-d51bf76792f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.182024 Aug 24 05:33:41.730045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1611/3330] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:41 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:42.460517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:42.461111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:42.467771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:42.468504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:42.469087 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:42.469954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:42.470425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:42.471062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:42.485573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 HTTP/1.1 Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:33:42.487138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. Aug 24 05:33:42.488359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': 'd0463d0c-9ee3-4f76-91c6-2fcbdfb55053'} Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:42.489028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. Aug 24 05:33:42.489988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:33:42.492535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:42.492535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-49e0364b-f994-4b7d-87d3-25243956c634 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 404 len: 111 microversion: 2.1 time: 0.032873 Aug 24 05:33:42.492535 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1720/3331] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:33:42 2022] DELETE /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:33:42.497806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:42.498417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] [instance: d0463d0c-9ee3-4f76-91c6-2fcbdfb55053] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:42.504722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:42.505195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:42.505626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:42.506353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:42.507395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:42.507395 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:42.522271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] HTTP exception thrown: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Request method failure captured: Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 HTTP/1.1 Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBa76aqezmLZpIMkVHQRvP1STJ0s0UwpJnxYodtRZEeYSzBRuHfdXeeOKVqlyLYQSuubqI3itiMcy5TAQ-wLpJQjuQrNVSjuhJUDD8m5_HgjazHqjXvlsb5NlX2BBFHR6zvJlhY5WXOGAJR7-5tuHX1C8D3OydsF4BWQt90HwL430_Bo Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:33:42.523915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_42f2c35fc0e4453eba1a25d2b6311bc5", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/42f2c35fc0e4453eba1a25d2b6311bc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 42f2c35fc0e4453eba1a25d2b6311bc5 Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1607231653 Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 4bc6971289b943aebec90909ffb8096a Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeNegativeTest-1607231653-project Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. Aug 24 05:33:42.525270 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': 'd0463d0c-9ee3-4f76-91c6-2fcbdfb55053'} Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:33:42.525913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. Aug 24 05:33:42.526939 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:33:42.527836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] Returning 404 to user: Instance d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:33:42.527836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0536ca61-12cf-4816-9e68-9fbbdd0c4016 tempest-AttachVolumeNegativeTest-1607231653 tempest-AttachVolumeNegativeTest-1607231653-project] 10.222.0.97 "GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053" status: 404 len: 111 microversion: 2.1 time: 0.031320 Aug 24 05:33:42.527836 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1612/3332] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:42 2022] GET /compute/v2.1/servers/d0463d0c-9ee3-4f76-91c6-2fcbdfb55053 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:33:42.736526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:42.737202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:42.739099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=49 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:42.746897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:42.747740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:42.748540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:42.749475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:42.750271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:42.750949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:42.908517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:42.923613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:42.925187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:42.926565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3a8ad6ca-fe6d-4ab8-ae52-1d932cc5e471 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.193772 Aug 24 05:33:42.943889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1721/3333] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:42 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:43.953454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:43.956916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:43.964697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:43.965535 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:43.966311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:43.967417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:43.968080 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:43.968711 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:44.223510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:44.233724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:44.235724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:44.237326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-36424663-dbea-45bd-8d1e-6bdae0109e30 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.289321 Aug 24 05:33:44.251303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1613/3334] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:43 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:44.366828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0fa7e902-f229-49c1-b9ab-a1bb532a198b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:44.371564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0fa7e902-f229-49c1-b9ab-a1bb532a198b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:44.378193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa7e902-f229-49c1-b9ab-a1bb532a198b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:44.378780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa7e902-f229-49c1-b9ab-a1bb532a198b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:44.379334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa7e902-f229-49c1-b9ab-a1bb532a198b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:44.380247 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa7e902-f229-49c1-b9ab-a1bb532a198b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:44.381188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa7e902-f229-49c1-b9ab-a1bb532a198b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:44.381947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fa7e902-f229-49c1-b9ab-a1bb532a198b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:44.514044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0fa7e902-f229-49c1-b9ab-a1bb532a198b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "POST /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/action" status: 202 len: 0 microversion: 2.1 time: 0.151584 Aug 24 05:33:44.514745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1722/3335] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 05:33:44 2022] POST /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 05:33:44.523931 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-862f7902-36ab-4388-a9e5-e9ae5c77f8f9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:44.524547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-862f7902-36ab-4388-a9e5-e9ae5c77f8f9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:44.537813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-862f7902-36ab-4388-a9e5-e9ae5c77f8f9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:44.538355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-862f7902-36ab-4388-a9e5-e9ae5c77f8f9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:44.538846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-862f7902-36ab-4388-a9e5-e9ae5c77f8f9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:44.544189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-862f7902-36ab-4388-a9e5-e9ae5c77f8f9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:44.544761 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-862f7902-36ab-4388-a9e5-e9ae5c77f8f9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:44.545213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-862f7902-36ab-4388-a9e5-e9ae5c77f8f9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:44.909447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-862f7902-36ab-4388-a9e5-e9ae5c77f8f9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:44.949971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-862f7902-36ab-4388-a9e5-e9ae5c77f8f9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1750 microversion: 2.1 time: 0.429861 Aug 24 05:33:44.952105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1614/3336] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:44 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1750 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:45.264703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:45.268331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:45.288937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:45.291379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:45.292235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:45.297344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:45.298285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:45.299030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:45.539845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:45.550413 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:45.555564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:45.559792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b9d55b0c-e68d-4112-9a6c-eb99b0741cf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.301187 Aug 24 05:33:45.562234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1723/3337] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:45 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:46.007449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-33ef4af9-5350-407d-b006-5285727a7392 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:46.008065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-33ef4af9-5350-407d-b006-5285727a7392 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:46.028324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33ef4af9-5350-407d-b006-5285727a7392 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:46.029684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33ef4af9-5350-407d-b006-5285727a7392 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:46.031209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33ef4af9-5350-407d-b006-5285727a7392 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:46.032680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33ef4af9-5350-407d-b006-5285727a7392 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:46.036571 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33ef4af9-5350-407d-b006-5285727a7392 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:46.037554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-33ef4af9-5350-407d-b006-5285727a7392 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:46.337290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-33ef4af9-5350-407d-b006-5285727a7392 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:46.347577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-33ef4af9-5350-407d-b006-5285727a7392 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.368323 Aug 24 05:33:46.348225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1615/3338] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:45 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:46.588549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:46.589157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:46.595462 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:46.596126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:46.596568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:46.597561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:46.598362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:46.598883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:46.790758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:46.799690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:46.801364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:46.802632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-59f10960-9075-4540-adb7-cc38a5cc992a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1742 microversion: 2.20 time: 0.218663 Aug 24 05:33:46.804023 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1724/3339] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:46 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1742 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:33:47.370367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6ed86350-a054-4b79-b0d5-be1ca2c4a360 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:47.371000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6ed86350-a054-4b79-b0d5-be1ca2c4a360 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:47.378723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ed86350-a054-4b79-b0d5-be1ca2c4a360 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:47.379885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ed86350-a054-4b79-b0d5-be1ca2c4a360 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:47.380541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ed86350-a054-4b79-b0d5-be1ca2c4a360 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:47.382239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ed86350-a054-4b79-b0d5-be1ca2c4a360 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:47.383210 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ed86350-a054-4b79-b0d5-be1ca2c4a360 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:47.383722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ed86350-a054-4b79-b0d5-be1ca2c4a360 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:47.829224 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:47.829871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:47.838949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:47.840552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:47.841164 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:47.842482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:47.843085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:47.843510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:47.889374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6ed86350-a054-4b79-b0d5-be1ca2c4a360 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:47.898910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6ed86350-a054-4b79-b0d5-be1ca2c4a360 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.532124 Aug 24 05:33:47.913792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1616/3340] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:47 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:48.020613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:48.031943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:48.033364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:48.034541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-885a2e21-a5a7-47f0-92e4-6a2ebedef516 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1724 microversion: 2.20 time: 0.211027 Aug 24 05:33:48.035196 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1725/3341] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:47 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:33:48.921719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7b128e58-ac06-4e96-a45a-193be3d1ce43 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:48.922390 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7b128e58-ac06-4e96-a45a-193be3d1ce43 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:48.929018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b128e58-ac06-4e96-a45a-193be3d1ce43 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:48.929531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b128e58-ac06-4e96-a45a-193be3d1ce43 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:48.929970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b128e58-ac06-4e96-a45a-193be3d1ce43 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:48.930657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b128e58-ac06-4e96-a45a-193be3d1ce43 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:48.931269 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b128e58-ac06-4e96-a45a-193be3d1ce43 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:48.931696 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7b128e58-ac06-4e96-a45a-193be3d1ce43 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:49.060313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:49.060914 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:49.070680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:49.071182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:49.071745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:49.072493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:49.072883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:49.073357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:49.083096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7b128e58-ac06-4e96-a45a-193be3d1ce43 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:49.091741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7b128e58-ac06-4e96-a45a-193be3d1ce43 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.174699 Aug 24 05:33:49.092312 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1617/3342] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:48 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:49.202048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:49.210086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:49.211620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:49.212743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9db8c629-81c7-4ae3-a292-883a16e0edad tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1724 microversion: 2.20 time: 0.158508 Aug 24 05:33:49.213293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1726/3343] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:49 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:33:50.112528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bdb206f8-6f4c-4ac0-acfc-272249e760d6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:50.113184 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bdb206f8-6f4c-4ac0-acfc-272249e760d6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:50.126357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bdb206f8-6f4c-4ac0-acfc-272249e760d6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.126889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bdb206f8-6f4c-4ac0-acfc-272249e760d6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.127324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bdb206f8-6f4c-4ac0-acfc-272249e760d6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.128022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bdb206f8-6f4c-4ac0-acfc-272249e760d6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.128667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bdb206f8-6f4c-4ac0-acfc-272249e760d6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.128879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bdb206f8-6f4c-4ac0-acfc-272249e760d6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.208972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-8a79373b-5cb1-44d5-963c-8b8f6fe2c5aa req-a8f0dd32-e114-449a-8c9e-e5c87b98e425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342b0ec6-3c25-4b72-bcb1-88878f3d85e8", "name": "network-vif-unplugged", "status": "completed", "tag": "e783a71b-b500-4cdb-96c0-ecd825b2a9c5"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:50.220281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-8a79373b-5cb1-44d5-963c-8b8f6fe2c5aa req-a8f0dd32-e114-449a-8c9e-e5c87b98e425 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.220753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-8a79373b-5cb1-44d5-963c-8b8f6fe2c5aa req-a8f0dd32-e114-449a-8c9e-e5c87b98e425 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.221358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-8a79373b-5cb1-44d5-963c-8b8f6fe2c5aa req-a8f0dd32-e114-449a-8c9e-e5c87b98e425 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.236903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.compute.server_external_events [req-8a79373b-5cb1-44d5-963c-8b8f6fe2c5aa req-a8f0dd32-e114-449a-8c9e-e5c87b98e425 service nova] Unable to find a host for instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8. Dropping event network-vif-unplugged {{(pid=120558) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 05:33:50.237795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-8a79373b-5cb1-44d5-963c-8b8f6fe2c5aa req-a8f0dd32-e114-449a-8c9e-e5c87b98e425 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032684 Aug 24 05:33:50.238382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1727/3344] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 24 05:33:50.243615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:50.245021 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:50.251237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.251885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.252707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.253624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.254215 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.254851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.320683 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bdb206f8-6f4c-4ac0-acfc-272249e760d6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:50.328755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bdb206f8-6f4c-4ac0-acfc-272249e760d6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.220053 Aug 24 05:33:50.329320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1618/3345] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:50 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:50.393039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:50.401435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:50.402967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:50.404138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3e878bf2-9716-4cf5-a066-c688d093d64f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1667 microversion: 2.20 time: 0.164612 Aug 24 05:33:50.404800 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1728/3346] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:50 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:50.428357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-958cd25d-728d-4366-82d3-3fd4d62dbc54 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d10abf32-ba3d-48d9-bb0e-7ae63c28f07f"}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:50.430725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-958cd25d-728d-4366-82d3-3fd4d62dbc54 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:50.436902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-958cd25d-728d-4366-82d3-3fd4d62dbc54 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.437366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-958cd25d-728d-4366-82d3-3fd4d62dbc54 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.437794 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-958cd25d-728d-4366-82d3-3fd4d62dbc54 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.438473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-958cd25d-728d-4366-82d3-3fd4d62dbc54 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.438954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-958cd25d-728d-4366-82d3-3fd4d62dbc54 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.439377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-958cd25d-728d-4366-82d3-3fd4d62dbc54 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.715594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.721910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-958cd25d-728d-4366-82d3-3fd4d62dbc54 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "POST /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298321 Aug 24 05:33:50.722657 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1619/3347] 10.222.0.97 () {62 vars in 1364 bytes} [Wed Aug 24 05:33:50 2022] POST /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:33:50.843225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d52b768e-262c-40b6-9c36-4c2087009c0b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:33:50.843812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d52b768e-262c-40b6-9c36-4c2087009c0b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:50.850333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d52b768e-262c-40b6-9c36-4c2087009c0b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.850844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d52b768e-262c-40b6-9c36-4c2087009c0b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.851277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d52b768e-262c-40b6-9c36-4c2087009c0b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.851954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d52b768e-262c-40b6-9c36-4c2087009c0b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:50.852397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d52b768e-262c-40b6-9c36-4c2087009c0b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:50.852814 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d52b768e-262c-40b6-9c36-4c2087009c0b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:50.869217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:33:50.992501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d52b768e-262c-40b6-9c36-4c2087009c0b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120558) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:33:51.059011 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d52b768e-262c-40b6-9c36-4c2087009c0b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "POST /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/action" status: 202 len: 0 microversion: 2.20 time: 0.219480 Aug 24 05:33:51.059730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1729/3348] 10.222.0.97 () {62 vars in 1319 bytes} [Wed Aug 24 05:33:50 2022] POST /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:33:51.067654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:51.068940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:51.076822 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:51.077307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:51.077740 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:51.078426 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:51.078905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:51.079331 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:51.219099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:51.230362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:51.230362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:51.231040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5cf94f92-0e86-43c7-955a-ba2c4ed12fe3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1753 microversion: 2.20 time: 0.167227 Aug 24 05:33:51.231590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1620/3349] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:51 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:51.349806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ee4f22b9-1ee2-4b2b-a473-92b1acf49acc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:51.351077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ee4f22b9-1ee2-4b2b-a473-92b1acf49acc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:51.359273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4f22b9-1ee2-4b2b-a473-92b1acf49acc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:51.359812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4f22b9-1ee2-4b2b-a473-92b1acf49acc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:51.360244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4f22b9-1ee2-4b2b-a473-92b1acf49acc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:51.360917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4f22b9-1ee2-4b2b-a473-92b1acf49acc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:51.361357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4f22b9-1ee2-4b2b-a473-92b1acf49acc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:51.361767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ee4f22b9-1ee2-4b2b-a473-92b1acf49acc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:51.524506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ee4f22b9-1ee2-4b2b-a473-92b1acf49acc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:51.534871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ee4f22b9-1ee2-4b2b-a473-92b1acf49acc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.189373 Aug 24 05:33:51.535610 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1730/3350] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:51 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:33:52.253636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:52.254245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:52.262233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:52.263010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:52.263639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:52.264550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:52.265119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:52.265813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:52.393703 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:52.403399 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:52.404937 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:52.406153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e59b7768-7e03-4c64-8449-1918ee81bb4a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1753 microversion: 2.20 time: 0.156497 Aug 24 05:33:52.406719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1621/3351] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:52 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:52.557433 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-708ac830-b683-48ce-97fe-8342a2dfbd9a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:52.558297 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-708ac830-b683-48ce-97fe-8342a2dfbd9a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:52.564687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708ac830-b683-48ce-97fe-8342a2dfbd9a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:52.565166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708ac830-b683-48ce-97fe-8342a2dfbd9a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:52.565599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708ac830-b683-48ce-97fe-8342a2dfbd9a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:52.566277 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708ac830-b683-48ce-97fe-8342a2dfbd9a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:52.566752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708ac830-b683-48ce-97fe-8342a2dfbd9a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:52.567179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708ac830-b683-48ce-97fe-8342a2dfbd9a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:52.715183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-708ac830-b683-48ce-97fe-8342a2dfbd9a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:52.723847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-708ac830-b683-48ce-97fe-8342a2dfbd9a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.170303 Aug 24 05:33:52.724416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1731/3352] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:52 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:53.429309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:53.429905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:53.436601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:53.437077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:53.437504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:53.438169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:53.438611 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:53.439049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:53.568957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:53.577673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:53.579203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:53.580353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8bf85451-63ec-4da7-b475-5555bd0b7fe9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1753 microversion: 2.20 time: 0.155659 Aug 24 05:33:53.580905 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1622/3353] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:53 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:53.745282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a36d38db-52d6-4e55-8f1f-2d7e6aba7b97 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:53.745889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a36d38db-52d6-4e55-8f1f-2d7e6aba7b97 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:53.752447 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d38db-52d6-4e55-8f1f-2d7e6aba7b97 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:53.752925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d38db-52d6-4e55-8f1f-2d7e6aba7b97 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:53.753354 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d38db-52d6-4e55-8f1f-2d7e6aba7b97 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:53.754061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d38db-52d6-4e55-8f1f-2d7e6aba7b97 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:53.754515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d38db-52d6-4e55-8f1f-2d7e6aba7b97 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:53.754962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a36d38db-52d6-4e55-8f1f-2d7e6aba7b97 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:53.896536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a36d38db-52d6-4e55-8f1f-2d7e6aba7b97 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:53.904679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a36d38db-52d6-4e55-8f1f-2d7e6aba7b97 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.163236 Aug 24 05:33:53.905272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1732/3354] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:53 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:54.603824 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:54.604457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:54.610954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:54.611434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:54.611860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:54.612538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:54.612984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:54.613402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:54.754556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:54.764912 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:54.766534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:54.767889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ba882aeb-353b-4ca2-8d79-556043751a98 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1753 microversion: 2.20 time: 0.168454 Aug 24 05:33:54.768452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1623/3355] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:54 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:54.926482 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ac20bdb0-71f7-407e-bbf6-c48f09d4d6ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:54.927028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ac20bdb0-71f7-407e-bbf6-c48f09d4d6ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:54.934532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ac20bdb0-71f7-407e-bbf6-c48f09d4d6ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:54.935042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ac20bdb0-71f7-407e-bbf6-c48f09d4d6ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:54.935465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ac20bdb0-71f7-407e-bbf6-c48f09d4d6ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:54.936137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ac20bdb0-71f7-407e-bbf6-c48f09d4d6ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:54.936572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ac20bdb0-71f7-407e-bbf6-c48f09d4d6ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:54.936984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ac20bdb0-71f7-407e-bbf6-c48f09d4d6ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:55.087133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ac20bdb0-71f7-407e-bbf6-c48f09d4d6ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:55.099201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ac20bdb0-71f7-407e-bbf6-c48f09d4d6ee tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.176416 Aug 24 05:33:55.100641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1733/3356] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:54 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:55.791837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:55.792587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:55.799039 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:55.799631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:55.799936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:55.800609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:55.801049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:55.801459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:55.934805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:55.943552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:55.945028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:55.946168 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-44f68825-eed1-4881-a285-b13452c1b70f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1753 microversion: 2.20 time: 0.158899 Aug 24 05:33:55.946764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1624/3357] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:55 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:56.121813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a1174d57-0d98-442e-ad1c-fe6da817cfd2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:56.122400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a1174d57-0d98-442e-ad1c-fe6da817cfd2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:56.128862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1174d57-0d98-442e-ad1c-fe6da817cfd2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:56.129342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1174d57-0d98-442e-ad1c-fe6da817cfd2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:56.129777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1174d57-0d98-442e-ad1c-fe6da817cfd2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:56.130452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1174d57-0d98-442e-ad1c-fe6da817cfd2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:56.131651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1174d57-0d98-442e-ad1c-fe6da817cfd2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:56.132073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1174d57-0d98-442e-ad1c-fe6da817cfd2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:56.281175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a1174d57-0d98-442e-ad1c-fe6da817cfd2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:56.290501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a1174d57-0d98-442e-ad1c-fe6da817cfd2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.172753 Aug 24 05:33:56.292549 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1734/3358] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:56 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:56.969262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:56.969919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:56.976837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:56.977316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:56.977744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:56.978420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:56.978892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:56.979306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:57.118281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:57.127016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:57.128522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:57.129677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3c30aab4-9f8e-4cd1-b880-56b411bc3168 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1755 microversion: 2.20 time: 0.164331 Aug 24 05:33:57.130230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1625/3359] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:56 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:57.315179 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-feb6adb4-bd1d-4c09-bf28-3ea959a4e7de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:57.316520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-feb6adb4-bd1d-4c09-bf28-3ea959a4e7de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:57.324378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-feb6adb4-bd1d-4c09-bf28-3ea959a4e7de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:57.324852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-feb6adb4-bd1d-4c09-bf28-3ea959a4e7de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:57.325273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-feb6adb4-bd1d-4c09-bf28-3ea959a4e7de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:57.326008 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-feb6adb4-bd1d-4c09-bf28-3ea959a4e7de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:57.326442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-feb6adb4-bd1d-4c09-bf28-3ea959a4e7de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:57.326881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-feb6adb4-bd1d-4c09-bf28-3ea959a4e7de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:57.483217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-feb6adb4-bd1d-4c09-bf28-3ea959a4e7de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:57.492461 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-feb6adb4-bd1d-4c09-bf28-3ea959a4e7de tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.182108 Aug 24 05:33:57.493203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1735/3360] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:57 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:33:58.156154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:58.156750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:58.164370 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:58.164862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:58.165613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:58.166481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:58.166873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:58.168079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:58.376857 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:58.387053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:58.388644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:58.389834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6a016b30-35c3-418f-a26c-d66f12ea5a26 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.237783 Aug 24 05:33:58.390418 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1626/3361] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:58 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:58.514434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-35c00056-d576-4ea8-addd-b200d92a1c63 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:58.515069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-35c00056-d576-4ea8-addd-b200d92a1c63 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:58.521369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35c00056-d576-4ea8-addd-b200d92a1c63 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:58.522198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35c00056-d576-4ea8-addd-b200d92a1c63 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:58.522757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35c00056-d576-4ea8-addd-b200d92a1c63 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:58.523446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35c00056-d576-4ea8-addd-b200d92a1c63 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:58.523901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35c00056-d576-4ea8-addd-b200d92a1c63 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:58.524349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-35c00056-d576-4ea8-addd-b200d92a1c63 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:58.670722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-35c00056-d576-4ea8-addd-b200d92a1c63 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:58.679608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-35c00056-d576-4ea8-addd-b200d92a1c63 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.168991 Aug 24 05:33:58.680218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1736/3362] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:58 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:33:59.413739 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:59.415220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:59.422539 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:59.423058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:59.423489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:59.424174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:59.424652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:59.425066 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:59.602375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:59.612592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:59.614260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:59.616603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-06176e53-63ca-403c-a9c5-0a08d2294a5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.207162 Aug 24 05:33:59.617120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1627/3363] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:33:59 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:33:59.701544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2ef4ac39-1094-4dda-834a-a6970bac2419 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:33:59.702766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2ef4ac39-1094-4dda-834a-a6970bac2419 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:33:59.709657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ef4ac39-1094-4dda-834a-a6970bac2419 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:59.710316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ef4ac39-1094-4dda-834a-a6970bac2419 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:59.710935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ef4ac39-1094-4dda-834a-a6970bac2419 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:59.711636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ef4ac39-1094-4dda-834a-a6970bac2419 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:33:59.712084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ef4ac39-1094-4dda-834a-a6970bac2419 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:33:59.712504 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2ef4ac39-1094-4dda-834a-a6970bac2419 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:33:59.909442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2ef4ac39-1094-4dda-834a-a6970bac2419 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:33:59.917856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2ef4ac39-1094-4dda-834a-a6970bac2419 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.220779 Aug 24 05:33:59.918426 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1737/3364] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:33:59 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:00.641251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:00.643377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:00.651172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:00.651673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:00.652102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:00.652792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:00.653240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:00.653664 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:00.808560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:00.818430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:00.820332 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:00.821604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8b0abe45-f00c-44fe-aa2d-955e263a7c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.185263 Aug 24 05:34:00.822572 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1628/3365] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:00 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:00.939951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4d481d26-18cc-436b-9a02-8abefd002b68 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:00.940587 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4d481d26-18cc-436b-9a02-8abefd002b68 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:00.948019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d481d26-18cc-436b-9a02-8abefd002b68 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:00.948497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d481d26-18cc-436b-9a02-8abefd002b68 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:00.948935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d481d26-18cc-436b-9a02-8abefd002b68 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:00.949619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d481d26-18cc-436b-9a02-8abefd002b68 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:00.950053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d481d26-18cc-436b-9a02-8abefd002b68 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:00.950466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4d481d26-18cc-436b-9a02-8abefd002b68 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:01.198978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4d481d26-18cc-436b-9a02-8abefd002b68 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:01.208655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4d481d26-18cc-436b-9a02-8abefd002b68 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.272516 Aug 24 05:34:01.224468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1738/3366] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:00 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:01.845083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:01.845743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:01.852976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:01.853456 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:01.853889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:01.854829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:01.855295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:01.855699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:02.004452 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:02.013512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:02.015048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:02.016205 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-49ffe1ef-5c8c-458d-b278-5ee967d9c245 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.175080 Aug 24 05:34:02.016763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1629/3367] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:01 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:02.231692 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-37ac2795-b345-41ad-a5b6-d7941cf2688a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:02.232389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-37ac2795-b345-41ad-a5b6-d7941cf2688a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:02.239463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37ac2795-b345-41ad-a5b6-d7941cf2688a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:02.239949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37ac2795-b345-41ad-a5b6-d7941cf2688a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:02.240957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37ac2795-b345-41ad-a5b6-d7941cf2688a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:02.242035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37ac2795-b345-41ad-a5b6-d7941cf2688a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:02.242479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37ac2795-b345-41ad-a5b6-d7941cf2688a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:02.243058 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-37ac2795-b345-41ad-a5b6-d7941cf2688a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:02.397439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-37ac2795-b345-41ad-a5b6-d7941cf2688a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:02.406543 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-37ac2795-b345-41ad-a5b6-d7941cf2688a tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.178664 Aug 24 05:34:02.408200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1739/3368] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:02 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:03.042748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:03.043336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:03.049774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:03.050243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:03.050665 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:03.051380 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:03.051804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:03.052214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:03.209461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:03.219936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:03.221427 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:03.222585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4fd903ca-ec42-4c89-a118-a273fa069658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.183753 Aug 24 05:34:03.223174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1630/3369] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:03 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:03.429727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d20238ee-2b52-48a0-877c-7102fab6f7cd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:03.430743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d20238ee-2b52-48a0-877c-7102fab6f7cd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:03.438783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d20238ee-2b52-48a0-877c-7102fab6f7cd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:03.439267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d20238ee-2b52-48a0-877c-7102fab6f7cd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:03.439898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d20238ee-2b52-48a0-877c-7102fab6f7cd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:03.441048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d20238ee-2b52-48a0-877c-7102fab6f7cd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:03.441641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d20238ee-2b52-48a0-877c-7102fab6f7cd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:03.442206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d20238ee-2b52-48a0-877c-7102fab6f7cd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:03.939209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d20238ee-2b52-48a0-877c-7102fab6f7cd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:03.954436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d20238ee-2b52-48a0-877c-7102fab6f7cd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.528958 Aug 24 05:34:03.956286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1740/3370] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:03 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:04.247108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:04.248684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:04.257315 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:04.258115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:04.258829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:04.259861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:04.260484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:04.261009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:04.412820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:04.421851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:04.423388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:04.424550 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-811da220-1270-4ed0-a4a6-5fa77131d948 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.182110 Aug 24 05:34:04.425109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1631/3371] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:04 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:04.989764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e40a63eb-d86c-4142-a479-ec1d134c2c64 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:04.991059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e40a63eb-d86c-4142-a479-ec1d134c2c64 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:04.999613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e40a63eb-d86c-4142-a479-ec1d134c2c64 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:05.000091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e40a63eb-d86c-4142-a479-ec1d134c2c64 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:05.000529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e40a63eb-d86c-4142-a479-ec1d134c2c64 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:05.001218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e40a63eb-d86c-4142-a479-ec1d134c2c64 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:05.001668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e40a63eb-d86c-4142-a479-ec1d134c2c64 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:05.002083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e40a63eb-d86c-4142-a479-ec1d134c2c64 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:05.163523 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e40a63eb-d86c-4142-a479-ec1d134c2c64 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:05.173516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e40a63eb-d86c-4142-a479-ec1d134c2c64 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.191304 Aug 24 05:34:05.174667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1741/3372] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:04 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:34:05.450191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:05.451567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:05.468669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:05.469159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:05.469587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:05.470288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:05.470779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:05.471203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:05.629552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:05.640172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:05.641671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:05.642851 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c77d1f5a-eaa3-44d1-8841-43e25c64e4e7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.196534 Aug 24 05:34:05.643552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1632/3373] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:05 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:06.199547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9507468f-abbc-4aaa-9891-b1ee82eb4d9f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:06.201209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9507468f-abbc-4aaa-9891-b1ee82eb4d9f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:06.209963 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9507468f-abbc-4aaa-9891-b1ee82eb4d9f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:06.210554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9507468f-abbc-4aaa-9891-b1ee82eb4d9f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:06.211083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9507468f-abbc-4aaa-9891-b1ee82eb4d9f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:06.211838 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9507468f-abbc-4aaa-9891-b1ee82eb4d9f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:06.212539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9507468f-abbc-4aaa-9891-b1ee82eb4d9f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:06.213182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9507468f-abbc-4aaa-9891-b1ee82eb4d9f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:06.381294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9507468f-abbc-4aaa-9891-b1ee82eb4d9f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:06.390263 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9507468f-abbc-4aaa-9891-b1ee82eb4d9f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.197192 Aug 24 05:34:06.403627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1742/3374] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:06 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:06.672853 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:06.673465 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:06.680768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:06.681239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:06.681843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:06.682709 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:06.683445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:06.683973 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:06.776920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:34:06.777236 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:34:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 (ip 10.222.0.97) !!! Aug 24 05:34:06.842195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:06.851750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:06.853510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:06.854885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-80508834-94af-46c6-8a8a-8ee0dcb7fe62 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.185905 Aug 24 05:34:06.866555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1633/3375] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:06 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:07.414376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-59941638-d298-4879-80fc-13bd359e0cbd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:07.415806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-59941638-d298-4879-80fc-13bd359e0cbd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:07.436154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59941638-d298-4879-80fc-13bd359e0cbd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:07.437010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59941638-d298-4879-80fc-13bd359e0cbd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:07.438308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59941638-d298-4879-80fc-13bd359e0cbd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:07.439795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59941638-d298-4879-80fc-13bd359e0cbd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:07.440450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59941638-d298-4879-80fc-13bd359e0cbd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:07.445083 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-59941638-d298-4879-80fc-13bd359e0cbd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:07.604728 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-59941638-d298-4879-80fc-13bd359e0cbd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:07.613517 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-59941638-d298-4879-80fc-13bd359e0cbd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.204038 Aug 24 05:34:07.614328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1743/3376] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:07 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:07.877628 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:07.878216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:07.885265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:07.885741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:07.886170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:07.886885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:07.887335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:07.887754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:08.021419 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:08.029896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:08.031414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:08.032557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0fe6e079-a55f-4cbc-9ff5-143f4d6ce029 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.159114 Aug 24 05:34:08.033101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1634/3377] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:07 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:08.634767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f4184ee2-5944-4ba9-a70f-e99070f096dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:08.635284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f4184ee2-5944-4ba9-a70f-e99070f096dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:08.641181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4184ee2-5944-4ba9-a70f-e99070f096dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:08.641656 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4184ee2-5944-4ba9-a70f-e99070f096dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:08.642089 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4184ee2-5944-4ba9-a70f-e99070f096dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:08.642789 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4184ee2-5944-4ba9-a70f-e99070f096dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:08.643242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4184ee2-5944-4ba9-a70f-e99070f096dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:08.643663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4184ee2-5944-4ba9-a70f-e99070f096dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:08.791486 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f4184ee2-5944-4ba9-a70f-e99070f096dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:08.799670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f4184ee2-5944-4ba9-a70f-e99070f096dd tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.169394 Aug 24 05:34:08.800228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1744/3378] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:08 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:09.056015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:09.056615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:09.063365 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:09.063844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:09.064277 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:09.064948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:09.065396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:09.065812 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:09.202344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:09.211755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:09.213233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:09.214368 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-569fdd27-2adf-4906-8f6c-8d2220b83d04 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.162909 Aug 24 05:34:09.215013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1635/3379] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:09 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:09.821235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-57b73c00-1eca-422c-a50d-c83e49b595be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:09.821841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-57b73c00-1eca-422c-a50d-c83e49b595be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:09.828273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57b73c00-1eca-422c-a50d-c83e49b595be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:09.828748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57b73c00-1eca-422c-a50d-c83e49b595be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:09.829181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57b73c00-1eca-422c-a50d-c83e49b595be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:09.829860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57b73c00-1eca-422c-a50d-c83e49b595be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:09.830312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57b73c00-1eca-422c-a50d-c83e49b595be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:09.830761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-57b73c00-1eca-422c-a50d-c83e49b595be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:09.834884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:09.975918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-57b73c00-1eca-422c-a50d-c83e49b595be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:09.984170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-57b73c00-1eca-422c-a50d-c83e49b595be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.166910 Aug 24 05:34:09.984740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1745/3380] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:09 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:10.237750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:10.238353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:10.245296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:10.245775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:10.246207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:10.246908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:10.247357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:10.247775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:10.266496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:10.383597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:10.392180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:10.393681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:10.394870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3fee1049-94ac-41ec-8123-f8d635ae7890 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.160983 Aug 24 05:34:10.395425 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1636/3381] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:10 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:11.006121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1b5831b2-9951-4fc8-9bce-012e7974758b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:11.006647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1b5831b2-9951-4fc8-9bce-012e7974758b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:11.013090 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5831b2-9951-4fc8-9bce-012e7974758b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:11.013565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5831b2-9951-4fc8-9bce-012e7974758b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:11.014000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5831b2-9951-4fc8-9bce-012e7974758b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:11.014676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5831b2-9951-4fc8-9bce-012e7974758b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:11.015153 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5831b2-9951-4fc8-9bce-012e7974758b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:11.015573 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1b5831b2-9951-4fc8-9bce-012e7974758b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:11.165043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1b5831b2-9951-4fc8-9bce-012e7974758b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:11.173175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1b5831b2-9951-4fc8-9bce-012e7974758b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.171172 Aug 24 05:34:11.173738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1746/3382] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:11 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:11.419297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:11.419831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:11.422085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=56 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:11.428067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:11.428596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:11.429060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:11.429743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:11.430194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:11.430613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:11.561929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:11.571306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:11.572864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:11.574023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-59301ebc-3811-4ba4-a2a7-5a92f1d9e8b7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.158741 Aug 24 05:34:11.574579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1637/3383] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:11 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:12.195126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7d69a081-3c0d-4046-ab4f-07c1282fcc18 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:12.195749 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7d69a081-3c0d-4046-ab4f-07c1282fcc18 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:12.202098 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69a081-3c0d-4046-ab4f-07c1282fcc18 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:12.202577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69a081-3c0d-4046-ab4f-07c1282fcc18 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:12.203045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69a081-3c0d-4046-ab4f-07c1282fcc18 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:12.203722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69a081-3c0d-4046-ab4f-07c1282fcc18 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:12.204180 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69a081-3c0d-4046-ab4f-07c1282fcc18 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:12.204600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7d69a081-3c0d-4046-ab4f-07c1282fcc18 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:12.346003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7d69a081-3c0d-4046-ab4f-07c1282fcc18 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:12.354939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7d69a081-3c0d-4046-ab4f-07c1282fcc18 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.163859 Aug 24 05:34:12.355506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1747/3384] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:12 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:12.597401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:12.597921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:12.605130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:12.605614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:12.606053 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:12.606757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:12.607213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:12.607638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:12.736195 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:12.744889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:12.746388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:12.747567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c29cab4d-961a-4f2f-9718-abe05574e8f8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.154132 Aug 24 05:34:12.748109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1638/3385] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:12 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:13.375796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a3b66008-a96e-4fd0-9531-430fae7140da tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:13.376389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a3b66008-a96e-4fd0-9531-430fae7140da tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:13.378640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:13.384644 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3b66008-a96e-4fd0-9531-430fae7140da tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:13.385140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3b66008-a96e-4fd0-9531-430fae7140da tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:13.385570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3b66008-a96e-4fd0-9531-430fae7140da tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:13.386233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3b66008-a96e-4fd0-9531-430fae7140da tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:13.386671 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3b66008-a96e-4fd0-9531-430fae7140da tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:13.387101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3b66008-a96e-4fd0-9531-430fae7140da tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:13.531732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a3b66008-a96e-4fd0-9531-430fae7140da tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:13.539713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a3b66008-a96e-4fd0-9531-430fae7140da tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.167737 Aug 24 05:34:13.540270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1748/3386] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:13 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:13.771569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:13.772296 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:13.778952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:13.779429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:13.779865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:13.780547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:13.781000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:13.781424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:13.919271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:13.928759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:13.930374 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:13.931551 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ca4d42ed-033a-4db7-9b75-509e01cbe993 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.164489 Aug 24 05:34:13.932138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1639/3387] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:13 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:14.560102 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-838b9e6f-1ea5-4ebc-a96c-b2ef40626083 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:14.560713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-838b9e6f-1ea5-4ebc-a96c-b2ef40626083 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:14.567257 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-838b9e6f-1ea5-4ebc-a96c-b2ef40626083 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:14.567768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-838b9e6f-1ea5-4ebc-a96c-b2ef40626083 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:14.568197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-838b9e6f-1ea5-4ebc-a96c-b2ef40626083 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:14.568877 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-838b9e6f-1ea5-4ebc-a96c-b2ef40626083 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:14.569324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-838b9e6f-1ea5-4ebc-a96c-b2ef40626083 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:14.569744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-838b9e6f-1ea5-4ebc-a96c-b2ef40626083 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:14.711340 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-838b9e6f-1ea5-4ebc-a96c-b2ef40626083 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:14.719463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-838b9e6f-1ea5-4ebc-a96c-b2ef40626083 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.163451 Aug 24 05:34:14.720027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1749/3388] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:14 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:14.954788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:14.955391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:14.962748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:14.963225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:14.963653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:14.964327 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:14.964774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:14.965191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:15.093754 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:15.102637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:15.104166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:15.105325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-508eda35-1605-41c2-a085-d065d13a52cd tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.154503 Aug 24 05:34:15.105874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1640/3389] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:14 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:15.741316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a8681f1d-0088-4933-8204-e80a6e8811a8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:15.741926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a8681f1d-0088-4933-8204-e80a6e8811a8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:15.748154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8681f1d-0088-4933-8204-e80a6e8811a8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:15.748638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8681f1d-0088-4933-8204-e80a6e8811a8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:15.749069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8681f1d-0088-4933-8204-e80a6e8811a8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:15.749747 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8681f1d-0088-4933-8204-e80a6e8811a8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:15.750198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8681f1d-0088-4933-8204-e80a6e8811a8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:15.750617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a8681f1d-0088-4933-8204-e80a6e8811a8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:15.892884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a8681f1d-0088-4933-8204-e80a6e8811a8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:15.901541 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a8681f1d-0088-4933-8204-e80a6e8811a8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.164426 Aug 24 05:34:15.902100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1750/3390] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:15 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:16.128113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:16.128632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:16.135639 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:16.136117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:16.136553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:16.137229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:16.137682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:16.138102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:16.271154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:16.280529 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:16.282035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:16.283500 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f1b268fd-8077-41e5-91c7-3229f081426e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.159137 Aug 24 05:34:16.283841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1641/3391] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:16 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:16.922655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-fa8725d7-d119-4b22-973f-5339c73a6998 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:16.923287 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-fa8725d7-d119-4b22-973f-5339c73a6998 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:16.930314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8725d7-d119-4b22-973f-5339c73a6998 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:16.930820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8725d7-d119-4b22-973f-5339c73a6998 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:16.931250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8725d7-d119-4b22-973f-5339c73a6998 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:16.931928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8725d7-d119-4b22-973f-5339c73a6998 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:16.932380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8725d7-d119-4b22-973f-5339c73a6998 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:16.932795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-fa8725d7-d119-4b22-973f-5339c73a6998 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:17.076730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-fa8725d7-d119-4b22-973f-5339c73a6998 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:17.085275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-fa8725d7-d119-4b22-973f-5339c73a6998 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.166490 Aug 24 05:34:17.085835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1751/3392] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:16 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:17.307766 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:17.308625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:17.315042 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:17.315524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:17.315956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:17.316631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:17.317079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:17.317496 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:17.443226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:17.451975 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:17.453469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:17.454727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b4337b7b-eb90-47b3-9ee6-b03239de987e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.150704 Aug 24 05:34:17.455285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1642/3393] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:17 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:18.106596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5ac6dd57-cf91-40a5-a082-1679d8a0f1df tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:18.107159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5ac6dd57-cf91-40a5-a082-1679d8a0f1df tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:18.113511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ac6dd57-cf91-40a5-a082-1679d8a0f1df tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:18.113990 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ac6dd57-cf91-40a5-a082-1679d8a0f1df tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:18.114416 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ac6dd57-cf91-40a5-a082-1679d8a0f1df tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:18.115713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ac6dd57-cf91-40a5-a082-1679d8a0f1df tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:18.116181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ac6dd57-cf91-40a5-a082-1679d8a0f1df tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:18.116599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ac6dd57-cf91-40a5-a082-1679d8a0f1df tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:18.264649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ac6dd57-cf91-40a5-a082-1679d8a0f1df tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:18.273568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5ac6dd57-cf91-40a5-a082-1679d8a0f1df tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.170928 Aug 24 05:34:18.274133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1752/3394] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:18 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:18.477375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:18.477976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:18.484409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:18.484881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:18.485308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:18.485983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:18.486428 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:18.486874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:18.614386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:18.623819 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:18.625305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:18.626446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-abeb58f0-5333-4874-a4ea-a706fe2ae07c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.153026 Aug 24 05:34:18.627035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1643/3395] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:18 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:19.294389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8604c9cf-ab71-4e28-a948-413dd046f9c9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:19.295020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8604c9cf-ab71-4e28-a948-413dd046f9c9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:19.301422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8604c9cf-ab71-4e28-a948-413dd046f9c9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:19.301897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8604c9cf-ab71-4e28-a948-413dd046f9c9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:19.302327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8604c9cf-ab71-4e28-a948-413dd046f9c9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:19.303036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8604c9cf-ab71-4e28-a948-413dd046f9c9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:19.303479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8604c9cf-ab71-4e28-a948-413dd046f9c9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:19.303901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8604c9cf-ab71-4e28-a948-413dd046f9c9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:19.448943 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8604c9cf-ab71-4e28-a948-413dd046f9c9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:19.457034 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8604c9cf-ab71-4e28-a948-413dd046f9c9 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.166518 Aug 24 05:34:19.457614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1753/3396] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:19 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:19.650375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:19.650936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:19.657319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:19.657788 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:19.658215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:19.658917 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:19.659391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:19.659803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:19.793862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:19.802436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:19.804798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:19.805930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-66b613e1-e592-4266-9a70-5c6e05992280 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.160350 Aug 24 05:34:19.806480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1644/3397] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:19 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:20.478651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0076525f-53ec-4d37-ac2e-53d6c958a3b5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:20.479273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0076525f-53ec-4d37-ac2e-53d6c958a3b5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:20.486892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0076525f-53ec-4d37-ac2e-53d6c958a3b5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:20.487371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0076525f-53ec-4d37-ac2e-53d6c958a3b5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:20.487801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0076525f-53ec-4d37-ac2e-53d6c958a3b5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:20.488484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0076525f-53ec-4d37-ac2e-53d6c958a3b5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:20.488944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0076525f-53ec-4d37-ac2e-53d6c958a3b5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:20.489346 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0076525f-53ec-4d37-ac2e-53d6c958a3b5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:20.632251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0076525f-53ec-4d37-ac2e-53d6c958a3b5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:20.640468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0076525f-53ec-4d37-ac2e-53d6c958a3b5 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.166095 Aug 24 05:34:20.641031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1754/3398] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:20 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:20.671106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:34:20.671250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:34:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:34:20.829453 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:20.830058 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:20.837159 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:20.837636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:20.838069 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:20.838771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:20.839223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:20.839644 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:20.966153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:20.974815 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:20.976316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:20.977471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-178e80af-65f9-4f6e-b09f-6fd53a1bc2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.152021 Aug 24 05:34:20.978018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1645/3399] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:20 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:21.662151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c06f3007-fe4f-4ffc-adf7-72a3f37f4cf0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:21.662697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c06f3007-fe4f-4ffc-adf7-72a3f37f4cf0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:21.669542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c06f3007-fe4f-4ffc-adf7-72a3f37f4cf0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:21.670018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c06f3007-fe4f-4ffc-adf7-72a3f37f4cf0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:21.670450 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c06f3007-fe4f-4ffc-adf7-72a3f37f4cf0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:21.671159 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c06f3007-fe4f-4ffc-adf7-72a3f37f4cf0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:21.671608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c06f3007-fe4f-4ffc-adf7-72a3f37f4cf0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:21.672025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c06f3007-fe4f-4ffc-adf7-72a3f37f4cf0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:21.813566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c06f3007-fe4f-4ffc-adf7-72a3f37f4cf0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:21.822172 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c06f3007-fe4f-4ffc-adf7-72a3f37f4cf0 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1755 microversion: 2.1 time: 0.164139 Aug 24 05:34:21.822762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1755/3400] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:21 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:21.999996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:22.000596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:22.006902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:22.008157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:22.008594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:22.009263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:22.009705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:22.010119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:22.141682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:22.150613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:22.152151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:22.153308 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0ebb294f-53e6-4239-a288-39752ba2963a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.157188 Aug 24 05:34:22.153866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1646/3401] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:21 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:22.843432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6476c8ce-9e5b-4f8d-a485-0f026e1957ef tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:22.844033 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6476c8ce-9e5b-4f8d-a485-0f026e1957ef tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:22.850554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6476c8ce-9e5b-4f8d-a485-0f026e1957ef tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:22.851063 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6476c8ce-9e5b-4f8d-a485-0f026e1957ef tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:22.851526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6476c8ce-9e5b-4f8d-a485-0f026e1957ef tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:22.852169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6476c8ce-9e5b-4f8d-a485-0f026e1957ef tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:22.852616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6476c8ce-9e5b-4f8d-a485-0f026e1957ef tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:22.853030 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6476c8ce-9e5b-4f8d-a485-0f026e1957ef tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:22.999150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6476c8ce-9e5b-4f8d-a485-0f026e1957ef tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:23.007994 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6476c8ce-9e5b-4f8d-a485-0f026e1957ef tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1758 microversion: 2.1 time: 0.167708 Aug 24 05:34:23.008547 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1756/3402] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:34:22 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:34:23.176487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:23.177081 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:23.184321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:23.184789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:23.185215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:23.185879 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:23.186319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:23.186756 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:23.319194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:23.328266 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:23.329738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:23.330903 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0564b684-947a-4300-91dc-52717f3e41a8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.158372 Aug 24 05:34:23.331458 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1647/3403] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:23 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:24.354780 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:24.355405 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:24.361768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:24.362244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:24.362676 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:24.363372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:24.363817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:24.364233 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:24.494044 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:24.502842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:24.504556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:24.505745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-56a8c784-d91c-4e29-a570-11249732355b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.155537 Aug 24 05:34:24.506432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1757/3404] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:24 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:25.530437 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:25.531084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:25.537623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:25.538095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:25.538558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:25.539264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:25.539728 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:25.540145 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:25.675313 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:25.684239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:25.685730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:25.686908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ca5d8440-b529-4214-8fb7-6cdd2d23600e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.160267 Aug 24 05:34:25.687450 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1648/3405] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:25 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:26.711086 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:26.711741 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:26.718198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:26.718663 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:26.719124 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:26.719808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:26.720229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:26.720636 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:26.854736 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:26.863239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:26.864710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:26.865834 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-68223d9a-c06a-4283-ae0c-95b42e134583 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.159387 Aug 24 05:34:26.866382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1758/3406] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:26 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:27.888940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:27.889473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:27.895891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:27.896367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:27.896801 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:27.897481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:27.897929 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:27.898347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:28.028286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:28.037601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:28.039147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:28.041160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b1e43b0b-9bec-41ee-9435-f7eb12f77998 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.156275 Aug 24 05:34:28.041725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1649/3407] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:27 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:29.064261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:29.064894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:29.072239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:29.072712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:29.073146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:29.073826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:29.074276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:29.074708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:29.202451 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:29.211114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:29.214200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:29.215513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0f9defb5-61cc-4dc2-b46f-06690081bcab tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.155024 Aug 24 05:34:29.216673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1759/3408] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:29 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:30.239556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:30.240116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:30.247116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:30.247599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:30.248035 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:30.248723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:30.249197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:30.249620 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:30.382423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:30.391869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:30.393362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:30.394504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ff4f8f8b-9584-4378-a39f-b6dda620627e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.159034 Aug 24 05:34:30.395095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1650/3409] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:30 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:31.417201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:31.417810 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:31.424335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:31.424903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:31.425253 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:31.426170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:31.426641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:31.427182 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:31.565493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:31.574515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:31.576294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:31.577830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6c4ea151-0cf3-4eb0-93d5-dee6090f6ee8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.164003 Aug 24 05:34:31.578390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1760/3410] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:31 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:32.600640 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:32.601314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:32.609745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:32.610267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:32.610810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:32.611508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:32.612157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:32.612528 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:32.796284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:32.805540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:32.807070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:32.808830 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e9116319-2fa7-414a-90fb-c27680b398f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.211747 Aug 24 05:34:32.823086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1651/3411] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:32 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:33.832817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:33.833422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:33.839896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:33.840375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:33.840809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:33.841488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:33.841935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:33.842356 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:33.971916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:33.975387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=100 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:33.982140 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:33.983743 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:33.984985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-20a3330a-5b95-4ee9-8a90-d2e1c3e69136 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.156265 Aug 24 05:34:33.985697 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1761/3412] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:33 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:34.174994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-0494f416-d23f-447a-a63a-36b148217956 req-26ceaf36-5def-4a61-bc38-a9469e54426c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342b0ec6-3c25-4b72-bcb1-88878f3d85e8", "name": "network-vif-plugged", "status": "completed", "tag": "e783a71b-b500-4cdb-96c0-ecd825b2a9c5"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:34:34.185247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-0494f416-d23f-447a-a63a-36b148217956 req-26ceaf36-5def-4a61-bc38-a9469e54426c service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:34.185718 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-0494f416-d23f-447a-a63a-36b148217956 req-26ceaf36-5def-4a61-bc38-a9469e54426c service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:34.186139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-0494f416-d23f-447a-a63a-36b148217956 req-26ceaf36-5def-4a61-bc38-a9469e54426c service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:34.198041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-0494f416-d23f-447a-a63a-36b148217956 req-26ceaf36-5def-4a61-bc38-a9469e54426c service nova] Creating event network-vif-plugged:e783a71b-b500-4cdb-96c0-ecd825b2a9c5 for instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 on hv-cinder-85426 Aug 24 05:34:34.204079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-0494f416-d23f-447a-a63a-36b148217956 req-26ceaf36-5def-4a61-bc38-a9469e54426c service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101045 Aug 24 05:34:34.205123 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1652/3413] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:34:35.008048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:35.008566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:35.015387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:35.015861 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:35.016568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:35.016939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:35.017379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:35.017795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:35.147222 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:35.156654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:35.158137 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:35.159294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-56fcd4b3-00fa-4a9b-8bb8-544719516353 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.155465 Aug 24 05:34:35.159844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1762/3414] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:35 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:36.182613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:36.184148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:36.190811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:36.191284 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:36.191712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:36.192391 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:36.192865 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:36.193281 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:36.320652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:36.324839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=100 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:34:36.330919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:36.332432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:36.333585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-90c9c2c9-3b9a-432b-9ff6-f1f6d7832b57 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.155253 Aug 24 05:34:36.334141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1653/3415] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:36 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:37.357170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:37.357767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:37.364314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:37.364790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:37.365218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:37.365887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:37.366331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:37.366776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:37.498338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:37.506851 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:37.508388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:37.509516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8678de7d-3d5b-4152-b64e-132d21f3f51d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.156488 Aug 24 05:34:37.510071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1763/3416] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:37 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:34:38.533230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:38.533838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:38.539922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:38.540400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:38.540838 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:38.541517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:38.541968 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:38.543003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:38.677352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:38.686464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:38.687999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:38.689149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-015031c0-a43e-4e0c-a7fe-1024567534db tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.160013 Aug 24 05:34:38.689704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1654/3417] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:38 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:39.712673 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:39.713378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:39.719826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:39.720300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:39.720729 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:39.721404 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:39.721844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:39.722302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:39.852827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:39.862157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:39.863688 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:39.864824 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b31387f3-fb3e-46de-b908-870aa5f75d4d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.156254 Aug 24 05:34:39.865372 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1764/3418] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:39 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:40.887516 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:40.888128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:40.895072 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:40.895543 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:40.895992 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:40.896846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:40.897288 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:40.897699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:41.033549 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:41.042330 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:41.043875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:41.045026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0fa99413-910c-4ad9-a3a5-6bb68ab7f0e9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1811 microversion: 2.20 time: 0.161422 Aug 24 05:34:41.045596 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1655/3419] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:40 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1811 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:34:42.073136 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:34:42.079151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:34:42.084251 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:42.084652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:42.085328 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:42.086199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:34:42.086757 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:34:42.087388 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:34:42.414195 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:42.424959 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:42.427028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:34:42.428149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-17e44f32-4cd1-4fb5-9831-6549416b27ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1798 microversion: 2.20 time: 0.361633 Aug 24 05:34:42.428820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1765/3420] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:34:42 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1798 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:35:30.096645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-23786052-cb41-49f0-ae02-6b91d646ff7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-847934577"}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:35:30.097223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-23786052-cb41-49f0-ae02-6b91d646ff7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:30.099366 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=37 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:30.100300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=12 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:30.105979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23786052-cb41-49f0-ae02-6b91d646ff7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:30.106460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23786052-cb41-49f0-ae02-6b91d646ff7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:30.106924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23786052-cb41-49f0-ae02-6b91d646ff7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:30.107613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23786052-cb41-49f0-ae02-6b91d646ff7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:30.108065 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23786052-cb41-49f0-ae02-6b91d646ff7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:30.108486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-23786052-cb41-49f0-ae02-6b91d646ff7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:30.233816 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.network.security_group_api [None req-23786052-cb41-49f0-ae02-6b91d646ff7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Removing security group c03b451f-825a-43fe-bf1b-22a156dd7d93 from port fe225cc9-367b-4a79-bdcf-67de3b667c45 Aug 24 05:35:30.536274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-23786052-cb41-49f0-ae02-6b91d646ff7b tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "POST /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/action" status: 202 len: 0 microversion: 2.1 time: 0.444120 Aug 24 05:35:30.536885 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1656/3421] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 05:35:30 2022] POST /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:35:30.546365 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=35 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:30.547344 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=24 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:30.774738 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-a2479858-2f39-47f8-a1be-88ba295860f4 req-645140e6-add2-404c-bdeb-fa4f75a59a7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb9a2e3-49ff-4ce5-9009-4dbbdedaa574", "tag": "fe225cc9-367b-4a79-bdcf-67de3b667c45"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:35:30.784734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-a2479858-2f39-47f8-a1be-88ba295860f4 req-645140e6-add2-404c-bdeb-fa4f75a59a7b service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:30.785528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-a2479858-2f39-47f8-a1be-88ba295860f4 req-645140e6-add2-404c-bdeb-fa4f75a59a7b service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:30.785961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-a2479858-2f39-47f8-a1be-88ba295860f4 req-645140e6-add2-404c-bdeb-fa4f75a59a7b service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:30.796312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-a2479858-2f39-47f8-a1be-88ba295860f4 req-645140e6-add2-404c-bdeb-fa4f75a59a7b service nova] Creating event network-changed:fe225cc9-367b-4a79-bdcf-67de3b667c45 for instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 on hv-cinder-85426 Aug 24 05:35:30.802448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-a2479858-2f39-47f8-a1be-88ba295860f4 req-645140e6-add2-404c-bdeb-fa4f75a59a7b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.260726 Aug 24 05:35:30.803402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1766/3422] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:35:32.241653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-215a9a89-12f0-4d8f-b7bc-cf80d802b1b8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:32.242146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-215a9a89-12f0-4d8f-b7bc-cf80d802b1b8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:32.248359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215a9a89-12f0-4d8f-b7bc-cf80d802b1b8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:32.248837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215a9a89-12f0-4d8f-b7bc-cf80d802b1b8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:32.249272 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215a9a89-12f0-4d8f-b7bc-cf80d802b1b8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:32.249955 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215a9a89-12f0-4d8f-b7bc-cf80d802b1b8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:32.250406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215a9a89-12f0-4d8f-b7bc-cf80d802b1b8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:32.251371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-215a9a89-12f0-4d8f-b7bc-cf80d802b1b8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:32.335721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-215a9a89-12f0-4d8f-b7bc-cf80d802b1b8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lazy-loading 'services' on Instance uuid efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:35:32.411526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-215a9a89-12f0-4d8f-b7bc-cf80d802b1b8 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "DELETE /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments/a86bd392-c592-4e30-a351-79ae086946c3" status: 202 len: 0 microversion: 2.1 time: 0.174312 Aug 24 05:35:32.412169 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1657/3423] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:35:32 2022] DELETE /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments/a86bd392-c592-4e30-a351-79ae086946c3 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:35:32.421453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3c516e3f-d55d-4fc8-a6a5-03d57b9c055f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:32.424370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3c516e3f-d55d-4fc8-a6a5-03d57b9c055f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:32.431225 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c516e3f-d55d-4fc8-a6a5-03d57b9c055f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:32.431950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c516e3f-d55d-4fc8-a6a5-03d57b9c055f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:32.432381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c516e3f-d55d-4fc8-a6a5-03d57b9c055f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:32.433163 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c516e3f-d55d-4fc8-a6a5-03d57b9c055f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:32.433876 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c516e3f-d55d-4fc8-a6a5-03d57b9c055f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:32.434293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3c516e3f-d55d-4fc8-a6a5-03d57b9c055f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:32.465917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3c516e3f-d55d-4fc8-a6a5-03d57b9c055f tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049175 Aug 24 05:35:32.466468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1767/3424] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:35:32 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:35:32.819653 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-123aa82e-f8d2-429f-a049-63379738a792 req-f1a2c6c6-9ef3-4904-86d5-951ae2f9f358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "efb9a2e3-49ff-4ce5-9009-4dbbdedaa574", "tag": "fe225cc9-367b-4a79-bdcf-67de3b667c45"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:35:32.830251 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-123aa82e-f8d2-429f-a049-63379738a792 req-f1a2c6c6-9ef3-4904-86d5-951ae2f9f358 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:32.830733 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-123aa82e-f8d2-429f-a049-63379738a792 req-f1a2c6c6-9ef3-4904-86d5-951ae2f9f358 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:32.831164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-123aa82e-f8d2-429f-a049-63379738a792 req-f1a2c6c6-9ef3-4904-86d5-951ae2f9f358 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:32.842090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-123aa82e-f8d2-429f-a049-63379738a792 req-f1a2c6c6-9ef3-4904-86d5-951ae2f9f358 service nova] Creating event network-changed:fe225cc9-367b-4a79-bdcf-67de3b667c45 for instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 on hv-cinder-85426 Aug 24 05:35:32.847773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-123aa82e-f8d2-429f-a049-63379738a792 req-f1a2c6c6-9ef3-4904-86d5-951ae2f9f358 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032201 Aug 24 05:35:32.848356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1658/3425] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:35:33.479496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a24719f8-911e-4f89-8f54-0ab1eb192f28 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:33.482492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a24719f8-911e-4f89-8f54-0ab1eb192f28 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:33.489723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a24719f8-911e-4f89-8f54-0ab1eb192f28 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:33.490198 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a24719f8-911e-4f89-8f54-0ab1eb192f28 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:33.490854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a24719f8-911e-4f89-8f54-0ab1eb192f28 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:33.491916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a24719f8-911e-4f89-8f54-0ab1eb192f28 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:33.492308 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a24719f8-911e-4f89-8f54-0ab1eb192f28 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:33.492907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a24719f8-911e-4f89-8f54-0ab1eb192f28 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:33.525165 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a24719f8-911e-4f89-8f54-0ab1eb192f28 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049570 Aug 24 05:35:33.525716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1768/3426] 10.222.0.97 () {58 vars in 1302 bytes} [Wed Aug 24 05:35:33 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 05:35:33.537083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:33.537662 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:33.544037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:33.544532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:33.544979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:33.545667 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:33.546127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:33.546577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:33.624174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] HTTP exception thrown: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 is not attached to volume a86bd392-c592-4e30-a351-79ae086946c3 Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Request method failure captured: Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: DELETE /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments/a86bd392-c592-4e30-a351-79ae086946c3 HTTP/1.1 Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBbeZZza9Py576vh0PUrqBk_GpAxQlGZ4UD3wnF-TF1rBno0IgXLYyfdOxbWLJmwNxijKv_WPGjenKURnRfo_MM7ZFX7L-A6qZziX1xLw96Y-RM2eqkQsgUcoTYRBoIHX0i0Zth-VFC_4jrMiNh7OSH3DqVob9MWUfFKju3nXmhjSQ9E Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: ecdf03c1545c4bc3a2a74507d8b9aa47 Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-TestMinimumBasicScenario-1245970729 Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:35:33.627247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ecdf03c1545c4bc3a2a74507d8b9aa47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ecdf03c1545c4bc3a2a74507d8b9aa47", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ecdf03c1545c4bc3a2a74507d8b9aa47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ecdf03c1545c4bc3a2a74507d8b9aa47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-TestMinimumBasicScenario-1245970729 Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: ecdf03c1545c4bc3a2a74507d8b9aa47 Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1245970729 Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-TestMinimumBasicScenario-1245970729-project Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: d973e98445c44fa5a5f9eecbb393d8c7 Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-TestMinimumBasicScenario-1245970729-project Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:35:33.628725 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 is not attached to volume a86bd392-c592-4e30-a351-79ae086946c3 Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'server_id': 'efb9a2e3-49ff-4ce5-9009-4dbbdedaa574', 'id': 'a86bd392-c592-4e30-a351-79ae086946c3'} Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a86bd392-c592-4e30-a351-79ae086946c3. Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:35:33.629473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 is not attached to volume a86bd392-c592-4e30-a351-79ae086946c3 Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 is not attached to volume a86bd392-c592-4e30-a351-79ae086946c3 Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:35:33.630557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Returning 404 to user: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 is not attached to volume a86bd392-c592-4e30-a351-79ae086946c3 {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:35:33.631403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-ae669c02-6dee-45aa-9e83-18381d230c04 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "DELETE /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments/a86bd392-c592-4e30-a351-79ae086946c3" status: 404 len: 154 microversion: 2.1 time: 0.096482 Aug 24 05:35:33.631403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1659/3427] 10.222.0.97 () {58 vars in 1416 bytes} [Wed Aug 24 05:35:33 2022] DELETE /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574/os-volume_attachments/a86bd392-c592-4e30-a351-79ae086946c3 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:35:34.768499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-170c88c0-3cb9-4495-b129-7972d209a342 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:34.769048 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-170c88c0-3cb9-4495-b129-7972d209a342 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:34.775478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-170c88c0-3cb9-4495-b129-7972d209a342 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:34.775956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-170c88c0-3cb9-4495-b129-7972d209a342 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:34.776390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-170c88c0-3cb9-4495-b129-7972d209a342 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:34.777073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-170c88c0-3cb9-4495-b129-7972d209a342 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:34.777528 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-170c88c0-3cb9-4495-b129-7972d209a342 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:34.777946 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-170c88c0-3cb9-4495-b129-7972d209a342 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:34.803852 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-170c88c0-3cb9-4495-b129-7972d209a342 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Going to try to terminate instance {{(pid=120558) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:35:34.884844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-170c88c0-3cb9-4495-b129-7972d209a342 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "DELETE /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 204 len: 0 microversion: 2.1 time: 0.120654 Aug 24 05:35:34.885641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1769/3428] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:35:34 2022] DELETE /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:35:34.894394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f73c3e7e-9ac9-4a0c-944c-b8bf9606be31 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:34.895026 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f73c3e7e-9ac9-4a0c-944c-b8bf9606be31 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:34.901504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f73c3e7e-9ac9-4a0c-944c-b8bf9606be31 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:34.901981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f73c3e7e-9ac9-4a0c-944c-b8bf9606be31 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:34.902408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f73c3e7e-9ac9-4a0c-944c-b8bf9606be31 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:34.903186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f73c3e7e-9ac9-4a0c-944c-b8bf9606be31 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:34.903619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f73c3e7e-9ac9-4a0c-944c-b8bf9606be31 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:34.904036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f73c3e7e-9ac9-4a0c-944c-b8bf9606be31 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:35.034185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f73c3e7e-9ac9-4a0c-944c-b8bf9606be31 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:35.042568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f73c3e7e-9ac9-4a0c-944c-b8bf9606be31 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1554 microversion: 2.1 time: 0.152666 Aug 24 05:35:35.043237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1660/3429] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:35:34 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:35:36.066151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cd270413-864a-4f97-8777-14c45b348ecc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:36.066907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cd270413-864a-4f97-8777-14c45b348ecc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:36.073214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd270413-864a-4f97-8777-14c45b348ecc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:36.073687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd270413-864a-4f97-8777-14c45b348ecc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:36.074123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd270413-864a-4f97-8777-14c45b348ecc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:36.074822 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd270413-864a-4f97-8777-14c45b348ecc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:36.075273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd270413-864a-4f97-8777-14c45b348ecc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:36.075691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cd270413-864a-4f97-8777-14c45b348ecc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:36.206712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cd270413-864a-4f97-8777-14c45b348ecc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:36.214607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cd270413-864a-4f97-8777-14c45b348ecc tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1554 microversion: 2.1 time: 0.152825 Aug 24 05:35:36.215204 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1770/3430] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:35:36 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:35:37.239649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6bc22f7c-dcab-421e-9b49-9b874ba579f6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:37.240357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6bc22f7c-dcab-421e-9b49-9b874ba579f6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:37.246555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6bc22f7c-dcab-421e-9b49-9b874ba579f6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:37.247083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6bc22f7c-dcab-421e-9b49-9b874ba579f6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:37.247522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6bc22f7c-dcab-421e-9b49-9b874ba579f6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:37.248209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6bc22f7c-dcab-421e-9b49-9b874ba579f6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:37.248663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6bc22f7c-dcab-421e-9b49-9b874ba579f6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:37.249091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6bc22f7c-dcab-421e-9b49-9b874ba579f6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:37.457430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6bc22f7c-dcab-421e-9b49-9b874ba579f6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd973e98445c44fa5a5f9eecbb393d8c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecdf03c1545c4bc3a2a74507d8b9aa47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:37.465085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6bc22f7c-dcab-421e-9b49-9b874ba579f6 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 200 len: 1554 microversion: 2.1 time: 0.230106 Aug 24 05:35:37.465651 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1661/3431] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:35:37 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:35:37.585041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-3a7d742c-fbb8-4273-9397-46f848ab976e req-cc451a7d-67b1-42fc-9f38-93f3d1334be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "efb9a2e3-49ff-4ce5-9009-4dbbdedaa574", "name": "network-vif-deleted", "tag": "fe225cc9-367b-4a79-bdcf-67de3b667c45"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:35:37.596176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-3a7d742c-fbb8-4273-9397-46f848ab976e req-cc451a7d-67b1-42fc-9f38-93f3d1334be6 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:37.596643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-3a7d742c-fbb8-4273-9397-46f848ab976e req-cc451a7d-67b1-42fc-9f38-93f3d1334be6 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:37.597069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-3a7d742c-fbb8-4273-9397-46f848ab976e req-cc451a7d-67b1-42fc-9f38-93f3d1334be6 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:37.610856 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-3a7d742c-fbb8-4273-9397-46f848ab976e req-cc451a7d-67b1-42fc-9f38-93f3d1334be6 service nova] Creating event network-vif-deleted:fe225cc9-367b-4a79-bdcf-67de3b667c45 for instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 on hv-cinder-85426 Aug 24 05:35:37.616187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-3a7d742c-fbb8-4273-9397-46f848ab976e req-cc451a7d-67b1-42fc-9f38-93f3d1334be6 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035496 Aug 24 05:35:37.616840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1771/3432] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:35:38.487225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:38.487832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] [instance: efb9a2e3-49ff-4ce5-9009-4dbbdedaa574] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:38.494260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:38.494767 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:38.495202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:38.495877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:38.496325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:38.496743 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:38.512661 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] HTTP exception thrown: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 could not be found. Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Request method failure captured: Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 HTTP/1.1 Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBbeZZza9Py576vh0PUrqBk_GpAxQlGZ4UD3wnF-TF1rBno0IgXLYyfdOxbWLJmwNxijKv_WPGjenKURnRfo_MM7ZFX7L-A6qZziX1xLw96Y-RM2eqkQsgUcoTYRBoIHX0i0Zth-VFC_4jrMiNh7OSH3DqVob9MWUfFKju3nXmhjSQ9E Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: ecdf03c1545c4bc3a2a74507d8b9aa47 Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-TestMinimumBasicScenario-1245970729 Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:35:38.514154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/ecdf03c1545c4bc3a2a74507d8b9aa47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_ecdf03c1545c4bc3a2a74507d8b9aa47", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ecdf03c1545c4bc3a2a74507d8b9aa47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/ecdf03c1545c4bc3a2a74507d8b9aa47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-TestMinimumBasicScenario-1245970729 Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: ecdf03c1545c4bc3a2a74507d8b9aa47 Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1245970729 Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-TestMinimumBasicScenario-1245970729-project Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: d973e98445c44fa5a5f9eecbb393d8c7 Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-TestMinimumBasicScenario-1245970729-project Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 could not be found. Aug 24 05:35:38.515557 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': 'efb9a2e3-49ff-4ce5-9009-4dbbdedaa574'} Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 could not be found. Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:35:38.516393 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 could not be found. Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 could not be found. Aug 24 05:35:38.517636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:35:38.518804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Returning 404 to user: Instance efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:35:38.518804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5ef71953-3301-4e5e-a05a-b65232d0c7be tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574" status: 404 len: 111 microversion: 2.1 time: 0.032383 Aug 24 05:35:38.518804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1662/3433] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:35:38 2022] GET /compute/v2.1/servers/efb9a2e3-49ff-4ce5-9009-4dbbdedaa574 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:35:38.525347 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2110afb4-80b0-4c55-83eb-8731303605e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] Calling method '.version_select at 0x7f3594288310>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:38.547807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2110afb4-80b0-4c55-83eb-8731303605e2 tempest-TestMinimumBasicScenario-1245970729 tempest-TestMinimumBasicScenario-1245970729-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1558069474" status: 202 len: 0 microversion: 2.1 time: 0.026529 Aug 24 05:35:38.548366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1772/3434] 10.222.0.97 () {58 vars in 1272 bytes} [Wed Aug 24 05:35:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1558069474 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:35:49.382997 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6afdde2c-908c-4c2f-9522-9ff8896fc4a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:49.383536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6afdde2c-908c-4c2f-9522-9ff8896fc4a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:49.385976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=14 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:49.386630 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:49.392534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afdde2c-908c-4c2f-9522-9ff8896fc4a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:49.393645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afdde2c-908c-4c2f-9522-9ff8896fc4a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:49.394086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afdde2c-908c-4c2f-9522-9ff8896fc4a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:49.394806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afdde2c-908c-4c2f-9522-9ff8896fc4a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:49.395265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afdde2c-908c-4c2f-9522-9ff8896fc4a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:49.395685 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6afdde2c-908c-4c2f-9522-9ff8896fc4a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:49.425646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6afdde2c-908c-4c2f-9522-9ff8896fc4a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-volume_attachments/d10abf32-ba3d-48d9-bb0e-7ae63c28f07f" status: 200 len: 194 microversion: 2.20 time: 0.046762 Aug 24 05:35:49.426222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1663/3435] 10.222.0.97 () {60 vars in 1454 bytes} [Wed Aug 24 05:35:49 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-volume_attachments/d10abf32-ba3d-48d9-bb0e-7ae63c28f07f => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:35:49.489092 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:49.489848 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:35:49.494477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-263f2bb5-248d-47c7-8345-234fa5e96415 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:49.495101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-263f2bb5-248d-47c7-8345-234fa5e96415 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:49.503586 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263f2bb5-248d-47c7-8345-234fa5e96415 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:49.504072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263f2bb5-248d-47c7-8345-234fa5e96415 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:49.504507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263f2bb5-248d-47c7-8345-234fa5e96415 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:49.505194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263f2bb5-248d-47c7-8345-234fa5e96415 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:49.505649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263f2bb5-248d-47c7-8345-234fa5e96415 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:49.506072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-263f2bb5-248d-47c7-8345-234fa5e96415 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:49.593076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-263f2bb5-248d-47c7-8345-234fa5e96415 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lazy-loading 'services' on Instance uuid 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:35:49.665826 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-263f2bb5-248d-47c7-8345-234fa5e96415 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "DELETE /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-volume_attachments/d10abf32-ba3d-48d9-bb0e-7ae63c28f07f" status: 202 len: 0 microversion: 2.20 time: 0.178005 Aug 24 05:35:49.666402 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1773/3436] 10.222.0.97 () {60 vars in 1457 bytes} [Wed Aug 24 05:35:49 2022] DELETE /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-volume_attachments/d10abf32-ba3d-48d9-bb0e-7ae63c28f07f => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:35:49.675935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-aaa7db14-6497-4c1d-9526-04ac25f2b924 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:49.678214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-aaa7db14-6497-4c1d-9526-04ac25f2b924 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:49.685359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaa7db14-6497-4c1d-9526-04ac25f2b924 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:49.685850 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaa7db14-6497-4c1d-9526-04ac25f2b924 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:49.686286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaa7db14-6497-4c1d-9526-04ac25f2b924 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:49.687858 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaa7db14-6497-4c1d-9526-04ac25f2b924 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:49.688540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaa7db14-6497-4c1d-9526-04ac25f2b924 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:49.689164 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-aaa7db14-6497-4c1d-9526-04ac25f2b924 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:49.720632 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-aaa7db14-6497-4c1d-9526-04ac25f2b924 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049873 Aug 24 05:35:49.721321 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1664/3437] 10.222.0.97 () {60 vars in 1343 bytes} [Wed Aug 24 05:35:49 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:35:50.734708 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aaf1b7ab-cc85-43f4-b4dd-f27819031cb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:50.737028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aaf1b7ab-cc85-43f4-b4dd-f27819031cb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:50.743382 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaf1b7ab-cc85-43f4-b4dd-f27819031cb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:50.743858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaf1b7ab-cc85-43f4-b4dd-f27819031cb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:50.744289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaf1b7ab-cc85-43f4-b4dd-f27819031cb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:50.744966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaf1b7ab-cc85-43f4-b4dd-f27819031cb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:50.745443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaf1b7ab-cc85-43f4-b4dd-f27819031cb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:50.745862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aaf1b7ab-cc85-43f4-b4dd-f27819031cb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:50.775145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aaf1b7ab-cc85-43f4-b4dd-f27819031cb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045293 Aug 24 05:35:50.775698 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1774/3438] 10.222.0.97 () {60 vars in 1343 bytes} [Wed Aug 24 05:35:50 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:35:50.837286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c8f5f7bd-6019-43ec-88ea-d82ae3e884c3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:50.837777 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c8f5f7bd-6019-43ec-88ea-d82ae3e884c3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:50.844132 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8f5f7bd-6019-43ec-88ea-d82ae3e884c3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:50.844602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8f5f7bd-6019-43ec-88ea-d82ae3e884c3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:50.845033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8f5f7bd-6019-43ec-88ea-d82ae3e884c3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:50.845796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8f5f7bd-6019-43ec-88ea-d82ae3e884c3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:50.846247 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8f5f7bd-6019-43ec-88ea-d82ae3e884c3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:50.847299 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c8f5f7bd-6019-43ec-88ea-d82ae3e884c3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:50.872256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c8f5f7bd-6019-43ec-88ea-d82ae3e884c3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Going to try to terminate instance {{(pid=120557) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:35:50.949248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c8f5f7bd-6019-43ec-88ea-d82ae3e884c3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "DELETE /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 204 len: 0 microversion: 2.20 time: 0.115552 Aug 24 05:35:50.949843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1665/3439] 10.222.0.97 () {60 vars in 1280 bytes} [Wed Aug 24 05:35:50 2022] DELETE /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:35:50.958894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:50.959525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:50.965417 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:50.965897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:50.966331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:50.967062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:50.967513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:50.967942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:51.099871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:51.111650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:51.113603 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:51.114783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b057cb0b-aadd-4e0e-96a4-a8600ebf6124 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.160480 Aug 24 05:35:51.115331 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1775/3440] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:35:50 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:35:52.138162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:52.138891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:52.145499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:52.145971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:52.146405 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:52.147117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:52.147570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:52.147995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:52.280097 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:52.288821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:52.290278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:52.291491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0d5e8fda-b6d3-46d0-b841-acfd01cb749d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.157603 Aug 24 05:35:52.292040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1666/3441] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:35:52 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:35:53.316467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:53.317145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:53.323700 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:53.324183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:53.324615 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:53.325315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:53.325764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:53.326190 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:53.464073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:53.473026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:53.474650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:53.475885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-22bce518-8d00-42c7-9485-55c2e19f8fbf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 200 len: 1726 microversion: 2.20 time: 0.164164 Aug 24 05:35:53.476640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1776/3442] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:35:53 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:35:53.720016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-75584264-f0c4-4823-96d3-83ea09c778a0 req-487f5f1e-d837-4270-a74d-a6ba49ef7ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "342b0ec6-3c25-4b72-bcb1-88878f3d85e8", "name": "network-vif-deleted", "tag": "e783a71b-b500-4cdb-96c0-ecd825b2a9c5"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:35:53.733807 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-75584264-f0c4-4823-96d3-83ea09c778a0 req-487f5f1e-d837-4270-a74d-a6ba49ef7ec4 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:53.734358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-75584264-f0c4-4823-96d3-83ea09c778a0 req-487f5f1e-d837-4270-a74d-a6ba49ef7ec4 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:53.734817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-75584264-f0c4-4823-96d3-83ea09c778a0 req-487f5f1e-d837-4270-a74d-a6ba49ef7ec4 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:53.748697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-75584264-f0c4-4823-96d3-83ea09c778a0 req-487f5f1e-d837-4270-a74d-a6ba49ef7ec4 service nova] Creating event network-vif-deleted:e783a71b-b500-4cdb-96c0-ecd825b2a9c5 for instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 on hv-cinder-85426 Aug 24 05:35:53.754431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-75584264-f0c4-4823-96d3-83ea09c778a0 req-487f5f1e-d837-4270-a74d-a6ba49ef7ec4 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037917 Aug 24 05:35:53.755431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1667/3443] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:35:54.499400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:54.500002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:54.507371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:54.507947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:54.508379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:54.509072 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:54.509519 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:54.509935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:54.525193 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] HTTP exception thrown: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Request method failure captured: Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 HTTP/1.1 Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBbeR-EPeHubq7OxuVGxJiWxVw2tH1RVAwQhMbOw5T9dsTekL7O15CgiWsC0ztV9E2UHA5A4jTjeu9iRoEQuFUi6_4S5jCraRkoNp50xkYJptyT_AzAlqS3PDmB0wJVXb-ip-EbIQATqH2npyjb2bWefFCtFNfqYMdjp1L8KJsflFZY0 Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:35:54.526884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/721b72380f284f80a5e56aac69688224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_721b72380f284f80a5e56aac69688224", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 0549cf43ea544faba1e7a2d8fe2f6a27 Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:35:54.528420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '342b0ec6-3c25-4b72-bcb1-88878f3d85e8'} Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:35:54.529207 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:35:54.530310 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:35:54.531348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Returning 404 to user: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:35:54.531348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a1b9bc49-81c0-4a4f-821e-a294f588222c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 404 len: 111 microversion: 2.20 time: 0.032752 Aug 24 05:35:54.531348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1777/3444] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:35:54 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:35:54.538383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b8a3311a-7eb9-49bd-8c43-6bd37466edfa tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '.version_select at 0x7f359029db80>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:54.559023 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b8a3311a-7eb9-49bd-8c43-6bd37466edfa tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1761409279" status: 204 len: 0 microversion: 2.20 time: 0.025017 Aug 24 05:35:54.559599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1668/3445] 10.222.0.97 () {60 vars in 1262 bytes} [Wed Aug 24 05:35:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1761409279 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:35:55.198931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6ee8b264-0068-45c1-8200-fc99c67d86ef tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Action: 'create', calling method: .version_select at 0x7f3594288430>, body: {"keypair": {"name": "tempest-keypair-1182699228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFVnw6r41V5iBgqkQR1KvRo8TuLqb1aXA4WTAZLvNxRyasmjGX1iXx3gFJT9YLmJ4/z6m8pE0hs7reVfTKLzdhGA4B5VSsj42w69RFD1cdFSQKbT75ysqkUxOyzuB4cKUg=="}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:35:55.214078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-6ee8b264-0068-45c1-8200-fc99c67d86ef tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Getting quotas for project 721b72380f284f80a5e56aac69688224. Resources: {'key_pairs'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:35:55.217841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-6ee8b264-0068-45c1-8200-fc99c67d86ef tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Getting quotas for user 0549cf43ea544faba1e7a2d8fe2f6a27 and project 721b72380f284f80a5e56aac69688224. Resources: {'key_pairs'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:35:55.240641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6ee8b264-0068-45c1-8200-fc99c67d86ef tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044756 Aug 24 05:35:55.241227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1778/3446] 10.222.0.97 () {62 vars in 1200 bytes} [Wed Aug 24 05:35:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 05:35:56.499375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-758477901", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd1b9fe7-5c01-40a1-bd69-d32f9fba19ee"}], "security_groups": [{"name": "tempest-securitygroup--689265108"}], "key_name": "tempest-keypair-1182699228", "user_data": "}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:35:56.605669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] validate_networks() for [('cd1b9fe7-5c01-40a1-bd69-d32f9fba19ee', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:35:57.121647 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:35:57.122059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:35:57.122520 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:35:57.122970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:35:57.123371 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:35:57.132615 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:57.133084 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:57.133504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:57.134207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:57.134654 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:57.135101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:57.152561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Getting quotas for project 721b72380f284f80a5e56aac69688224. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:35:57.156438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Getting quotas for user 0549cf43ea544faba1e7a2d8fe2f6a27 and project 721b72380f284f80a5e56aac69688224. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:35:57.168046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:35:57.170369 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:35:57.217455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-881d158d-512b-4cd9-b16e-8c23ba5568ae tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.722976 Aug 24 05:35:57.218096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1669/3447] 10.222.0.97 () {62 vars in 1188 bytes} [Wed Aug 24 05:35:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 05:35:57.230043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-27e57094-b2b9-4732-8ae6-cdc5a2ca3193 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:57.230646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-27e57094-b2b9-4732-8ae6-cdc5a2ca3193 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:57.288126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-27e57094-b2b9-4732-8ae6-cdc5a2ca3193 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:57.296234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-27e57094-b2b9-4732-8ae6-cdc5a2ca3193 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:57.297756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-27e57094-b2b9-4732-8ae6-cdc5a2ca3193 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:57.298889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-27e57094-b2b9-4732-8ae6-cdc5a2ca3193 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1281 microversion: 2.20 time: 0.073212 Aug 24 05:35:57.299679 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1779/3448] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:35:57 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:35:58.321276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:58.321871 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:58.328649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:58.329124 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:58.329560 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:58.330237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:58.330920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:58.331340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:58.404499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:58.413818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:58.415320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:58.416406 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2e9ce0c4-2963-4a62-993a-a7c544c4bba5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1339 microversion: 2.20 time: 0.099635 Aug 24 05:35:58.416963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1670/3449] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:35:58 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:35:59.439978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:35:59.440764 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:35:59.447793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:59.448273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:59.448702 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:59.449564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:59.450019 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:59.450440 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:59.583280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:59.591557 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:59.593055 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:35:59.594151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7b5a2f49-c0a9-40eb-a676-4000bf6da5d7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1406 microversion: 2.20 time: 0.158136 Aug 24 05:35:59.594740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1780/3450] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:35:59 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:35:59.877319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-29bcfff1-aa41-4ce4-8b0b-e919815a4d6e req-71f016d8-29c9-4caf-84f2-0791787d9621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dbf3649-33d4-4e5f-abb3-720b1b8802f8", "tag": "4c03fd3f-89c8-4628-a987-222cb53fd98d"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:35:59.888377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-29bcfff1-aa41-4ce4-8b0b-e919815a4d6e req-71f016d8-29c9-4caf-84f2-0791787d9621 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:35:59.888758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-29bcfff1-aa41-4ce4-8b0b-e919815a4d6e req-71f016d8-29c9-4caf-84f2-0791787d9621 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:35:59.889372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-29bcfff1-aa41-4ce4-8b0b-e919815a4d6e req-71f016d8-29c9-4caf-84f2-0791787d9621 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:35:59.901423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-29bcfff1-aa41-4ce4-8b0b-e919815a4d6e req-71f016d8-29c9-4caf-84f2-0791787d9621 service nova] Creating event network-changed:4c03fd3f-89c8-4628-a987-222cb53fd98d for instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 on hv-cinder-85426 Aug 24 05:35:59.912765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-29bcfff1-aa41-4ce4-8b0b-e919815a4d6e req-71f016d8-29c9-4caf-84f2-0791787d9621 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038931 Aug 24 05:35:59.913377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1671/3451] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:36:00.616961 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:00.617552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:36:00.624242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:00.624721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:00.625149 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:00.625829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:00.626275 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:00.626718 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:00.760139 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:00.769154 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:00.770752 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:00.771853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-40af95b6-f8d8-4a97-8a55-a67b427f5624 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1406 microversion: 2.20 time: 0.159519 Aug 24 05:36:00.772406 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1781/3452] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:36:00 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:36:01.795949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:01.796636 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:36:01.803587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:01.804063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:01.804491 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:01.805197 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:01.805649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:01.806067 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:01.947278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:01.955347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:01.956896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:01.957979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f14e178b-6377-4e26-83ed-8f86fa073df4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1406 microversion: 2.20 time: 0.166900 Aug 24 05:36:01.958536 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1672/3453] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:36:01 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:36:02.980501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:02.981106 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:36:02.988410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:02.988903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:02.989360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:02.990291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:02.990895 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:02.991322 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:03.121191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:03.129499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:03.131031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:03.132128 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c48b3825-4f2c-4991-b9d1-69c9109dd15b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1406 microversion: 2.20 time: 0.155656 Aug 24 05:36:03.132690 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1782/3454] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:36:02 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:36:04.155482 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:04.156017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:36:04.163013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:04.163492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:04.163924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:04.164603 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:04.165051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:04.165470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:04.298467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:04.307340 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:04.309127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:04.310219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dc111d02-1c01-4c56-85f2-3e2c2a98c964 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1406 microversion: 2.20 time: 0.158755 Aug 24 05:36:04.310798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1673/3455] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:36:04 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:36:04.523123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-ddfd7567-b4b0-4995-a773-ea06b4a85b01 req-76f90cc5-9181-4da8-b729-d055b7843754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbf3649-33d4-4e5f-abb3-720b1b8802f8", "name": "network-vif-plugged", "status": "completed", "tag": "4c03fd3f-89c8-4628-a987-222cb53fd98d"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:36:04.533483 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ddfd7567-b4b0-4995-a773-ea06b4a85b01 req-76f90cc5-9181-4da8-b729-d055b7843754 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:04.534223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ddfd7567-b4b0-4995-a773-ea06b4a85b01 req-76f90cc5-9181-4da8-b729-d055b7843754 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:04.535130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ddfd7567-b4b0-4995-a773-ea06b4a85b01 req-76f90cc5-9181-4da8-b729-d055b7843754 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:04.546853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-ddfd7567-b4b0-4995-a773-ea06b4a85b01 req-76f90cc5-9181-4da8-b729-d055b7843754 service nova] Creating event network-vif-plugged:4c03fd3f-89c8-4628-a987-222cb53fd98d for instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 on hv-cinder-85426 Aug 24 05:36:04.556862 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-ddfd7567-b4b0-4995-a773-ea06b4a85b01 req-76f90cc5-9181-4da8-b729-d055b7843754 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038466 Aug 24 05:36:04.557872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1783/3456] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:36:05.332706 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:05.333302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:36:05.339738 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:05.340213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:05.340652 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:05.341324 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:05.341773 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:05.342193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:05.476104 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:05.484268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:05.485753 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:05.486876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-35749f7c-c8fd-4750-aec6-95f1fef6318a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1406 microversion: 2.20 time: 0.158562 Aug 24 05:36:05.487454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1674/3457] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:36:05 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:36:06.509231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:06.509954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:36:06.516460 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:06.516950 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:06.517374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:06.518069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:06.518581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:06.519280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:06.657568 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:06.665817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:06.667358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:06.668448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-654cf012-5bd3-4ca2-9ba6-35159b7cc407 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1406 microversion: 2.20 time: 0.163997 Aug 24 05:36:06.669002 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1784/3458] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:36:06 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:36:07.693432 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:07.693985 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:36:07.696161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:07.697016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=6 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:07.702823 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:07.703300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:07.703729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:07.704411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:07.704854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:07.705274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:07.835994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:07.844403 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:07.845887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:36:07.847495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c5e6df2b-ae5f-42fe-a607-4a857174f0cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1598 microversion: 2.20 time: 0.158889 Aug 24 05:36:07.848048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1675/3459] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:36:07 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:36:07.869468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a119151e-0fdb-4fc2-a850-3c290d9c2424 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:36:07.869948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a119151e-0fdb-4fc2-a850-3c290d9c2424 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:36:07.871939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=6 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:36:07.878216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a119151e-0fdb-4fc2-a850-3c290d9c2424 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:07.878713 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a119151e-0fdb-4fc2-a850-3c290d9c2424 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:07.879160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a119151e-0fdb-4fc2-a850-3c290d9c2424 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:07.879844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a119151e-0fdb-4fc2-a850-3c290d9c2424 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:07.880289 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a119151e-0fdb-4fc2-a850-3c290d9c2424 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:07.880709 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a119151e-0fdb-4fc2-a850-3c290d9c2424 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:07.962327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a119151e-0fdb-4fc2-a850-3c290d9c2424 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096749 Aug 24 05:36:07.962951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1785/3460] 10.222.0.97 () {60 vars in 1316 bytes} [Wed Aug 24 05:36:07 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:36:08.766370 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:36:08.766591 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:36:09.011551 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-5f954617-45e1-41aa-88b3-5594a1fb2c8c req-ac96159a-b38c-4a45-922f-aa4eec9d4b71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dbf3649-33d4-4e5f-abb3-720b1b8802f8", "tag": "4c03fd3f-89c8-4628-a987-222cb53fd98d"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:36:09.022356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-5f954617-45e1-41aa-88b3-5594a1fb2c8c req-ac96159a-b38c-4a45-922f-aa4eec9d4b71 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:36:09.022870 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-5f954617-45e1-41aa-88b3-5594a1fb2c8c req-ac96159a-b38c-4a45-922f-aa4eec9d4b71 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:36:09.023302 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-5f954617-45e1-41aa-88b3-5594a1fb2c8c req-ac96159a-b38c-4a45-922f-aa4eec9d4b71 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:36:09.034834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-5f954617-45e1-41aa-88b3-5594a1fb2c8c req-ac96159a-b38c-4a45-922f-aa4eec9d4b71 service nova] Creating event network-changed:4c03fd3f-89c8-4628-a987-222cb53fd98d for instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 on hv-cinder-85426 Aug 24 05:36:09.039821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-5f954617-45e1-41aa-88b3-5594a1fb2c8c req-ac96159a-b38c-4a45-922f-aa4eec9d4b71 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170763 Aug 24 05:36:09.040429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1676/3461] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:23.891469 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:23.892271 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:23.897304 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-075759e0-da0e-486c-9054-3142897e2239 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:23.897799 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-075759e0-da0e-486c-9054-3142897e2239 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:23.905850 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-075759e0-da0e-486c-9054-3142897e2239 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:23.906326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-075759e0-da0e-486c-9054-3142897e2239 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:23.906785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-075759e0-da0e-486c-9054-3142897e2239 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:23.907479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-075759e0-da0e-486c-9054-3142897e2239 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:23.907928 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-075759e0-da0e-486c-9054-3142897e2239 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:23.908348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-075759e0-da0e-486c-9054-3142897e2239 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:23.933040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-075759e0-da0e-486c-9054-3142897e2239 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/ips" status: 200 len: 152 microversion: 2.20 time: 0.043674 Aug 24 05:37:23.933596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1786/3462] 10.222.0.97 () {60 vars in 1289 bytes} [Wed Aug 24 05:37:23 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 05:37:25.754787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:25.755687 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:25.760832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e0640469-22d8-4cff-904a-85d4f50d4d16 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:25.761443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e0640469-22d8-4cff-904a-85d4f50d4d16 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:25.771160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0640469-22d8-4cff-904a-85d4f50d4d16 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:25.771635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0640469-22d8-4cff-904a-85d4f50d4d16 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:25.772061 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0640469-22d8-4cff-904a-85d4f50d4d16 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:25.772783 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0640469-22d8-4cff-904a-85d4f50d4d16 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:25.773229 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0640469-22d8-4cff-904a-85d4f50d4d16 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:25.773645 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e0640469-22d8-4cff-904a-85d4f50d4d16 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:25.799137 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-e0640469-22d8-4cff-904a-85d4f50d4d16 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lazy-loading 'flavor' on Instance uuid 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:37:26.081483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e0640469-22d8-4cff-904a-85d4f50d4d16 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "POST /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/action" status: 202 len: 0 microversion: 2.20 time: 0.328667 Aug 24 05:37:26.082633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1677/3463] 10.222.0.97 () {62 vars in 1319 bytes} [Wed Aug 24 05:37:25 2022] POST /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:37:26.090894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:26.091508 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:26.098916 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:26.099434 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:26.099842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:26.100670 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:26.101142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:26.101566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:26.290045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:26.298174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:26.299716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:26.300940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-747ac9b0-88d8-49fa-ac8e-e736a10b65e2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.214016 Aug 24 05:37:26.301650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1787/3464] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:26 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:27.325459 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:27.326153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:27.335294 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:27.335776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:27.336211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:27.336891 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:27.337342 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:27.337763 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:27.469802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:27.478076 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:27.479607 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:27.480752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-017ac75b-f028-45d8-957f-eb3b24340097 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.160090 Aug 24 05:37:27.481303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1678/3465] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:27 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:28.503767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:28.504432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:28.510896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:28.511376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:28.511808 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:28.512484 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:28.512932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:28.513352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:28.642400 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:28.650762 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:28.652261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:28.653396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-204da53e-add3-4122-a0a7-a0039c2ddfb5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.153662 Aug 24 05:37:28.653954 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1788/3466] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:28 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:29.678274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:29.679038 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:29.685844 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:29.686318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:29.686887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:29.687569 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:29.688013 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:29.688423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:29.817524 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:29.825983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:29.827585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:29.828724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-7d863960-5216-4692-b7da-74e4be73361e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.155649 Aug 24 05:37:29.829274 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1679/3467] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:29 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:30.852214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:30.852837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:30.859272 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:30.859782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:30.860218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:30.860896 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:30.861348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:30.861795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:30.992265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:31.000333 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:31.001858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:31.003027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-67a65b41-6a50-4e38-92cb-dea41c69bb20 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.155685 Aug 24 05:37:31.004160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1789/3468] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:30 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:32.026758 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:32.027319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:32.033673 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:32.034150 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:32.034588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:32.036090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:32.036542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:32.036962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:32.168625 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:32.177032 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:32.178547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:32.179730 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-261af954-1db5-4223-857c-d68a399dc511 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.156991 Aug 24 05:37:32.180290 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1680/3469] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:32 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:33.203601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:33.204208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:33.211387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:33.211859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:33.212290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:33.212966 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:33.213411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:33.213835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:33.343545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:33.352234 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:33.353727 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:33.354894 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4f5d36d2-fcf5-405a-88b2-9e7abdba1e10 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.155233 Aug 24 05:37:33.355438 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1790/3470] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:33 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:34.377200 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:34.377806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:34.385105 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:34.385587 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:34.386037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:34.386727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:34.387186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:34.387609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:34.514547 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:34.525533 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:34.527136 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:34.528319 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b4870250-f624-4661-a00a-5be127a183e6 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.155052 Aug 24 05:37:34.528873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1681/3471] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:34 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:35.551428 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:35.551957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:35.558391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:35.559146 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:35.559584 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:35.560261 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:35.560706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:35.561130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:35.695100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:35.703284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:35.704813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:35.705944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3868f709-2921-4978-957e-16b8a9eadab0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.159023 Aug 24 05:37:35.706526 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1791/3472] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:35 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:36.728112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:36.728722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:36.735484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:36.735966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:36.736398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:36.737082 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:36.737526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:36.738697 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:36.865589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:36.873689 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:36.875214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:36.876358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-b8690b27-cf31-40bb-91cd-f9201765c8f1 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.152140 Aug 24 05:37:36.876911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1682/3473] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:36 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:37.899175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:37.899777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:37.906381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:37.906908 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:37.907345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:37.908026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:37.908472 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:37.908892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:38.040648 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:38.048756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:38.050793 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:38.052751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d7dadee4-6c31-49ab-b88b-88ffe80cd14a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1744 microversion: 2.20 time: 0.156820 Aug 24 05:37:38.052751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1792/3474] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:37 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:37:39.076360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:39.077012 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:39.083286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:39.083750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:39.084189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:39.084887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:39.085336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:39.085805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:39.218414 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:39.227375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:39.228887 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:39.230045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bd35822f-b451-4306-a39d-2c9a1567edd0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1744 microversion: 2.20 time: 0.157733 Aug 24 05:37:39.230608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1683/3475] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:39 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:40.253279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:40.254881 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:40.261293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:40.261768 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:40.262195 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:40.262906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:40.263351 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:40.263767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:40.396891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:40.405014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:40.406518 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:40.407797 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7ea5dbb0-23d1-45f5-b879-265def39aa77 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1744 microversion: 2.20 time: 0.158429 Aug 24 05:37:40.408364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1793/3476] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:40 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:40.974352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-7c65dd85-e3dd-4428-ad7e-9ac041fe7c60 req-3b80eaaf-5975-42d0-8e08-c2a13ff7f18b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbf3649-33d4-4e5f-abb3-720b1b8802f8", "name": "network-vif-plugged", "status": "completed", "tag": "4c03fd3f-89c8-4628-a987-222cb53fd98d"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:40.984642 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-7c65dd85-e3dd-4428-ad7e-9ac041fe7c60 req-3b80eaaf-5975-42d0-8e08-c2a13ff7f18b service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:40.985185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-7c65dd85-e3dd-4428-ad7e-9ac041fe7c60 req-3b80eaaf-5975-42d0-8e08-c2a13ff7f18b service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:40.985558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-7c65dd85-e3dd-4428-ad7e-9ac041fe7c60 req-3b80eaaf-5975-42d0-8e08-c2a13ff7f18b service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:40.999584 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-7c65dd85-e3dd-4428-ad7e-9ac041fe7c60 req-3b80eaaf-5975-42d0-8e08-c2a13ff7f18b service nova] Creating event network-vif-plugged:4c03fd3f-89c8-4628-a987-222cb53fd98d for instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 on hv-cinder-85426 Aug 24 05:37:41.004764 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-7c65dd85-e3dd-4428-ad7e-9ac041fe7c60 req-3b80eaaf-5975-42d0-8e08-c2a13ff7f18b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034772 Aug 24 05:37:41.005357 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1684/3477] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:41.430672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:41.431229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:41.437945 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:41.438418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:41.438879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:41.439554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:41.440003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:41.440420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:41.572891 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:41.581088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:41.582625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:41.585129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-280eb226-4717-4c18-a172-a3090b5640f9 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1744 microversion: 2.20 time: 0.158432 Aug 24 05:37:41.585687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1794/3478] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:41 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:42.608860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:42.609688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:42.616339 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:42.616825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:42.617315 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:42.618083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:42.618447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:42.618922 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:42.758477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:42.767117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:42.768626 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:42.769966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fd89df16-9248-4886-ba35-0b7703623da2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1739 microversion: 2.20 time: 0.165847 Aug 24 05:37:42.770508 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1685/3479] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:42 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:43.794529 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:43.795885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:43.802971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:43.803942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:43.804582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:43.805475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:43.806120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:43.806882 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:43.963496 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:43.976371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:43.978931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:43.980109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-32e284b2-fcfe-4f83-9399-19f235e5b473 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1739 microversion: 2.20 time: 0.190599 Aug 24 05:37:43.995017 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1795/3480] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:43 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:45.008623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:45.009156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:45.016235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:45.017243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:45.017915 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:45.020182 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:45.020820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:45.021256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:45.174423 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:45.184230 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:45.186085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:45.187372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4b0e2ca6-6721-472b-abe8-7785cef3d9a0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1739 microversion: 2.20 time: 0.182651 Aug 24 05:37:45.199209 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1686/3481] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:45 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:46.211855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:46.212455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:46.218985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:46.219463 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:46.220073 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:46.220771 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:46.221213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:46.221627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:46.372291 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:46.385380 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:46.387081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:46.388258 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b9381b54-a55a-4b28-8a83-c480768cfb0c tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1739 microversion: 2.20 time: 0.180636 Aug 24 05:37:46.409286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1796/3482] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:46 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:47.416286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:47.416920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:47.424469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:47.424956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:47.426014 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:47.426919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:47.427378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:47.427804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:47.575845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:47.585748 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:47.587392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:47.589192 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-438f208e-5b02-42dd-9dd0-acd044f2f122 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1739 microversion: 2.20 time: 0.176674 Aug 24 05:37:47.590045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1687/3483] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:47 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:48.616620 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:48.618175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:48.623625 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:48.624091 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:48.624513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:48.625197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:48.625639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:48.630722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:48.777468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:48.787213 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:48.788798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:48.789988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-28cb2c85-a6d1-4b3a-b2b6-fc68d3a65c88 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1739 microversion: 2.20 time: 0.177987 Aug 24 05:37:48.790540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1797/3484] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:48 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:37:49.813787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:49.814412 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:49.823571 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:49.824160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:49.824604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:49.825306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:49.825762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:49.826189 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:49.975948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:49.984692 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:49.986264 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:49.988018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f27fa6c5-469e-4002-abc6-a73366fedf5b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1739 microversion: 2.20 time: 0.177748 Aug 24 05:37:50.004211 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1688/3485] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:49 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:51.011983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:51.012705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:51.020922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:51.020922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:51.020922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:51.020922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:51.021338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:51.021601 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:51.169188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:51.180985 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:51.182514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:51.184187 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1cad8d67-a8ef-46b3-a63b-275b2a76d17e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1739 microversion: 2.20 time: 0.176151 Aug 24 05:37:51.185035 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1798/3486] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:51 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:52.208457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:52.209044 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:52.215588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:52.216060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:52.216489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:52.217225 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:52.217671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:52.218086 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:52.349559 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:52.357832 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:52.359384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:52.360538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c5212556-8b5b-4f5f-9ec5-985aad68fe80 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1739 microversion: 2.20 time: 0.156212 Aug 24 05:37:52.361093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1689/3487] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:52 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:53.386507 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:53.387147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:53.393748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:53.394326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:53.394786 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:53.395473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:53.395926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:53.396355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:53.528629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:53.537369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:53.538909 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:53.540061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-cc95bb5c-6e7d-4e49-9575-6b99e0232285 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1721 microversion: 2.20 time: 0.157483 Aug 24 05:37:53.540613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1799/3488] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:53 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:54.563429 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:54.564015 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:54.571116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:54.571585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:54.572009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:54.572678 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:54.573118 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:54.573530 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:54.702604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:54.710919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:54.712407 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:54.713542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-90c593ee-d4ff-4750-9fc3-0eba7c801c31 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1721 microversion: 2.20 time: 0.154326 Aug 24 05:37:54.714090 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1690/3489] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:54 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:55.027229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-b4e4299c-a013-450d-86db-30229e13253c req-54c141d8-e384-43e3-bb00-6b541ba86691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbf3649-33d4-4e5f-abb3-720b1b8802f8", "name": "network-vif-unplugged", "status": "completed", "tag": "4c03fd3f-89c8-4628-a987-222cb53fd98d"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:55.032425 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=29 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:55.041121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-b4e4299c-a013-450d-86db-30229e13253c req-54c141d8-e384-43e3-bb00-6b541ba86691 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:55.041884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-b4e4299c-a013-450d-86db-30229e13253c req-54c141d8-e384-43e3-bb00-6b541ba86691 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:55.042313 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-b4e4299c-a013-450d-86db-30229e13253c req-54c141d8-e384-43e3-bb00-6b541ba86691 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:55.046323 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=83 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:55.055430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-b4e4299c-a013-450d-86db-30229e13253c req-54c141d8-e384-43e3-bb00-6b541ba86691 service nova] Creating event network-vif-unplugged:4c03fd3f-89c8-4628-a987-222cb53fd98d for instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 on hv-cinder-85426 Aug 24 05:37:55.060942 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-b4e4299c-a013-450d-86db-30229e13253c req-54c141d8-e384-43e3-bb00-6b541ba86691 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037477 Aug 24 05:37:55.061686 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1800/3490] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:37:55.737282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:55.738868 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:55.746631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:55.747139 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:55.747589 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:55.748256 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:55.748710 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:55.749133 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:55.879825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:55.882092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:55.889614 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:55.891153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:55.892311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-04cce79f-543f-4536-b029-f7e43b973a5d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1664 microversion: 2.20 time: 0.158945 Aug 24 05:37:55.892861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1691/3491] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:55 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:55.916299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-506bc6b0-705b-48fa-bdcc-e6e8aed9d143 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65ae6625-fdfe-42f7-a4b8-e38b30bd0843"}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:55.918705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-506bc6b0-705b-48fa-bdcc-e6e8aed9d143 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:55.924748 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-506bc6b0-705b-48fa-bdcc-e6e8aed9d143 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:55.925265 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-506bc6b0-705b-48fa-bdcc-e6e8aed9d143 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:55.925695 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-506bc6b0-705b-48fa-bdcc-e6e8aed9d143 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:55.926375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-506bc6b0-705b-48fa-bdcc-e6e8aed9d143 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:55.926906 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-506bc6b0-705b-48fa-bdcc-e6e8aed9d143 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:55.927332 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-506bc6b0-705b-48fa-bdcc-e6e8aed9d143 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:56.219311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-506bc6b0-705b-48fa-bdcc-e6e8aed9d143 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "POST /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307567 Aug 24 05:37:56.219977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1801/3492] 10.222.0.97 () {62 vars in 1364 bytes} [Wed Aug 24 05:37:55 2022] POST /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/os-volume_attachments => generated 188 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 05:37:56.342156 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-605107e5-afed-4f2d-ac62-bb7e3fb7bcf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:56.342641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-605107e5-afed-4f2d-ac62-bb7e3fb7bcf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:56.344433 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=31 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:37:56.350866 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-605107e5-afed-4f2d-ac62-bb7e3fb7bcf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:56.351346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-605107e5-afed-4f2d-ac62-bb7e3fb7bcf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:56.351779 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-605107e5-afed-4f2d-ac62-bb7e3fb7bcf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:56.352463 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-605107e5-afed-4f2d-ac62-bb7e3fb7bcf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:56.352908 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-605107e5-afed-4f2d-ac62-bb7e3fb7bcf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:56.353326 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-605107e5-afed-4f2d-ac62-bb7e3fb7bcf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:56.587179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-605107e5-afed-4f2d-ac62-bb7e3fb7bcf3 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "DELETE /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/os-volume_attachments/65ae6625-fdfe-42f7-a4b8-e38b30bd0843" status: 202 len: 0 microversion: 2.20 time: 0.249170 Aug 24 05:37:56.587862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1692/3493] 10.222.0.97 () {60 vars in 1457 bytes} [Wed Aug 24 05:37:56 2022] DELETE /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/os-volume_attachments/65ae6625-fdfe-42f7-a4b8-e38b30bd0843 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:37:56.646199 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a4f21540-84c0-4fe2-8ffd-6374f2e3b475 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:37:56.646794 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a4f21540-84c0-4fe2-8ffd-6374f2e3b475 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:56.652790 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4f21540-84c0-4fe2-8ffd-6374f2e3b475 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:56.653256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4f21540-84c0-4fe2-8ffd-6374f2e3b475 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:56.653685 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4f21540-84c0-4fe2-8ffd-6374f2e3b475 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:56.654357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4f21540-84c0-4fe2-8ffd-6374f2e3b475 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:56.654821 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4f21540-84c0-4fe2-8ffd-6374f2e3b475 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:56.655241 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a4f21540-84c0-4fe2-8ffd-6374f2e3b475 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:56.687226 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a4f21540-84c0-4fe2-8ffd-6374f2e3b475 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120558) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:37:56.752880 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a4f21540-84c0-4fe2-8ffd-6374f2e3b475 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "POST /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/action" status: 202 len: 0 microversion: 2.20 time: 0.110901 Aug 24 05:37:56.757145 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1802/3494] 10.222.0.97 () {62 vars in 1319 bytes} [Wed Aug 24 05:37:56 2022] POST /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:37:56.762318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:56.762949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:56.770021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:56.770504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:56.770971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:56.771663 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:56.772112 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:56.772531 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:56.931206 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:56.939796 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:56.942089 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:56.943276 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-6ea851f9-57f2-43aa-bfd6-b4193001e32f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1672 microversion: 2.20 time: 0.184883 Aug 24 05:37:56.943825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1693/3495] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:56 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:57.966922 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:57.967530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:57.974133 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:57.974608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:57.975070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:57.975755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:57.976212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:57.976737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:58.106147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:58.115100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:58.116609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:58.117759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-dfb11f9c-4323-4035-807e-cc1d8797f290 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1672 microversion: 2.20 time: 0.155297 Aug 24 05:37:58.118314 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1803/3496] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:57 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:37:59.142910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:37:59.144258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:37:59.150999 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:59.151484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:59.151916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:59.152595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:37:59.153040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:37:59.153460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:37:59.286310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:59.294672 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:59.296244 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:37:59.297388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3e2d028a-977a-490a-a7b6-25d68f24197f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1672 microversion: 2.20 time: 0.158416 Aug 24 05:37:59.297948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1694/3497] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:37:59 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:00.320952 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:00.321546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:00.328022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:00.328492 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:00.328917 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:00.329585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:00.330026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:00.330439 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:00.462286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:00.470415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:00.472830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:00.473962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c382920b-a5b0-4bba-893e-31d6d043612b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1672 microversion: 2.20 time: 0.156972 Aug 24 05:38:00.474515 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1804/3498] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:00 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:01.496345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:01.496960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:01.504096 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:01.504590 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:01.505011 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:01.505745 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:01.506141 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:01.506562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:01.640316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:01.649268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:01.650806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:01.651946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d36c66c7-8436-4dcc-af83-13b4c8e32f42 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1674 microversion: 2.20 time: 0.159557 Aug 24 05:38:01.652493 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1695/3499] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:01 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:02.674230 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:02.675408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:02.681932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:02.682412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:02.682885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:02.683564 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:02.684269 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:02.684705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:02.822960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:02.831548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:02.833070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:02.834211 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e1bdc8c0-0436-4f11-ad2d-e5f9b424a78b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.163945 Aug 24 05:38:02.834792 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1805/3500] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:02 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:03.857497 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:03.858144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:03.865864 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:03.866344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:03.866804 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:03.867499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:03.868129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:03.868581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:04.007599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:04.016254 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:04.017814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:04.019724 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-21909fbe-c9b4-4fc7-bd5f-dbfcc9c976c8 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.166211 Aug 24 05:38:04.020447 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1696/3501] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:03 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:05.043742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:05.044488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:05.052628 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:05.053236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:05.053820 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:05.054864 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:05.055475 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:05.056038 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:05.227596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:05.235948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:05.237548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:05.240010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e6ba3b0b-ca8e-44b9-9e2d-60083d640c3b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.200116 Aug 24 05:38:05.250754 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1806/3502] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:05 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:38:06.263253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:06.264083 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:06.272352 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:06.272811 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:06.273269 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:06.273956 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:06.274397 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:06.274848 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:06.417010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:06.425382 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:06.427201 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:06.428360 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bc3abbda-2d8f-4a92-bf8b-5d304160125d tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.169313 Aug 24 05:38:06.428911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1697/3503] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:06 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:07.451432 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:07.452934 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:07.460401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:07.460978 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:07.461488 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:07.462270 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:07.462782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:07.463214 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:07.604971 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:07.614296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:07.616078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:07.617250 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-039c7eb8-470a-4b65-bc6d-e13f64086635 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.169771 Aug 24 05:38:07.617819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1807/3504] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:07 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:08.641649 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:08.642222 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:08.648688 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:08.649173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:08.649606 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:08.650307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:08.650775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:08.651194 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:08.789470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:08.798098 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:08.799641 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:08.800803 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-857a62e5-6a72-4370-864b-03e209a8cb51 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.163381 Aug 24 05:38:08.802110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1698/3505] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:08 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:09.825682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:09.826295 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:09.833609 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:09.834076 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:09.834516 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:09.835240 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:09.835687 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:09.836112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:09.980231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:09.988828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:09.991057 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:09.992221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-17d95a4c-62d0-416f-ac84-7ee33563a49e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.170481 Aug 24 05:38:09.992784 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1808/3506] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:09 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:11.016009 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:11.016901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:11.024335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:11.024888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:11.025409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:11.026174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:11.026759 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:11.027227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:11.174542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:11.185268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:11.186802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:11.188115 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-625fa616-55d2-48d0-9688-335a98bb3f01 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.175972 Aug 24 05:38:11.198356 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1699/3507] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:11 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:12.212167 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:12.212770 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:12.219239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:12.219742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:12.220175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:12.220844 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:12.221302 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:12.221707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:12.355397 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:12.363466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:12.365041 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:12.366175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e0fe66d2-703a-4eca-8f35-c4e15be5272e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.158297 Aug 24 05:38:12.366744 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1809/3508] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:12 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:13.388862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:13.389396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:13.396402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:13.396876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:13.397305 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:13.397979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:13.398422 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:13.398872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:13.526445 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:13.534511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:13.536613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:13.537757 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f774efab-c199-4ae3-90b8-25b3f5908cf7 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.152870 Aug 24 05:38:13.538310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1700/3509] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:13 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:14.561061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:14.561657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:14.568013 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:14.568485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:14.568911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:14.569585 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:14.570025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:14.570435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:14.698341 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:14.706420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:14.708448 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:14.709571 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-8abc1a05-a184-4abe-a031-101f586e075a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.152678 Aug 24 05:38:14.710122 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1810/3510] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:14 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:15.732563 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:15.734938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:15.739834 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:15.740316 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:15.740752 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:15.741439 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:15.741888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:15.742311 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:15.869627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:15.877784 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:15.879829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:15.881085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-79e62490-2e0d-4ae2-97f4-0f45a4d26217 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.152492 Aug 24 05:38:15.881637 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1701/3511] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:15 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:16.904868 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:16.905435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:16.912290 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:16.912755 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:16.913174 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:16.913841 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:16.914281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:16.914716 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:17.047067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:17.055777 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:17.057260 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:17.058386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5ff4b42d-96cd-4bfc-895b-c3f60e05e7a2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.157443 Aug 24 05:38:17.058958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1811/3512] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:16 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:18.080817 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:18.081344 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:18.087969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:18.088448 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:18.088899 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:18.089568 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:18.090018 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:18.090443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:18.223179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:18.232212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:18.233722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:18.234988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e449d6ab-70c3-41aa-a1f1-8443e55b7cf5 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.158117 Aug 24 05:38:18.235542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1702/3513] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:18 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:19.258209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:19.258878 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:19.265495 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:19.265969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:19.266401 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:19.267099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:19.267544 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:19.267960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:19.396566 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:19.404619 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:19.406120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:19.407284 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-10d75e70-827c-4c65-91d6-3f777866be8f tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.153661 Aug 24 05:38:19.407837 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1812/3514] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:19 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:38:20.430187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:20.430813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:20.437486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:20.437960 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:20.438392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:20.439106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:20.439552 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:20.439976 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:20.573174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:20.582234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:20.585010 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:20.586179 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0634206b-b508-4b56-86bb-a844b81b711e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.160001 Aug 24 05:38:20.586750 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1703/3515] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:20 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:21.609320 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:21.609918 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:21.617144 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:21.617612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:21.618060 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:21.618723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:21.619170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:21.619579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:21.746596 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:21.748901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:21.756699 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:21.758191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:21.759373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7caf352d-190c-4ab1-a877-486c0dab1f73 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.154000 Aug 24 05:38:21.759926 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1813/3516] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:21 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:22.782221 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:22.782884 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:22.790335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:22.790846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:22.791292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:22.791970 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:22.792417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:22.792854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:22.924314 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:22.932965 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:22.934781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:22.935977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e10ee988-53c5-498c-9754-29a293186a2b tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.157705 Aug 24 05:38:22.936532 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1704/3517] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:22 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:23.959200 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:23.959807 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:23.967348 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:23.967930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:23.968366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:23.969045 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:23.969493 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:23.969915 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:24.107847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:24.116760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:24.118276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:24.119455 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-349574b0-31c6-4f21-9053-3209b3b3e2cb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.164847 Aug 24 05:38:24.120007 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1814/3518] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:23 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:25.142095 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:25.142721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:25.150408 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:25.150919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:25.151355 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:25.152110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:25.152474 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:25.152894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:25.284443 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:25.288878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:25.295420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:25.296901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:25.298057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-2f50a336-64e3-46ad-96fe-a22aebc62bfc tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.159920 Aug 24 05:38:25.298605 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1705/3519] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:25 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:26.321499 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:26.322104 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:26.324548 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:26.329730 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:26.330206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:26.330640 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:26.331337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:26.331785 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:26.332203 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:26.462524 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:26.470651 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:26.472171 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:26.473338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d62961af-8f6d-44e9-8627-408b9c705d9a tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.156235 Aug 24 05:38:26.473889 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1815/3520] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:26 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:27.194499 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-94ddf61a-88fe-488b-95d1-edf5046c848e req-8091de0a-7ef2-4f03-9068-2b6806f41a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbf3649-33d4-4e5f-abb3-720b1b8802f8", "name": "network-vif-plugged", "status": "completed", "tag": "4c03fd3f-89c8-4628-a987-222cb53fd98d"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:38:27.200107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=28 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:38:27.206553 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-94ddf61a-88fe-488b-95d1-edf5046c848e req-8091de0a-7ef2-4f03-9068-2b6806f41a53 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:27.207093 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-94ddf61a-88fe-488b-95d1-edf5046c848e req-8091de0a-7ef2-4f03-9068-2b6806f41a53 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:27.207475 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-94ddf61a-88fe-488b-95d1-edf5046c848e req-8091de0a-7ef2-4f03-9068-2b6806f41a53 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:27.219215 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-94ddf61a-88fe-488b-95d1-edf5046c848e req-8091de0a-7ef2-4f03-9068-2b6806f41a53 service nova] Creating event network-vif-plugged:4c03fd3f-89c8-4628-a987-222cb53fd98d for instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 on hv-cinder-85426 Aug 24 05:38:27.224760 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-94ddf61a-88fe-488b-95d1-edf5046c848e req-8091de0a-7ef2-4f03-9068-2b6806f41a53 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034482 Aug 24 05:38:27.225595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1706/3521] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:38:27.496970 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:27.497734 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:27.504148 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:27.504691 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:27.505236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:27.506511 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:27.506984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:27.507398 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:27.638753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:27.646885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:27.648418 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:27.649536 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-d533858a-cccc-435e-9081-b85c91c85231 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.156507 Aug 24 05:38:27.650080 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1816/3522] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:27 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:28.673671 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:28.674358 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:28.681226 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:28.681707 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:28.682142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:28.682852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:28.683303 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:28.683723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:28.816492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:28.825216 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:28.826782 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:28.827920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-766e6133-fa8b-4cc1-bf96-dc6cbc6b30bb tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.159140 Aug 24 05:38:28.828480 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1707/3523] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:28 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:29.851336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:29.851874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:29.858442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:29.858962 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:29.859393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:29.860069 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:29.860512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:29.860930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:29.996869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:30.004904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:30.006452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:30.007632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-419a1085-c520-4291-bc86-0026f8b88dea tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1730 microversion: 2.20 time: 0.160873 Aug 24 05:38:30.008212 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1817/3524] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:29 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:38:31.030677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:38:31.031309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:38:31.037869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:31.038309 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:31.038770 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:31.039457 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:38:31.039910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:38:31.040336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:38:31.169379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:31.177522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:31.179693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:38:31.180839 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-28e1b618-ba5f-4671-a28b-a79a8d115f1e tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1717 microversion: 2.20 time: 0.154037 Aug 24 05:38:31.181401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1708/3525] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:38:31 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:39:06.788091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:39:06.788716 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:39:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:39:26.625345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1279c905-37f6-4f9a-abdc-b814e50f8537 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:26.627624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1279c905-37f6-4f9a-abdc-b814e50f8537 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:39:26.629624 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=5 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:26.630273 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=25 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:26.636336 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1279c905-37f6-4f9a-abdc-b814e50f8537 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:26.636816 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1279c905-37f6-4f9a-abdc-b814e50f8537 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:26.637249 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1279c905-37f6-4f9a-abdc-b814e50f8537 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:26.637993 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1279c905-37f6-4f9a-abdc-b814e50f8537 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:26.638443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1279c905-37f6-4f9a-abdc-b814e50f8537 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:26.638900 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1279c905-37f6-4f9a-abdc-b814e50f8537 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:26.668765 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1279c905-37f6-4f9a-abdc-b814e50f8537 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047540 Aug 24 05:39:26.669316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1818/3526] 10.222.0.97 () {60 vars in 1343 bytes} [Wed Aug 24 05:39:26 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:39:26.731481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-46f2d570-1267-4f00-baa4-d9ccd29a2f08 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:26.731988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-46f2d570-1267-4f00-baa4-d9ccd29a2f08 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:39:26.734235 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=5 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:26.735199 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=14 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:39:26.741165 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46f2d570-1267-4f00-baa4-d9ccd29a2f08 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:26.741650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46f2d570-1267-4f00-baa4-d9ccd29a2f08 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:26.742088 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46f2d570-1267-4f00-baa4-d9ccd29a2f08 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:26.742827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46f2d570-1267-4f00-baa4-d9ccd29a2f08 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:26.743283 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46f2d570-1267-4f00-baa4-d9ccd29a2f08 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:26.744409 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-46f2d570-1267-4f00-baa4-d9ccd29a2f08 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:26.769790 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-46f2d570-1267-4f00-baa4-d9ccd29a2f08 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Going to try to terminate instance {{(pid=120557) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:39:26.846542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-46f2d570-1267-4f00-baa4-d9ccd29a2f08 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "DELETE /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 204 len: 0 microversion: 2.20 time: 0.119133 Aug 24 05:39:26.847837 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1709/3527] 10.222.0.97 () {60 vars in 1280 bytes} [Wed Aug 24 05:39:26 2022] DELETE /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:39:26.856617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:26.857221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:39:26.866446 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:26.867324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:26.868111 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:26.869282 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:26.869875 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:26.870574 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:27.005766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:39:27.014710 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:39:27.016231 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:39:27.017377 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b2095da6-3e76-4b36-97f1-110bead2c8cf tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.164879 Aug 24 05:39:27.017930 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1819/3528] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:39:26 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:39:28.042135 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:28.042776 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:39:28.049193 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:28.049675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:28.050106 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:28.050813 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:28.051260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:28.051680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:28.184601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:39:28.192981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:39:28.194490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:39:28.195731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f31ff35d-9deb-4f0c-8b57-63d1d4bed658 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1723 microversion: 2.20 time: 0.158653 Aug 24 05:39:28.196278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1710/3529] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:39:28 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 05:39:29.219379 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:29.220157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:39:29.226812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:29.227294 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:29.227732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:29.229027 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:29.229480 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:29.229905 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:29.294616 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:39:29.303408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:39:29.304899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0549cf43ea544faba1e7a2d8fe2f6a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '721b72380f284f80a5e56aac69688224', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:39:29.306831 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7c39f004-ad9e-41d6-bd17-08af68c7efb2 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 200 len: 1656 microversion: 2.20 time: 0.090817 Aug 24 05:39:29.307436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1820/3530] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:39:29 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 05:39:29.339486 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-4f57a464-b71b-45ce-9975-46367be334c0 req-af39b6f5-d3f9-40ef-be2d-f2ba952c59ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dbf3649-33d4-4e5f-abb3-720b1b8802f8", "name": "network-vif-deleted", "tag": "4c03fd3f-89c8-4628-a987-222cb53fd98d"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:29.352362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-4f57a464-b71b-45ce-9975-46367be334c0 req-af39b6f5-d3f9-40ef-be2d-f2ba952c59ed service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:29.353681 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-4f57a464-b71b-45ce-9975-46367be334c0 req-af39b6f5-d3f9-40ef-be2d-f2ba952c59ed service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:29.354186 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-4f57a464-b71b-45ce-9975-46367be334c0 req-af39b6f5-d3f9-40ef-be2d-f2ba952c59ed service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:29.366173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-4f57a464-b71b-45ce-9975-46367be334c0 req-af39b6f5-d3f9-40ef-be2d-f2ba952c59ed service nova] Creating event network-vif-deleted:4c03fd3f-89c8-4628-a987-222cb53fd98d for instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 on hv-cinder-85426 Aug 24 05:39:29.371660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-4f57a464-b71b-45ce-9975-46367be334c0 req-af39b6f5-d3f9-40ef-be2d-f2ba952c59ed service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036950 Aug 24 05:39:29.372263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1711/3531] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:30.329983 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:30.330583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:39:30.337201 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:30.337731 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:30.338267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:30.338999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:30.339454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:30.339879 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:30.354138 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] HTTP exception thrown: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Request method failure captured: Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 HTTP/1.1 Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBbeR-EPeHubq7OxuVGxJiWxVw2tH1RVAwQhMbOw5T9dsTekL7O15CgiWsC0ztV9E2UHA5A4jTjeu9iRoEQuFUi6_4S5jCraRkoNp50xkYJptyT_AzAlqS3PDmB0wJVXb-ip-EbIQATqH2npyjb2bWefFCtFNfqYMdjp1L8KJsflFZY0 Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:39:30.356326 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/721b72380f284f80a5e56aac69688224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_721b72380f284f80a5e56aac69688224", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 0549cf43ea544faba1e7a2d8fe2f6a27 Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:30.357968 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '1dbf3649-33d4-4e5f-abb3-720b1b8802f8'} Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:30.358842 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:30.360197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:30.361422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Returning 404 to user: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:30.361422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c2a11df4-6ecc-4de9-b420-247f75c19cf4 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 404 len: 111 microversion: 2.20 time: 0.032045 Aug 24 05:39:30.362513 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1821/3532] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:39:30 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:39:30.369526 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-9595a268-8a7e-45e4-adc5-28529b1f65d0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '.version_select at 0x7f3594392700>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:30.388267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-9595a268-8a7e-45e4-adc5-28529b1f65d0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182699228" status: 204 len: 0 microversion: 2.20 time: 0.024163 Aug 24 05:39:30.388848 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1712/3533] 10.222.0.97 () {60 vars in 1262 bytes} [Wed Aug 24 05:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182699228 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 05:39:32.139873 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:32.140358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:39:32.146751 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:32.147242 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:32.147668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:32.148366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:32.148817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:32.149239 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:32.162650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] HTTP exception thrown: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Request method failure captured: Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 HTTP/1.1 Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBbeR-EPeHubq7OxuVGxJiWxVw2tH1RVAwQhMbOw5T9dsTekL7O15CgiWsC0ztV9E2UHA5A4jTjeu9iRoEQuFUi6_4S5jCraRkoNp50xkYJptyT_AzAlqS3PDmB0wJVXb-ip-EbIQATqH2npyjb2bWefFCtFNfqYMdjp1L8KJsflFZY0 Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:39:32.164338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/721b72380f284f80a5e56aac69688224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_721b72380f284f80a5e56aac69688224", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 0549cf43ea544faba1e7a2d8fe2f6a27 Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:32.166498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '1dbf3649-33d4-4e5f-abb3-720b1b8802f8'} Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:32.167550 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:32.168956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:32.170554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Returning 404 to user: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:32.170554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-27e95fc7-da66-40ef-999d-0be0999c35de tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "DELETE /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 404 len: 111 microversion: 2.20 time: 0.029842 Aug 24 05:39:32.170554 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1822/3534] 10.222.0.97 () {60 vars in 1280 bytes} [Wed Aug 24 05:39:32 2022] DELETE /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:39:32.175300 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:32.176028 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 1dbf3649-33d4-4e5f-abb3-720b1b8802f8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:39:32.183675 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:32.184153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:32.184585 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:32.185517 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:32.185967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:32.186386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:32.199787 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] HTTP exception thrown: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Request method failure captured: Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 HTTP/1.1 Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBbeR-EPeHubq7OxuVGxJiWxVw2tH1RVAwQhMbOw5T9dsTekL7O15CgiWsC0ztV9E2UHA5A4jTjeu9iRoEQuFUi6_4S5jCraRkoNp50xkYJptyT_AzAlqS3PDmB0wJVXb-ip-EbIQATqH2npyjb2bWefFCtFNfqYMdjp1L8KJsflFZY0 Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:39:32.201398 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/721b72380f284f80a5e56aac69688224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_721b72380f284f80a5e56aac69688224", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 0549cf43ea544faba1e7a2d8fe2f6a27 Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:32.202935 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '1dbf3649-33d4-4e5f-abb3-720b1b8802f8'} Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:32.203852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. Aug 24 05:39:32.205268 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:39:32.206737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Returning 404 to user: Instance 1dbf3649-33d4-4e5f-abb3-720b1b8802f8 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:32.206737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-376baef9-1d60-4f9c-bc3d-46ca4ec91bc0 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8" status: 404 len: 111 microversion: 2.20 time: 0.031897 Aug 24 05:39:32.206737 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1713/3535] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:39:32 2022] GET /compute/v2.1/servers/1dbf3649-33d4-4e5f-abb3-720b1b8802f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:39:33.343561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:33.344088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:39:33.350476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:33.350996 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:33.351429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:33.352112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:33.352560 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:33.353043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:33.368264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] HTTP exception thrown: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Request method failure captured: Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: DELETE /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 HTTP/1.1 Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBbeR-EPeHubq7OxuVGxJiWxVw2tH1RVAwQhMbOw5T9dsTekL7O15CgiWsC0ztV9E2UHA5A4jTjeu9iRoEQuFUi6_4S5jCraRkoNp50xkYJptyT_AzAlqS3PDmB0wJVXb-ip-EbIQATqH2npyjb2bWefFCtFNfqYMdjp1L8KJsflFZY0 Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:39:33.370505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/721b72380f284f80a5e56aac69688224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_721b72380f284f80a5e56aac69688224", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 0549cf43ea544faba1e7a2d8fe2f6a27 Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:39:33.371936 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '342b0ec6-3c25-4b72-bcb1-88878f3d85e8'} Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:33.372667 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:39:33.373977 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:33.375335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Returning 404 to user: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:33.375335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-12461143-9ef4-476f-abf8-dab4744bc821 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "DELETE /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 404 len: 111 microversion: 2.20 time: 0.032334 Aug 24 05:39:33.375335 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1823/3536] 10.222.0.97 () {60 vars in 1280 bytes} [Wed Aug 24 05:39:33 2022] DELETE /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:39:33.380375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:33.380983 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] [instance: 342b0ec6-3c25-4b72-bcb1-88878f3d85e8] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:39:33.388063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:33.388541 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:33.388974 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:33.389655 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:39:33.390107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:39:33.390527 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:39:33.404721 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] HTTP exception thrown: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Request method failure captured: Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 HTTP/1.1 Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBbeR-EPeHubq7OxuVGxJiWxVw2tH1RVAwQhMbOw5T9dsTekL7O15CgiWsC0ztV9E2UHA5A4jTjeu9iRoEQuFUi6_4S5jCraRkoNp50xkYJptyT_AzAlqS3PDmB0wJVXb-ip-EbIQATqH2npyjb2bWefFCtFNfqYMdjp1L8KJsflFZY0 Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:39:33.407947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/721b72380f284f80a5e56aac69688224"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_721b72380f284f80a5e56aac69688224", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/721b72380f284f80a5e56aac69688224"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: 721b72380f284f80a5e56aac69688224 Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-124248938 Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 0549cf43ea544faba1e7a2d8fe2f6a27 Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-AttachVolumeShelveTestJSON-124248938-project Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:39:33.409421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': '342b0ec6-3c25-4b72-bcb1-88878f3d85e8'} Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:33.410232 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. Aug 24 05:39:33.411577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:39:33.412741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] Returning 404 to user: Instance 342b0ec6-3c25-4b72-bcb1-88878f3d85e8 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:33.412741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-26e40800-35a7-483c-9d99-164014a69683 tempest-AttachVolumeShelveTestJSON-124248938 tempest-AttachVolumeShelveTestJSON-124248938-project] 10.222.0.97 "GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8" status: 404 len: 111 microversion: 2.20 time: 0.033347 Aug 24 05:39:33.412741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1714/3537] 10.222.0.97 () {60 vars in 1277 bytes} [Wed Aug 24 05:39:33 2022] GET /compute/v2.1/servers/342b0ec6-3c25-4b72-bcb1-88878f3d85e8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 05:39:37.805016 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-681a2bba-bb94-439b-91a1-b9ee4a82c84c tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] Action: 'create', calling method: .version_select at 0x7f35904f5f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1739363188", "metadata": {"Type": "work"}}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:39:38.096569 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-681a2bba-bb94-439b-91a1-b9ee4a82c84c tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] 10.222.0.97 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.423665 Aug 24 05:39:38.097082 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1824/3538] 10.222.0.97 () {60 vars in 1156 bytes} [Wed Aug 24 05:39:37 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 425 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 05:39:38.109691 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-09dd6f06-a4d8-4a54-b2ff-f49b926eef13 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] Calling method '.version_select at 0x7f359029dc10>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:38.163278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-09dd6f06-a4d8-4a54-b2ff-f49b926eef13 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af" status: 200 len: 353 microversion: 2.1 time: 0.057317 Aug 24 05:39:38.163873 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1715/3539] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 05:39:38 2022] GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:39.177408 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-bbb8ac81-8bdc-40e3-b75c-695b530f24c1 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] Calling method '.version_select at 0x7f35901a49d0>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:39.224904 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-bbb8ac81-8bdc-40e3-b75c-695b530f24c1 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af" status: 200 len: 354 microversion: 2.1 time: 0.051360 Aug 24 05:39:39.225452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1825/3540] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 05:39:39 2022] GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:39.238795 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-26c7bdb8-5236-4a0a-894c-67b4ca88875c tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] Calling method '.version_select at 0x7f35943974c0>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:39.285062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-26c7bdb8-5236-4a0a-894c-67b4ca88875c tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af" status: 200 len: 354 microversion: 2.1 time: 0.050495 Aug 24 05:39:39.285622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1716/3541] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 05:39:39 2022] GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:39.302441 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-03d83e92-7856-42ce-bf1c-94fb8bdc6766 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] Calling method '.version_select at 0x7f359030bc10>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:39.364061 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-03d83e92-7856-42ce-bf1c-94fb8bdc6766 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] 10.222.0.97 "DELETE /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af" status: 202 len: 0 microversion: 2.1 time: 0.065317 Aug 24 05:39:39.364646 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1826/3542] 10.222.0.97 () {58 vars in 1248 bytes} [Wed Aug 24 05:39:39 2022] DELETE /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:39:39.373218 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3d5eb1a6-58d5-4739-8250-562d61313d2c tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] Calling method '.version_select at 0x7f3594336790>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:39.420538 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3d5eb1a6-58d5-4739-8250-562d61313d2c tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af" status: 200 len: 353 microversion: 2.1 time: 0.051181 Aug 24 05:39:39.421108 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1717/3543] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 05:39:39 2022] GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:39:40.435421 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-14b43aec-d76f-463b-8b8b-1b53f6471c98 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] Calling method '.version_select at 0x7f35904f5f70>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:39:40.462746 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-14b43aec-d76f-463b-8b8b-1b53f6471c98 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] HTTP exception thrown: Volume 20656119-f855-41eb-845c-75ed6d1191af could not be found. Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-14b43aec-d76f-463b-8b8b-1b53f6471c98 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] Request method failure captured: Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af HTTP/1.1 Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBbmZ12rId16pWkgPdKzJ6jz8L4cDUiAcc_G8auucqdo9tV5YNSQYq5OGk7xBrRc5m69ix5giY2c33MpLNhv00yDJ7ze-WB_yydlh_-XdnsV7p-4h6o5MNcltMYEK9Jww7f1otsSBjlMkIj387kcfsLSkI31NurnkSGgmnnrK_D58aNQ Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: 8a1d7959c52f401d997c44f6e4952f3f Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-VolumesGetTestJSON-1006038401 Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:39:40.464668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/8a1d7959c52f401d997c44f6e4952f3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_8a1d7959c52f401d997c44f6e4952f3f", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/8a1d7959c52f401d997c44f6e4952f3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/8a1d7959c52f401d997c44f6e4952f3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-VolumesGetTestJSON-1006038401 Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: 8a1d7959c52f401d997c44f6e4952f3f Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-VolumesGetTestJSON-1006038401 Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-VolumesGetTestJSON-1006038401-project Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: e28497ddc063450abcf047f1eae63768 Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-VolumesGetTestJSON-1006038401-project Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Volume 20656119-f855-41eb-845c-75ed6d1191af could not be found. Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': '20656119-f855-41eb-845c-75ed6d1191af'} Aug 24 05:39:40.466077 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20656119-f855-41eb-845c-75ed6d1191af could not be found. (HTTP 404) (Request-ID: req-667c5b8d-e661-4125-8360-21edbcf0eef1) Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:40.467036 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 05:39:40.468643 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20656119-f855-41eb-845c-75ed6d1191af could not be found. Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 05:39:40.469885 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20656119-f855-41eb-845c-75ed6d1191af could not be found. Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20656119-f855-41eb-845c-75ed6d1191af could not be found. Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-14b43aec-d76f-463b-8b8b-1b53f6471c98 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] Returning 404 to user: Volume 20656119-f855-41eb-845c-75ed6d1191af could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-14b43aec-d76f-463b-8b8b-1b53f6471c98 tempest-VolumesGetTestJSON-1006038401 tempest-VolumesGetTestJSON-1006038401-project] 10.222.0.97 "GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af" status: 404 len: 109 microversion: 2.1 time: 0.036052 Aug 24 05:39:40.471345 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1827/3544] 10.222.0.97 () {58 vars in 1245 bytes} [Wed Aug 24 05:39:40 2022] GET /compute/v2.1/os-volumes/20656119-f855-41eb-845c-75ed6d1191af => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:40:23.538555 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.539434 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:23.543417 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1535534860", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "networks": [{"uuid": "0f6e2ba9-d544-4735-a855-f67c8699de49"}]}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:40:23.600037 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] validate_networks() for [('0f6e2ba9-d544-4735-a855-f67c8699de49', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:40:23.960780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:40:23.961202 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:40:23.961704 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:40:23.962400 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:40:23.962495 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:40:23.972265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:23.972749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:23.973177 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:23.973888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:23.974333 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:23.974780 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:23.991729 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Getting quotas for project be66d1804bc34886a58841d77b8473ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:40:23.995861 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Getting quotas for user 3faa6d2a1489469e9e971e2350486424 and project be66d1804bc34886a58841d77b8473ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:40:24.007634 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:40:24.009938 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:40:24.054420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fa7267cb-6b4b-4bb1-87d7-09b3f9410159 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517109 Aug 24 05:40:24.055113 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1718/3545] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 05:40:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:40:24.064745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=12 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:24.065592 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=24 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:24.069724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2eb78e7e-2947-4815-863f-c213e8ae6087 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:24.070512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2eb78e7e-2947-4815-863f-c213e8ae6087 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:24.124160 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2eb78e7e-2947-4815-863f-c213e8ae6087 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:24.131306 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2eb78e7e-2947-4815-863f-c213e8ae6087 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1214 microversion: 2.1 time: 0.068499 Aug 24 05:40:24.131872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1828/3546] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:24 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:25.152152 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f9e8f7d2-2e92-4c7c-b563-7eb07fdcd453 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:25.152877 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f9e8f7d2-2e92-4c7c-b563-7eb07fdcd453 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:25.161005 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9e8f7d2-2e92-4c7c-b563-7eb07fdcd453 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:25.161513 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9e8f7d2-2e92-4c7c-b563-7eb07fdcd453 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:25.161925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9e8f7d2-2e92-4c7c-b563-7eb07fdcd453 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:25.162619 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9e8f7d2-2e92-4c7c-b563-7eb07fdcd453 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:25.163158 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9e8f7d2-2e92-4c7c-b563-7eb07fdcd453 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:25.163537 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f9e8f7d2-2e92-4c7c-b563-7eb07fdcd453 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:25.263792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f9e8f7d2-2e92-4c7c-b563-7eb07fdcd453 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:25.271991 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f9e8f7d2-2e92-4c7c-b563-7eb07fdcd453 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1274 microversion: 2.1 time: 0.124256 Aug 24 05:40:25.273431 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1719/3547] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:25 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:26.295267 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-41f15205-7465-4558-86f3-bc45c6e929b3 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:26.295867 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-41f15205-7465-4558-86f3-bc45c6e929b3 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:26.302266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41f15205-7465-4558-86f3-bc45c6e929b3 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:26.302783 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41f15205-7465-4558-86f3-bc45c6e929b3 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:26.303221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41f15205-7465-4558-86f3-bc45c6e929b3 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:26.303911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41f15205-7465-4558-86f3-bc45c6e929b3 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:26.304390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41f15205-7465-4558-86f3-bc45c6e929b3 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:26.304812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-41f15205-7465-4558-86f3-bc45c6e929b3 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:26.440556 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-41f15205-7465-4558-86f3-bc45c6e929b3 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:26.449387 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-41f15205-7465-4558-86f3-bc45c6e929b3 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1314 microversion: 2.1 time: 0.158499 Aug 24 05:40:26.449958 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1829/3548] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:26 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:26.462377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-29161a16-0545-46e3-9286-9649558cad08 req-e2c1a55c-0dd0-42e3-a4c2-a6f738eee0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc797652-9281-4401-b70d-249795469030", "tag": "1849963e-d34f-41d4-be95-ea1cea4e9bf6"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:40:26.476379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-29161a16-0545-46e3-9286-9649558cad08 req-e2c1a55c-0dd0-42e3-a4c2-a6f738eee0ff service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:26.476855 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-29161a16-0545-46e3-9286-9649558cad08 req-e2c1a55c-0dd0-42e3-a4c2-a6f738eee0ff service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:26.477297 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-29161a16-0545-46e3-9286-9649558cad08 req-e2c1a55c-0dd0-42e3-a4c2-a6f738eee0ff service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:26.488436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-29161a16-0545-46e3-9286-9649558cad08 req-e2c1a55c-0dd0-42e3-a4c2-a6f738eee0ff service nova] Creating event network-changed:1849963e-d34f-41d4-be95-ea1cea4e9bf6 for instance dc797652-9281-4401-b70d-249795469030 on hv-cinder-85426 Aug 24 05:40:26.493345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-29161a16-0545-46e3-9286-9649558cad08 req-e2c1a55c-0dd0-42e3-a4c2-a6f738eee0ff service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044284 Aug 24 05:40:26.494237 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1720/3549] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:40:27.471227 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-7acbcd62-a320-4867-8f88-857ab270fe21 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:27.471836 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-7acbcd62-a320-4867-8f88-857ab270fe21 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:27.478266 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7acbcd62-a320-4867-8f88-857ab270fe21 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:27.478782 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7acbcd62-a320-4867-8f88-857ab270fe21 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:27.479221 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7acbcd62-a320-4867-8f88-857ab270fe21 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:27.479899 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7acbcd62-a320-4867-8f88-857ab270fe21 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:27.480353 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7acbcd62-a320-4867-8f88-857ab270fe21 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:27.480775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-7acbcd62-a320-4867-8f88-857ab270fe21 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:27.607972 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-7acbcd62-a320-4867-8f88-857ab270fe21 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:27.615608 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-7acbcd62-a320-4867-8f88-857ab270fe21 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1314 microversion: 2.1 time: 0.148846 Aug 24 05:40:27.616169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1830/3550] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:27 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:28.637902 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f801dcf8-4028-4b38-b1f0-e9f6f08cddae tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:28.638805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f801dcf8-4028-4b38-b1f0-e9f6f08cddae tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:28.645126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f801dcf8-4028-4b38-b1f0-e9f6f08cddae tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:28.645602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f801dcf8-4028-4b38-b1f0-e9f6f08cddae tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:28.646033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f801dcf8-4028-4b38-b1f0-e9f6f08cddae tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:28.646735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f801dcf8-4028-4b38-b1f0-e9f6f08cddae tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:28.647219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f801dcf8-4028-4b38-b1f0-e9f6f08cddae tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:28.647638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f801dcf8-4028-4b38-b1f0-e9f6f08cddae tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:28.937008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f801dcf8-4028-4b38-b1f0-e9f6f08cddae tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:28.944826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f801dcf8-4028-4b38-b1f0-e9f6f08cddae tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1314 microversion: 2.1 time: 0.311566 Aug 24 05:40:28.945487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1721/3551] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:28 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:29.965374 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-c1b23145-02e9-4654-9c98-ab0489e34391 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:29.965981 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-c1b23145-02e9-4654-9c98-ab0489e34391 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:29.972911 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1b23145-02e9-4654-9c98-ab0489e34391 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:29.973389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1b23145-02e9-4654-9c98-ab0489e34391 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:29.973819 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1b23145-02e9-4654-9c98-ab0489e34391 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:29.974498 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1b23145-02e9-4654-9c98-ab0489e34391 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:29.974974 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1b23145-02e9-4654-9c98-ab0489e34391 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:29.975391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-c1b23145-02e9-4654-9c98-ab0489e34391 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:30.105999 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-c1b23145-02e9-4654-9c98-ab0489e34391 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:30.114357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-c1b23145-02e9-4654-9c98-ab0489e34391 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1314 microversion: 2.1 time: 0.152881 Aug 24 05:40:30.114955 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1831/3552] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:29 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:31.135204 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-30f1a6d6-99da-4326-82cd-495ac628cb35 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:31.135810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-30f1a6d6-99da-4326-82cd-495ac628cb35 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:31.143322 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30f1a6d6-99da-4326-82cd-495ac628cb35 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:31.143806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30f1a6d6-99da-4326-82cd-495ac628cb35 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:31.144243 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30f1a6d6-99da-4326-82cd-495ac628cb35 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:31.144930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30f1a6d6-99da-4326-82cd-495ac628cb35 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:31.145411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30f1a6d6-99da-4326-82cd-495ac628cb35 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:31.145831 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-30f1a6d6-99da-4326-82cd-495ac628cb35 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:31.276241 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-30f1a6d6-99da-4326-82cd-495ac628cb35 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:31.284578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-30f1a6d6-99da-4326-82cd-495ac628cb35 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1314 microversion: 2.1 time: 0.153248 Aug 24 05:40:31.285126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1722/3553] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:31 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:32.306334 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a08e25bb-e027-481b-a48f-6c9635aa0919 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:32.307053 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a08e25bb-e027-481b-a48f-6c9635aa0919 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:32.314170 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a08e25bb-e027-481b-a48f-6c9635aa0919 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:32.314652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a08e25bb-e027-481b-a48f-6c9635aa0919 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:32.315121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a08e25bb-e027-481b-a48f-6c9635aa0919 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:32.315806 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a08e25bb-e027-481b-a48f-6c9635aa0919 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:32.316256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a08e25bb-e027-481b-a48f-6c9635aa0919 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:32.316675 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a08e25bb-e027-481b-a48f-6c9635aa0919 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:32.445657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a08e25bb-e027-481b-a48f-6c9635aa0919 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:32.453649 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a08e25bb-e027-481b-a48f-6c9635aa0919 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1314 microversion: 2.1 time: 0.151413 Aug 24 05:40:32.454274 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1832/3554] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:32 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:33.475789 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f1114987-1feb-4340-90b1-9829663c69d6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:33.476421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f1114987-1feb-4340-90b1-9829663c69d6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:33.483249 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1114987-1feb-4340-90b1-9829663c69d6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:33.483749 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1114987-1feb-4340-90b1-9829663c69d6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:33.484174 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1114987-1feb-4340-90b1-9829663c69d6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:33.484843 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1114987-1feb-4340-90b1-9829663c69d6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:33.485292 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1114987-1feb-4340-90b1-9829663c69d6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:33.485714 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1114987-1feb-4340-90b1-9829663c69d6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:33.618064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f1114987-1feb-4340-90b1-9829663c69d6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:33.625932 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f1114987-1feb-4340-90b1-9829663c69d6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1314 microversion: 2.1 time: 0.153953 Aug 24 05:40:33.626582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1723/3555] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:33 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:33.791436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-ef8a1d9c-3df9-4742-a124-71d3990d6c13 req-5decf0d7-92c8-46d0-91be-0d44f37710fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc797652-9281-4401-b70d-249795469030", "name": "network-vif-plugged", "status": "completed", "tag": "1849963e-d34f-41d4-be95-ea1cea4e9bf6"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:40:33.801520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ef8a1d9c-3df9-4742-a124-71d3990d6c13 req-5decf0d7-92c8-46d0-91be-0d44f37710fa service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:33.801988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ef8a1d9c-3df9-4742-a124-71d3990d6c13 req-5decf0d7-92c8-46d0-91be-0d44f37710fa service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:33.802415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-ef8a1d9c-3df9-4742-a124-71d3990d6c13 req-5decf0d7-92c8-46d0-91be-0d44f37710fa service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:33.813680 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-ef8a1d9c-3df9-4742-a124-71d3990d6c13 req-5decf0d7-92c8-46d0-91be-0d44f37710fa service nova] Creating event network-vif-plugged:1849963e-d34f-41d4-be95-ea1cea4e9bf6 for instance dc797652-9281-4401-b70d-249795469030 on hv-cinder-85426 Aug 24 05:40:33.819010 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-ef8a1d9c-3df9-4742-a124-71d3990d6c13 req-5decf0d7-92c8-46d0-91be-0d44f37710fa service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155460 Aug 24 05:40:33.819456 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1833/3556] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:40:34.647384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e00e292c-088e-41bc-a0ec-deb70b9169c6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:34.647980 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e00e292c-088e-41bc-a0ec-deb70b9169c6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:34.649882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:34.650540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=6 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:34.657786 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e00e292c-088e-41bc-a0ec-deb70b9169c6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:34.658278 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e00e292c-088e-41bc-a0ec-deb70b9169c6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:34.658726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e00e292c-088e-41bc-a0ec-deb70b9169c6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:34.659401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e00e292c-088e-41bc-a0ec-deb70b9169c6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:34.659845 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e00e292c-088e-41bc-a0ec-deb70b9169c6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:34.660257 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e00e292c-088e-41bc-a0ec-deb70b9169c6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:34.793240 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e00e292c-088e-41bc-a0ec-deb70b9169c6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:34.800948 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e00e292c-088e-41bc-a0ec-deb70b9169c6 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1314 microversion: 2.1 time: 0.157378 Aug 24 05:40:34.801440 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1724/3557] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:34 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:35.818779 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:35.823514 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-b6477bb1-bc97-4de3-9545-a32e2a72be57 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:35.824244 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-b6477bb1-bc97-4de3-9545-a32e2a72be57 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:35.831561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6477bb1-bc97-4de3-9545-a32e2a72be57 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:35.832049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6477bb1-bc97-4de3-9545-a32e2a72be57 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:35.832617 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6477bb1-bc97-4de3-9545-a32e2a72be57 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:35.833311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6477bb1-bc97-4de3-9545-a32e2a72be57 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:35.833773 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6477bb1-bc97-4de3-9545-a32e2a72be57 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:35.834191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-b6477bb1-bc97-4de3-9545-a32e2a72be57 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:35.968694 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-b6477bb1-bc97-4de3-9545-a32e2a72be57 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:35.976467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-b6477bb1-bc97-4de3-9545-a32e2a72be57 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1498 microversion: 2.1 time: 0.158850 Aug 24 05:40:35.977022 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1834/3558] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:35 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:36.473147 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-29f53062-601b-4c17-9a94-ef8ba247f220 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:36.473660 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-29f53062-601b-4c17-9a94-ef8ba247f220 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:36.480033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29f53062-601b-4c17-9a94-ef8ba247f220 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:36.480512 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29f53062-601b-4c17-9a94-ef8ba247f220 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:36.480944 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29f53062-601b-4c17-9a94-ef8ba247f220 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:36.481668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29f53062-601b-4c17-9a94-ef8ba247f220 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:36.482701 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29f53062-601b-4c17-9a94-ef8ba247f220 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:36.483223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-29f53062-601b-4c17-9a94-ef8ba247f220 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:36.508765 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-29f53062-601b-4c17-9a94-ef8ba247f220 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Going to try to terminate instance {{(pid=120557) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:40:36.582522 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-29f53062-601b-4c17-9a94-ef8ba247f220 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "DELETE /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 204 len: 0 microversion: 2.1 time: 0.113254 Aug 24 05:40:36.583410 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1725/3559] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:40:36 2022] DELETE /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:36.591588 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-708cc850-f78d-493f-ad12-e524fc146219 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:36.592262 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-708cc850-f78d-493f-ad12-e524fc146219 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:36.598419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708cc850-f78d-493f-ad12-e524fc146219 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:36.598935 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708cc850-f78d-493f-ad12-e524fc146219 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:36.599369 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708cc850-f78d-493f-ad12-e524fc146219 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:36.600085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708cc850-f78d-493f-ad12-e524fc146219 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:36.600530 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708cc850-f78d-493f-ad12-e524fc146219 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:36.600947 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-708cc850-f78d-493f-ad12-e524fc146219 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:36.740223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-708cc850-f78d-493f-ad12-e524fc146219 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:36.748582 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-708cc850-f78d-493f-ad12-e524fc146219 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1504 microversion: 2.1 time: 0.160385 Aug 24 05:40:36.749339 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1835/3560] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:36 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:40:37.770604 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-0acd62d9-0e39-4df9-b301-0e30cc9005b9 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:37.771345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-0acd62d9-0e39-4df9-b301-0e30cc9005b9 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:37.777545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0acd62d9-0e39-4df9-b301-0e30cc9005b9 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:37.778020 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0acd62d9-0e39-4df9-b301-0e30cc9005b9 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:37.778449 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0acd62d9-0e39-4df9-b301-0e30cc9005b9 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:37.779239 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0acd62d9-0e39-4df9-b301-0e30cc9005b9 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:37.779712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0acd62d9-0e39-4df9-b301-0e30cc9005b9 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:37.780130 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-0acd62d9-0e39-4df9-b301-0e30cc9005b9 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:37.908473 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-0acd62d9-0e39-4df9-b301-0e30cc9005b9 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:37.916996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-0acd62d9-0e39-4df9-b301-0e30cc9005b9 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1504 microversion: 2.1 time: 0.150619 Aug 24 05:40:37.917565 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1726/3561] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:37 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:38.890991 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-81b47d5f-9b18-41aa-a4f8-d3ffe1c01316 req-ca8bae06-248f-4c88-85a2-4be8df9b9ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc797652-9281-4401-b70d-249795469030", "name": "network-vif-deleted", "tag": "1849963e-d34f-41d4-be95-ea1cea4e9bf6"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:40:38.900477 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-81b47d5f-9b18-41aa-a4f8-d3ffe1c01316 req-ca8bae06-248f-4c88-85a2-4be8df9b9ea9 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:38.900951 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-81b47d5f-9b18-41aa-a4f8-d3ffe1c01316 req-ca8bae06-248f-4c88-85a2-4be8df9b9ea9 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:38.901376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-81b47d5f-9b18-41aa-a4f8-d3ffe1c01316 req-ca8bae06-248f-4c88-85a2-4be8df9b9ea9 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:38.913545 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-81b47d5f-9b18-41aa-a4f8-d3ffe1c01316 req-ca8bae06-248f-4c88-85a2-4be8df9b9ea9 service nova] Creating event network-vif-deleted:1849963e-d34f-41d4-be95-ea1cea4e9bf6 for instance dc797652-9281-4401-b70d-249795469030 on hv-cinder-85426 Aug 24 05:40:38.920042 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-81b47d5f-9b18-41aa-a4f8-d3ffe1c01316 req-ca8bae06-248f-4c88-85a2-4be8df9b9ea9 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091922 Aug 24 05:40:38.920638 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1836/3562] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:40:38.938362 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:38.939006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:38.945492 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:38.945969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:38.946402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:38.947121 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:38.947576 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:38.948003 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:38.983383 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:38.983771 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:38.984207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:38.984656 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lazy-loading 'fault' on Instance uuid dc797652-9281-4401-b70d-249795469030 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:40:39.026057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:39.034404 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fe1d42db-29a5-4283-b826-689365e9924c tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 200 len: 1304 microversion: 2.1 time: 0.100545 Aug 24 05:40:39.034996 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1727/3563] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:38 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:40.056614 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:40.057252 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: dc797652-9281-4401-b70d-249795469030] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:40.064327 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:40.064809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:40.065264 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:40.065944 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:40.066393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:40.066854 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:40.081129 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.wsgi [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] HTTP exception thrown: Instance dc797652-9281-4401-b70d-249795469030 could not be found. Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Request method failure captured: Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: request: GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 HTTP/1.1 Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept: application/json Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Accept-Encoding: identity Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Connection: close Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Length: 0 Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Content-Type: application/json Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Host: 10.222.0.97 Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Openstack-System-Scope: None Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: User-Agent: python-urllib3/1.26.11 Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Auth-Token: gAAAAABjBbnFHGLkfpS-5TaOomnAy97UO-c68UPyKsNnGX52ge5wxFlKiAQRiS2d06T1Jc6F6668SXlJohM5P4_NvJTu2nMNp83KUxuXj2DiXKpQiXe0JFSKtXGoUwJTa6FRlJETJs9U2PFpp9jgpI34mcEzoReGWI2cURMf26IuzsxbiTMWIwc Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Id: None Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Domain-Name: None Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Identity-Status: Confirmed Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Is-Admin-Project: True Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Id: default Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Domain-Name: Default Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Id: be66d1804bc34886a58841d77b8473ba Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Project-Name: tempest-VolumesActionsTest-661257079 Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Role: member,reader Aug 24 05:40:40.083478 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Roles: member,reader Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/be66d1804bc34886a58841d77b8473ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_be66d1804bc34886a58841d77b8473ba", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/be66d1804bc34886a58841d77b8473ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/be66d1804bc34886a58841d77b8473ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant: tempest-VolumesActionsTest-661257079 Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Id: be66d1804bc34886a58841d77b8473ba Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-Tenant-Name: tempest-VolumesActionsTest-661257079 Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User: tempest-VolumesActionsTest-661257079-project Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Id: default Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Domain-Name: Default Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Id: 3faa6d2a1489469e9e971e2350486424 Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: X-User-Name: tempest-VolumesActionsTest-661257079-project Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: method: > Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: exception: Instance dc797652-9281-4401-b70d-249795469030 could not be found. Aug 24 05:40:40.085071 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: action_args: {'id': 'dc797652-9281-4401-b70d-249795469030'} Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc797652-9281-4401-b70d-249795469030 could not be found. Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:40:40.085892 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc797652-9281-4401-b70d-249795469030 could not be found. Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc797652-9281-4401-b70d-249795469030 could not be found. Aug 24 05:40:40.087126 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR nova.api.openstack.wsgi Aug 24 05:40:40.088256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Returning 404 to user: Instance dc797652-9281-4401-b70d-249795469030 could not be found. {{(pid=120558) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:40:40.088256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-830e523a-0dbe-4102-acde-fee3891c5642 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030" status: 404 len: 111 microversion: 2.1 time: 0.032959 Aug 24 05:40:40.088256 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1837/3564] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:40 2022] GET /compute/v2.1/servers/dc797652-9281-4401-b70d-249795469030 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:40:40.137021 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-841137399", "imageRef": "bd25b558-99c7-4e21-8c04-b729b187065e", "flavorRef": "452", "networks": [{"uuid": "0f6e2ba9-d544-4735-a855-f67c8699de49"}]}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:40:40.191077 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] validate_networks() for [('0f6e2ba9-d544-4735-a855-f67c8699de49', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:40:40.537592 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:40:40.538025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:40:40.538477 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:40:40.538925 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:40:40.539336 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:40:40.548693 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:40.549170 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:40.549622 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:40.550345 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:40.550827 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:40.551253 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:40.568921 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Getting quotas for project be66d1804bc34886a58841d77b8473ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:40:40.572792 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Getting quotas for user 3faa6d2a1489469e9e971e2350486424 and project be66d1804bc34886a58841d77b8473ba. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:40:40.584402 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:40:40.586727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bd25b558-99c7-4e21-8c04-b729b187065e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:40:40.636889 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-642ea293-22a3-44bb-9a5d-8a33dba028d0 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503560 Aug 24 05:40:40.637841 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1728/3565] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 05:40:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:40:40.649358 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4009a989-53e1-461c-b266-401237cb049b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:40.650059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4009a989-53e1-461c-b266-401237cb049b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:40.708085 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4009a989-53e1-461c-b266-401237cb049b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:40.715081 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4009a989-53e1-461c-b266-401237cb049b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1213 microversion: 2.1 time: 0.069672 Aug 24 05:40:40.715642 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1838/3566] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:40 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:41.737719 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e236dc94-2ae3-4395-a326-e29a0f348117 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:41.738341 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e236dc94-2ae3-4395-a326-e29a0f348117 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:41.745594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e236dc94-2ae3-4395-a326-e29a0f348117 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:41.746338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e236dc94-2ae3-4395-a326-e29a0f348117 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:41.746805 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e236dc94-2ae3-4395-a326-e29a0f348117 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:41.747504 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e236dc94-2ae3-4395-a326-e29a0f348117 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:41.747957 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e236dc94-2ae3-4395-a326-e29a0f348117 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:41.748375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e236dc94-2ae3-4395-a326-e29a0f348117 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:41.974840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e236dc94-2ae3-4395-a326-e29a0f348117 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:41.982872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e236dc94-2ae3-4395-a326-e29a0f348117 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1271 microversion: 2.1 time: 0.251321 Aug 24 05:40:41.984279 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1729/3567] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:41 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:43.004683 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1a9e23de-b9ef-4911-a01b-4b9acefab455 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:43.005299 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1a9e23de-b9ef-4911-a01b-4b9acefab455 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:43.012540 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a9e23de-b9ef-4911-a01b-4b9acefab455 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:43.013018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a9e23de-b9ef-4911-a01b-4b9acefab455 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:43.013453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a9e23de-b9ef-4911-a01b-4b9acefab455 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:43.014161 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a9e23de-b9ef-4911-a01b-4b9acefab455 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:43.014598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a9e23de-b9ef-4911-a01b-4b9acefab455 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:43.015901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1a9e23de-b9ef-4911-a01b-4b9acefab455 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:43.147927 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1a9e23de-b9ef-4911-a01b-4b9acefab455 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:43.156967 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1a9e23de-b9ef-4911-a01b-4b9acefab455 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1313 microversion: 2.1 time: 0.156120 Aug 24 05:40:43.157652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1839/3568] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:42 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:40:43.172907 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-f4c9d605-e715-4ea5-aadd-3b3965545860 req-6f9e97b8-6d71-4e15-8e53-5a58eaa9c4a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82243df-cad4-4453-a9d9-c63a56f1d336", "tag": "16599571-027d-42ec-8054-ae173d3987bc"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:40:43.182712 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-f4c9d605-e715-4ea5-aadd-3b3965545860 req-6f9e97b8-6d71-4e15-8e53-5a58eaa9c4a5 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:43.183219 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-f4c9d605-e715-4ea5-aadd-3b3965545860 req-6f9e97b8-6d71-4e15-8e53-5a58eaa9c4a5 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:43.183650 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-f4c9d605-e715-4ea5-aadd-3b3965545860 req-6f9e97b8-6d71-4e15-8e53-5a58eaa9c4a5 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:43.195869 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-f4c9d605-e715-4ea5-aadd-3b3965545860 req-6f9e97b8-6d71-4e15-8e53-5a58eaa9c4a5 service nova] Creating event network-changed:16599571-027d-42ec-8054-ae173d3987bc for instance c82243df-cad4-4453-a9d9-c63a56f1d336 on hv-cinder-85426 Aug 24 05:40:43.200947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-f4c9d605-e715-4ea5-aadd-3b3965545860 req-6f9e97b8-6d71-4e15-8e53-5a58eaa9c4a5 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032662 Aug 24 05:40:43.201881 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1730/3569] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:40:44.177641 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-6620f30c-abaa-43e9-a090-c241e7aaa728 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:44.178177 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-6620f30c-abaa-43e9-a090-c241e7aaa728 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:44.184758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6620f30c-abaa-43e9-a090-c241e7aaa728 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:44.185236 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6620f30c-abaa-43e9-a090-c241e7aaa728 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:44.185668 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6620f30c-abaa-43e9-a090-c241e7aaa728 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:44.186707 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6620f30c-abaa-43e9-a090-c241e7aaa728 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:44.187285 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6620f30c-abaa-43e9-a090-c241e7aaa728 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:44.187717 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-6620f30c-abaa-43e9-a090-c241e7aaa728 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:44.315583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-6620f30c-abaa-43e9-a090-c241e7aaa728 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:44.323183 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-6620f30c-abaa-43e9-a090-c241e7aaa728 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1313 microversion: 2.1 time: 0.149401 Aug 24 05:40:44.323817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1840/3570] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:44 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:45.347556 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-fd91216b-8f18-492c-984f-004ca2049716 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:45.348286 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-fd91216b-8f18-492c-984f-004ca2049716 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:45.354483 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd91216b-8f18-492c-984f-004ca2049716 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:45.354994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd91216b-8f18-492c-984f-004ca2049716 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:45.355436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd91216b-8f18-492c-984f-004ca2049716 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:45.356120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd91216b-8f18-492c-984f-004ca2049716 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:45.356574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd91216b-8f18-492c-984f-004ca2049716 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:45.357000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-fd91216b-8f18-492c-984f-004ca2049716 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:45.490223 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-fd91216b-8f18-492c-984f-004ca2049716 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:45.497878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-fd91216b-8f18-492c-984f-004ca2049716 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1313 microversion: 2.1 time: 0.156019 Aug 24 05:40:45.498435 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1731/3571] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:45 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:46.518555 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-ddf933cd-842d-4b9e-8680-ff275c44881b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:46.519191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-ddf933cd-842d-4b9e-8680-ff275c44881b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:46.525393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ddf933cd-842d-4b9e-8680-ff275c44881b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:46.525871 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ddf933cd-842d-4b9e-8680-ff275c44881b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:46.526305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ddf933cd-842d-4b9e-8680-ff275c44881b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:46.527024 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ddf933cd-842d-4b9e-8680-ff275c44881b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:46.527473 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ddf933cd-842d-4b9e-8680-ff275c44881b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:46.527902 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-ddf933cd-842d-4b9e-8680-ff275c44881b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:46.657639 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-ddf933cd-842d-4b9e-8680-ff275c44881b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:46.665237 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-ddf933cd-842d-4b9e-8680-ff275c44881b tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1313 microversion: 2.1 time: 0.150673 Aug 24 05:40:46.665796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1841/3572] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:46 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:47.687000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c64f601a-7a45-4fa6-83dd-8cba95a1b90e tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:47.687613 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c64f601a-7a45-4fa6-83dd-8cba95a1b90e tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:47.694085 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c64f601a-7a45-4fa6-83dd-8cba95a1b90e tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:47.694558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c64f601a-7a45-4fa6-83dd-8cba95a1b90e tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:47.695022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c64f601a-7a45-4fa6-83dd-8cba95a1b90e tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:47.695698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c64f601a-7a45-4fa6-83dd-8cba95a1b90e tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:47.696144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c64f601a-7a45-4fa6-83dd-8cba95a1b90e tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:47.696602 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c64f601a-7a45-4fa6-83dd-8cba95a1b90e tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:47.834507 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c64f601a-7a45-4fa6-83dd-8cba95a1b90e tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:47.842969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c64f601a-7a45-4fa6-83dd-8cba95a1b90e tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1313 microversion: 2.1 time: 0.160142 Aug 24 05:40:47.844166 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1732/3573] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:47 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:48.865497 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-640160e4-0f64-405a-a3ca-cf9792dd8eb7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:48.866109 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-640160e4-0f64-405a-a3ca-cf9792dd8eb7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:48.872598 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-640160e4-0f64-405a-a3ca-cf9792dd8eb7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:48.873074 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-640160e4-0f64-405a-a3ca-cf9792dd8eb7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:48.873510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-640160e4-0f64-405a-a3ca-cf9792dd8eb7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:48.874186 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-640160e4-0f64-405a-a3ca-cf9792dd8eb7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:48.874637 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-640160e4-0f64-405a-a3ca-cf9792dd8eb7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:48.875216 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-640160e4-0f64-405a-a3ca-cf9792dd8eb7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:49.254318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-640160e4-0f64-405a-a3ca-cf9792dd8eb7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:49.261883 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-640160e4-0f64-405a-a3ca-cf9792dd8eb7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1313 microversion: 2.1 time: 0.400306 Aug 24 05:40:49.262443 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1842/3574] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:48 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1313 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:49.773262 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-293e4e64-3854-40cb-b832-c5b442404ea5 req-de67e5a6-98ae-40ee-9987-3ca941fc04de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82243df-cad4-4453-a9d9-c63a56f1d336", "name": "network-vif-plugged", "status": "completed", "tag": "16599571-027d-42ec-8054-ae173d3987bc"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:40:49.783894 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-293e4e64-3854-40cb-b832-c5b442404ea5 req-de67e5a6-98ae-40ee-9987-3ca941fc04de service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:49.784446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-293e4e64-3854-40cb-b832-c5b442404ea5 req-de67e5a6-98ae-40ee-9987-3ca941fc04de service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:49.784981 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-293e4e64-3854-40cb-b832-c5b442404ea5 req-de67e5a6-98ae-40ee-9987-3ca941fc04de service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:49.798157 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-293e4e64-3854-40cb-b832-c5b442404ea5 req-de67e5a6-98ae-40ee-9987-3ca941fc04de service nova] Creating event network-vif-plugged:16599571-027d-42ec-8054-ae173d3987bc for instance c82243df-cad4-4453-a9d9-c63a56f1d336 on hv-cinder-85426 Aug 24 05:40:49.803048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-293e4e64-3854-40cb-b832-c5b442404ea5 req-de67e5a6-98ae-40ee-9987-3ca941fc04de service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033459 Aug 24 05:40:49.803680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1733/3575] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:40:50.282466 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4abb40ae-a1e7-45cd-a933-c894a7276076 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:50.283015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4abb40ae-a1e7-45cd-a933-c894a7276076 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:50.289445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4abb40ae-a1e7-45cd-a933-c894a7276076 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:50.289919 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4abb40ae-a1e7-45cd-a933-c894a7276076 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:50.290349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4abb40ae-a1e7-45cd-a933-c894a7276076 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:50.291062 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4abb40ae-a1e7-45cd-a933-c894a7276076 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:50.291510 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4abb40ae-a1e7-45cd-a933-c894a7276076 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:50.291931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4abb40ae-a1e7-45cd-a933-c894a7276076 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:50.423049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4abb40ae-a1e7-45cd-a933-c894a7276076 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:50.430830 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4abb40ae-a1e7-45cd-a933-c894a7276076 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1313 microversion: 2.1 time: 0.152775 Aug 24 05:40:50.431396 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1843/3576] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:50 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:51.514116 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-dc8bdc65-bbd6-47ca-953d-de0161ae3e40 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:51.514953 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-dc8bdc65-bbd6-47ca-953d-de0161ae3e40 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:51.517708 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:51.518359 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=6 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:51.527052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc8bdc65-bbd6-47ca-953d-de0161ae3e40 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:51.527860 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc8bdc65-bbd6-47ca-953d-de0161ae3e40 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:51.528578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc8bdc65-bbd6-47ca-953d-de0161ae3e40 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:51.529727 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc8bdc65-bbd6-47ca-953d-de0161ae3e40 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:51.530502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc8bdc65-bbd6-47ca-953d-de0161ae3e40 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:51.531892 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-dc8bdc65-bbd6-47ca-953d-de0161ae3e40 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:51.684609 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-dc8bdc65-bbd6-47ca-953d-de0161ae3e40 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:51.693984 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-dc8bdc65-bbd6-47ca-953d-de0161ae3e40 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1498 microversion: 2.1 time: 0.184185 Aug 24 05:40:51.694561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1734/3577] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:51 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1498 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:52.227553 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-515e8d1d-ee82-4c42-bb93-b316ca7905e7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:52.228110 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-515e8d1d-ee82-4c42-bb93-b316ca7905e7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:52.230003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:52.236390 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-515e8d1d-ee82-4c42-bb93-b316ca7905e7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:52.236865 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-515e8d1d-ee82-4c42-bb93-b316ca7905e7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:52.237296 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-515e8d1d-ee82-4c42-bb93-b316ca7905e7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:52.237973 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-515e8d1d-ee82-4c42-bb93-b316ca7905e7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:52.238419 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-515e8d1d-ee82-4c42-bb93-b316ca7905e7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:52.238869 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-515e8d1d-ee82-4c42-bb93-b316ca7905e7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:52.264176 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-515e8d1d-ee82-4c42-bb93-b316ca7905e7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Going to try to terminate instance {{(pid=120558) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:40:52.339858 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-515e8d1d-ee82-4c42-bb93-b316ca7905e7 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "DELETE /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 204 len: 0 microversion: 2.1 time: 0.115499 Aug 24 05:40:52.340732 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1844/3578] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:40:52 2022] DELETE /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:40:52.349601 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d696929b-b068-417d-a705-06a9b51bb65f tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:52.350224 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d696929b-b068-417d-a705-06a9b51bb65f tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:52.356446 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d696929b-b068-417d-a705-06a9b51bb65f tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:52.356971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d696929b-b068-417d-a705-06a9b51bb65f tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:52.357478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d696929b-b068-417d-a705-06a9b51bb65f tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:52.358260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d696929b-b068-417d-a705-06a9b51bb65f tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:52.358933 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d696929b-b068-417d-a705-06a9b51bb65f tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:52.359896 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d696929b-b068-417d-a705-06a9b51bb65f tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:52.491741 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d696929b-b068-417d-a705-06a9b51bb65f tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:52.495120 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:52.501004 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d696929b-b068-417d-a705-06a9b51bb65f tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1504 microversion: 2.1 time: 0.155232 Aug 24 05:40:52.501570 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1735/3579] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:52 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:53.522552 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1073f830-20c4-4e1e-bd86-fad69b3eb699 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:53.523286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1073f830-20c4-4e1e-bd86-fad69b3eb699 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:53.529674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1073f830-20c4-4e1e-bd86-fad69b3eb699 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:53.530147 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1073f830-20c4-4e1e-bd86-fad69b3eb699 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:53.530579 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1073f830-20c4-4e1e-bd86-fad69b3eb699 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:53.531855 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1073f830-20c4-4e1e-bd86-fad69b3eb699 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:53.532337 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1073f830-20c4-4e1e-bd86-fad69b3eb699 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:53.532758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1073f830-20c4-4e1e-bd86-fad69b3eb699 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:53.662940 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1073f830-20c4-4e1e-bd86-fad69b3eb699 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:53.671175 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1073f830-20c4-4e1e-bd86-fad69b3eb699 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1504 microversion: 2.1 time: 0.152854 Aug 24 05:40:53.672378 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1845/3580] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:53 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:54.489854 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-e3a8283a-b975-41cc-90c4-0a40e13752ba req-5b3f60dd-5630-4523-b7fa-e31134ff49dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82243df-cad4-4453-a9d9-c63a56f1d336", "name": "network-vif-deleted", "tag": "16599571-027d-42ec-8054-ae173d3987bc"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:40:54.495677 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:54.503129 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-e3a8283a-b975-41cc-90c4-0a40e13752ba req-5b3f60dd-5630-4523-b7fa-e31134ff49dc service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:54.503638 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-e3a8283a-b975-41cc-90c4-0a40e13752ba req-5b3f60dd-5630-4523-b7fa-e31134ff49dc service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:54.504138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-e3a8283a-b975-41cc-90c4-0a40e13752ba req-5b3f60dd-5630-4523-b7fa-e31134ff49dc service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:54.517774 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-e3a8283a-b975-41cc-90c4-0a40e13752ba req-5b3f60dd-5630-4523-b7fa-e31134ff49dc service nova] Creating event network-vif-deleted:16599571-027d-42ec-8054-ae173d3987bc for instance c82243df-cad4-4453-a9d9-c63a56f1d336 on hv-cinder-85426 Aug 24 05:40:54.522525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-e3a8283a-b975-41cc-90c4-0a40e13752ba req-5b3f60dd-5630-4523-b7fa-e31134ff49dc service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036501 Aug 24 05:40:54.523144 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1736/3581] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:40:54.693366 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:54.694000 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:54.696487 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:54.701813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:54.702293 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:54.702753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:54.703581 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:54.704003 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:54.704427 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:54.709134 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:40:54.738721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:54.739217 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:54.739652 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:54.740097 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.objects.instance [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lazy-loading 'fault' on Instance uuid c82243df-cad4-4453-a9d9-c63a56f1d336 {{(pid=120558) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:40:54.780078 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3faa6d2a1489469e9e971e2350486424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be66d1804bc34886a58841d77b8473ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:40:54.788567 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-aecb0b10-9cef-42d9-a5ae-ca512449b992 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 200 len: 1303 microversion: 2.1 time: 0.099139 Aug 24 05:40:54.789120 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1846/3582] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:54 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:40:55.810384 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:40:55.811103 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] [instance: c82243df-cad4-4453-a9d9-c63a56f1d336] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:40:55.818071 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:55.818551 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:55.819019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:55.819698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:40:55.820148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:40:55.820564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:40:55.834187 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] HTTP exception thrown: Instance c82243df-cad4-4453-a9d9-c63a56f1d336 could not be found. Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Request method failure captured: Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 HTTP/1.1 Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBbnFHGLkfpS-5TaOomnAy97UO-c68UPyKsNnGX52ge5wxFlKiAQRiS2d06T1Jc6F6668SXlJohM5P4_NvJTu2nMNp83KUxuXj2DiXKpQiXe0JFSKtXGoUwJTa6FRlJETJs9U2PFpp9jgpI34mcEzoReGWI2cURMf26IuzsxbiTMWIwc Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: be66d1804bc34886a58841d77b8473ba Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-VolumesActionsTest-661257079 Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:40:55.835818 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/be66d1804bc34886a58841d77b8473ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_be66d1804bc34886a58841d77b8473ba", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/be66d1804bc34886a58841d77b8473ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/be66d1804bc34886a58841d77b8473ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-VolumesActionsTest-661257079 Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: be66d1804bc34886a58841d77b8473ba Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-VolumesActionsTest-661257079 Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-VolumesActionsTest-661257079-project Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 3faa6d2a1489469e9e971e2350486424 Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-VolumesActionsTest-661257079-project Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance c82243df-cad4-4453-a9d9-c63a56f1d336 could not be found. Aug 24 05:40:55.837328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': 'c82243df-cad4-4453-a9d9-c63a56f1d336'} Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82243df-cad4-4453-a9d9-c63a56f1d336 could not be found. Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:40:55.838154 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82243df-cad4-4453-a9d9-c63a56f1d336 could not be found. Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82243df-cad4-4453-a9d9-c63a56f1d336 could not be found. Aug 24 05:40:55.839597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:40:55.840810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] Returning 404 to user: Instance c82243df-cad4-4453-a9d9-c63a56f1d336 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:40:55.840810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bf888b70-8545-4cd2-8158-e725156b8c89 tempest-VolumesActionsTest-661257079 tempest-VolumesActionsTest-661257079-project] 10.222.0.97 "GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336" status: 404 len: 111 microversion: 2.1 time: 0.031536 Aug 24 05:40:55.840810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1737/3583] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:40:55 2022] GET /compute/v2.1/servers/c82243df-cad4-4453-a9d9-c63a56f1d336 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:41:00.682828 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:41:00.683542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:41:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:41:08.778453 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:41:08.779142 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:41:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:41:30.299449 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=3 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:30.304342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=7 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:30.559937 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-90e897b4-a837-4ba2-9132-53c3cc5f5485 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Action: 'create', calling method: .version_select at 0x7f359423cb80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1726657091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyt85zY0Hy33iXm2j2z7OnoPiKfbhR6GMgjn3wfeLyyin5PZxnJpgjzm86l6R9kTuXmyxggq4GFZz//564x0ozNSt6SL+ICYja08HDRM6eU/t9NbmMFsoiCeg4FrwyxHw=="}} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:41:30.577903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-90e897b4-a837-4ba2-9132-53c3cc5f5485 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Getting quotas for project f91c965b644d4fee98c895b269675668. Resources: {'key_pairs'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:41:30.583371 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.quota [None req-90e897b4-a837-4ba2-9132-53c3cc5f5485 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Getting quotas for user 8c88814cb3b64bd49d1cdc8d5d2f7f6b and project f91c965b644d4fee98c895b269675668. Resources: {'key_pairs'} {{(pid=120558) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:41:30.613655 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-90e897b4-a837-4ba2-9132-53c3cc5f5485 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.326216 Aug 24 05:41:30.614501 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1847/3584] 10.222.0.97 () {60 vars in 1159 bytes} [Wed Aug 24 05:41:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:41:52.263131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-906860085", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1726657091", "security_groups": [{"name": "tempest-secgroup-smoke-2066132484"}], "networks": [{"uuid": "f388fbf2-1e8e-43c8-a8b4-3871326cfb44"}], "block_device_mapping_v2": [{"uuid": "8f46dcf5-a34a-452d-9c4d-21274b6305ac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:41:52.273063 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=3 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:52.273698 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=4 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:52.379829 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.network.neutron [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] validate_networks() for [('f388fbf2-1e8e-43c8-a8b4-3871326cfb44', None, None, None, None, None)] {{(pid=120557) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 05:41:52.843578 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Flavor limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 05:41:52.844000 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Image limits 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 05:41:52.844469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Flavor pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 05:41:52.844875 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Image pref 0:0:0 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 05:41:52.845310 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.virt.hardware [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120557) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 05:41:52.854648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:52.855151 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:52.855581 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:52.856287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:52.856735 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:52.857153 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:52.875318 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Getting quotas for project f91c965b644d4fee98c895b269675668. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 05:41:52.879287 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.quota [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Getting quotas for user 8c88814cb3b64bd49d1cdc8d5d2f7f6b and project f91c965b644d4fee98c895b269675668. Resources: {'instances', 'ram', 'cores'} {{(pid=120557) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 05:41:52.936019 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Going to run 1 instances... {{(pid=120557) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 05:41:52.939562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8f46dcf5-a34a-452d-9c4d-21274b6305ac',volume_size=None,volume_type=None)] {{(pid=120557) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 05:41:53.071695 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-bf5221e6-746f-4172-b1c1-ff77e3022fa3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.812686 Aug 24 05:41:53.072325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1738/3585] 10.222.0.97 () {60 vars in 1147 bytes} [Wed Aug 24 05:41:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 05:41:53.080467 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=4 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:53.081412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:41:53.085753 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-de3cf174-0b75-4980-a5ce-751719085f13 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:41:53.086360 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-de3cf174-0b75-4980-a5ce-751719085f13 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:41:53.141720 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-de3cf174-0b75-4980-a5ce-751719085f13 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:41:53.149305 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-de3cf174-0b75-4980-a5ce-751719085f13 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1088 microversion: 2.1 time: 0.070258 Aug 24 05:41:53.150143 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1848/3586] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:41:53 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:41:54.169882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8906ce80-7d7b-41da-93eb-42233efb9287 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:41:54.171059 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8906ce80-7d7b-41da-93eb-42233efb9287 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:41:54.178940 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8906ce80-7d7b-41da-93eb-42233efb9287 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:54.179436 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8906ce80-7d7b-41da-93eb-42233efb9287 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:54.179876 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8906ce80-7d7b-41da-93eb-42233efb9287 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:54.180580 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8906ce80-7d7b-41da-93eb-42233efb9287 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:54.181033 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8906ce80-7d7b-41da-93eb-42233efb9287 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:54.181460 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8906ce80-7d7b-41da-93eb-42233efb9287 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:54.255394 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8906ce80-7d7b-41da-93eb-42233efb9287 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:41:54.264110 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8906ce80-7d7b-41da-93eb-42233efb9287 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1204 microversion: 2.1 time: 0.098716 Aug 24 05:41:54.266623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1739/3587] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:41:54 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:41:55.285422 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-9793e375-9c03-40c4-882a-7f4c7e5798cf tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:41:55.286840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-9793e375-9c03-40c4-882a-7f4c7e5798cf tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:41:55.293359 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9793e375-9c03-40c4-882a-7f4c7e5798cf tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:55.294020 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9793e375-9c03-40c4-882a-7f4c7e5798cf tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:55.294546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9793e375-9c03-40c4-882a-7f4c7e5798cf tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:55.295410 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9793e375-9c03-40c4-882a-7f4c7e5798cf tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:55.295866 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9793e375-9c03-40c4-882a-7f4c7e5798cf tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:55.296315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-9793e375-9c03-40c4-882a-7f4c7e5798cf tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:55.433703 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-9793e375-9c03-40c4-882a-7f4c7e5798cf tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:41:55.442825 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-9793e375-9c03-40c4-882a-7f4c7e5798cf tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.160744 Aug 24 05:41:55.443769 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1849/3588] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:41:55 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:41:55.516271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-03ef0195-6d09-4661-a7bb-0353708c5c4d req-a4431dcc-e517-4d3d-98dd-41b1b91759cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a261b95f-7633-46d9-a6b1-122ebe87d092", "tag": "6ccb2b6e-02ab-4e12-a51f-cca98516d108"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:41:55.528213 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-03ef0195-6d09-4661-a7bb-0353708c5c4d req-a4431dcc-e517-4d3d-98dd-41b1b91759cb service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:55.528798 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-03ef0195-6d09-4661-a7bb-0353708c5c4d req-a4431dcc-e517-4d3d-98dd-41b1b91759cb service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:55.529467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-03ef0195-6d09-4661-a7bb-0353708c5c4d req-a4431dcc-e517-4d3d-98dd-41b1b91759cb service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:55.541882 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-03ef0195-6d09-4661-a7bb-0353708c5c4d req-a4431dcc-e517-4d3d-98dd-41b1b91759cb service nova] Creating event network-changed:6ccb2b6e-02ab-4e12-a51f-cca98516d108 for instance a261b95f-7633-46d9-a6b1-122ebe87d092 on hv-cinder-85426 Aug 24 05:41:55.547017 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-03ef0195-6d09-4661-a7bb-0353708c5c4d req-a4431dcc-e517-4d3d-98dd-41b1b91759cb service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035361 Aug 24 05:41:55.547599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1740/3589] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:41:56.464682 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4baf8390-47db-4194-ab9b-8e84a1b9f230 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:41:56.465309 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4baf8390-47db-4194-ab9b-8e84a1b9f230 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:41:56.471767 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4baf8390-47db-4194-ab9b-8e84a1b9f230 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:56.472238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4baf8390-47db-4194-ab9b-8e84a1b9f230 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:56.472665 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4baf8390-47db-4194-ab9b-8e84a1b9f230 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:56.474088 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4baf8390-47db-4194-ab9b-8e84a1b9f230 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:56.474546 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4baf8390-47db-4194-ab9b-8e84a1b9f230 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:56.475099 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4baf8390-47db-4194-ab9b-8e84a1b9f230 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:56.605948 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4baf8390-47db-4194-ab9b-8e84a1b9f230 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:41:56.613479 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4baf8390-47db-4194-ab9b-8e84a1b9f230 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.152695 Aug 24 05:41:56.614064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1850/3590] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:41:56 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:41:57.634969 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f1c22fa5-a0d2-4ab4-a631-302785ad313e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:41:57.635577 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f1c22fa5-a0d2-4ab4-a631-302785ad313e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:41:57.641731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1c22fa5-a0d2-4ab4-a631-302785ad313e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:57.642207 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1c22fa5-a0d2-4ab4-a631-302785ad313e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:57.642635 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1c22fa5-a0d2-4ab4-a631-302785ad313e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:57.643329 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1c22fa5-a0d2-4ab4-a631-302785ad313e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:57.643775 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1c22fa5-a0d2-4ab4-a631-302785ad313e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:57.644191 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f1c22fa5-a0d2-4ab4-a631-302785ad313e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:57.777346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f1c22fa5-a0d2-4ab4-a631-302785ad313e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:41:57.785046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f1c22fa5-a0d2-4ab4-a631-302785ad313e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.154831 Aug 24 05:41:57.785599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1741/3591] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:41:57 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:41:58.805984 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-beeba12d-87cc-4b06-b1e9-15104a878470 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:41:58.806594 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-beeba12d-87cc-4b06-b1e9-15104a878470 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:41:58.813311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beeba12d-87cc-4b06-b1e9-15104a878470 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:58.813787 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beeba12d-87cc-4b06-b1e9-15104a878470 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:58.814220 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beeba12d-87cc-4b06-b1e9-15104a878470 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:58.814925 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beeba12d-87cc-4b06-b1e9-15104a878470 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:58.815376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beeba12d-87cc-4b06-b1e9-15104a878470 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:58.815796 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-beeba12d-87cc-4b06-b1e9-15104a878470 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:58.946886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-beeba12d-87cc-4b06-b1e9-15104a878470 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:41:58.954817 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-beeba12d-87cc-4b06-b1e9-15104a878470 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.152583 Aug 24 05:41:58.955376 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1851/3592] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:41:58 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:41:59.976859 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8ee7ade8-efb8-480a-b5be-39ba1780431b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:41:59.977467 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8ee7ade8-efb8-480a-b5be-39ba1780431b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:41:59.983930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ee7ade8-efb8-480a-b5be-39ba1780431b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:59.984413 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ee7ade8-efb8-480a-b5be-39ba1780431b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:59.984846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ee7ade8-efb8-480a-b5be-39ba1780431b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:41:59.985579 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ee7ade8-efb8-480a-b5be-39ba1780431b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:41:59.985979 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ee7ade8-efb8-480a-b5be-39ba1780431b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:41:59.986396 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8ee7ade8-efb8-480a-b5be-39ba1780431b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:00.116377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8ee7ade8-efb8-480a-b5be-39ba1780431b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:42:00.124060 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8ee7ade8-efb8-480a-b5be-39ba1780431b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.151826 Aug 24 05:42:00.124616 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1742/3593] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:41:59 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:01.146208 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-2f518a25-c229-4d7b-9dbf-2d293d663dc0 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:01.146760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-2f518a25-c229-4d7b-9dbf-2d293d663dc0 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:42:01.153130 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f518a25-c229-4d7b-9dbf-2d293d663dc0 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:01.153612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f518a25-c229-4d7b-9dbf-2d293d663dc0 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:01.154049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f518a25-c229-4d7b-9dbf-2d293d663dc0 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:01.154756 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f518a25-c229-4d7b-9dbf-2d293d663dc0 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:01.155209 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f518a25-c229-4d7b-9dbf-2d293d663dc0 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:01.155630 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-2f518a25-c229-4d7b-9dbf-2d293d663dc0 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:01.283561 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-2f518a25-c229-4d7b-9dbf-2d293d663dc0 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:42:01.291847 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-2f518a25-c229-4d7b-9dbf-2d293d663dc0 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.150336 Aug 24 05:42:01.292407 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1852/3594] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:42:01 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:02.313918 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-d637524f-7815-4d2b-a536-c05ccc01affb tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:02.314451 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-d637524f-7815-4d2b-a536-c05ccc01affb tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:42:02.320901 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d637524f-7815-4d2b-a536-c05ccc01affb tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:02.321375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d637524f-7815-4d2b-a536-c05ccc01affb tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:02.321806 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d637524f-7815-4d2b-a536-c05ccc01affb tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:02.322478 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d637524f-7815-4d2b-a536-c05ccc01affb tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:02.322954 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d637524f-7815-4d2b-a536-c05ccc01affb tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:02.323367 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-d637524f-7815-4d2b-a536-c05ccc01affb tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:02.455057 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-d637524f-7815-4d2b-a536-c05ccc01affb tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:42:02.463597 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-d637524f-7815-4d2b-a536-c05ccc01affb tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.153892 Aug 24 05:42:02.464160 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1743/3595] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:42:02 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:03.484602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-292df295-1ca7-4909-99fb-4cb81bd21927 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:03.485205 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-292df295-1ca7-4909-99fb-4cb81bd21927 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:42:03.487565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell0:SELECT=2 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:03.493795 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-292df295-1ca7-4909-99fb-4cb81bd21927 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:03.494281 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-292df295-1ca7-4909-99fb-4cb81bd21927 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:03.494745 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-292df295-1ca7-4909-99fb-4cb81bd21927 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:03.495436 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-292df295-1ca7-4909-99fb-4cb81bd21927 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:03.495887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-292df295-1ca7-4909-99fb-4cb81bd21927 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:03.496311 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-292df295-1ca7-4909-99fb-4cb81bd21927 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:03.626452 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-292df295-1ca7-4909-99fb-4cb81bd21927 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:42:03.634737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-292df295-1ca7-4909-99fb-4cb81bd21927 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.154039 Aug 24 05:42:03.635301 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1853/3596] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:42:03 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:04.656041 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-f6442da9-877a-4f34-a014-17d9ff25efc3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:04.656574 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-f6442da9-877a-4f34-a014-17d9ff25efc3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:42:04.658462 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=2 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:04.659149 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell0:SELECT=6 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:42:04.665930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6442da9-877a-4f34-a014-17d9ff25efc3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:04.666401 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6442da9-877a-4f34-a014-17d9ff25efc3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:04.666852 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6442da9-877a-4f34-a014-17d9ff25efc3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:04.667525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6442da9-877a-4f34-a014-17d9ff25efc3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:04.667967 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6442da9-877a-4f34-a014-17d9ff25efc3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:04.668379 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-f6442da9-877a-4f34-a014-17d9ff25efc3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:04.806461 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-f6442da9-877a-4f34-a014-17d9ff25efc3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:42:04.814971 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-f6442da9-877a-4f34-a014-17d9ff25efc3 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.162762 Aug 24 05:42:04.815545 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1744/3597] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:42:04 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:05.836890 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-be900135-5cdf-4453-bbb8-2a95e3e290fe tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:05.837489 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-be900135-5cdf-4453-bbb8-2a95e3e290fe tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:42:05.844039 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be900135-5cdf-4453-bbb8-2a95e3e290fe tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:05.844520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be900135-5cdf-4453-bbb8-2a95e3e290fe tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:05.844960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be900135-5cdf-4453-bbb8-2a95e3e290fe tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:05.845627 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be900135-5cdf-4453-bbb8-2a95e3e290fe tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:05.846084 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be900135-5cdf-4453-bbb8-2a95e3e290fe tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:05.846506 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-be900135-5cdf-4453-bbb8-2a95e3e290fe tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:05.979901 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-be900135-5cdf-4453-bbb8-2a95e3e290fe tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:42:05.987539 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-be900135-5cdf-4453-bbb8-2a95e3e290fe tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.155206 Aug 24 05:42:05.988107 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1854/3598] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:42:05 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:06.914762 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [req-2b63a206-0ab2-498e-840f-6351d90a037e req-c8cc4c63-e0a2-4658-a1d7-9f5efafe0e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261b95f-7633-46d9-a6b1-122ebe87d092", "name": "network-vif-plugged", "status": "completed", "tag": "6ccb2b6e-02ab-4e12-a51f-cca98516d108"}]} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:42:06.924772 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-2b63a206-0ab2-498e-840f-6351d90a037e req-c8cc4c63-e0a2-4658-a1d7-9f5efafe0e30 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:06.925248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-2b63a206-0ab2-498e-840f-6351d90a037e req-c8cc4c63-e0a2-4658-a1d7-9f5efafe0e30 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:06.925678 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [req-2b63a206-0ab2-498e-840f-6351d90a037e req-c8cc4c63-e0a2-4658-a1d7-9f5efafe0e30 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:06.936963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.compute.server_external_events [req-2b63a206-0ab2-498e-840f-6351d90a037e req-c8cc4c63-e0a2-4658-a1d7-9f5efafe0e30 service nova] Creating event network-vif-plugged:6ccb2b6e-02ab-4e12-a51f-cca98516d108 for instance a261b95f-7633-46d9-a6b1-122ebe87d092 on hv-cinder-85426 Aug 24 05:42:06.942913 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [req-2b63a206-0ab2-498e-840f-6351d90a037e req-c8cc4c63-e0a2-4658-a1d7-9f5efafe0e30 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031146 Aug 24 05:42:06.943583 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1745/3599] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:42:07.009049 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3234ab74-1586-440d-9d36-1de60e705a3d tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:07.009420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3234ab74-1586-440d-9d36-1de60e705a3d tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:42:07.017095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3234ab74-1586-440d-9d36-1de60e705a3d tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:07.017576 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3234ab74-1586-440d-9d36-1de60e705a3d tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:07.018004 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3234ab74-1586-440d-9d36-1de60e705a3d tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:07.018706 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3234ab74-1586-440d-9d36-1de60e705a3d tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:07.019158 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3234ab74-1586-440d-9d36-1de60e705a3d tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:07.019572 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3234ab74-1586-440d-9d36-1de60e705a3d tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:07.159355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3234ab74-1586-440d-9d36-1de60e705a3d tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:42:07.167315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3234ab74-1586-440d-9d36-1de60e705a3d tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.163500 Aug 24 05:42:07.167897 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1855/3600] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:42:07 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:08.189411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-628867c9-2744-447a-bc7d-e1ae72e64405 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:08.190131 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-628867c9-2744-447a-bc7d-e1ae72e64405 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:42:08.198377 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-628867c9-2744-447a-bc7d-e1ae72e64405 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:08.198911 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-628867c9-2744-447a-bc7d-e1ae72e64405 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:08.199353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-628867c9-2744-447a-bc7d-e1ae72e64405 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:08.200045 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-628867c9-2744-447a-bc7d-e1ae72e64405 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:08.200502 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-628867c9-2744-447a-bc7d-e1ae72e64405 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:08.200928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-628867c9-2744-447a-bc7d-e1ae72e64405 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:08.333825 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-628867c9-2744-447a-bc7d-e1ae72e64405 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:42:08.341540 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-628867c9-2744-447a-bc7d-e1ae72e64405 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1260 microversion: 2.1 time: 0.157105 Aug 24 05:42:08.342100 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1746/3601] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:42:08 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:09.364468 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-4419a75a-a326-41be-acd3-c529cf8b82c7 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:09.365121 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-4419a75a-a326-41be-acd3-c529cf8b82c7 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:42:09.371454 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4419a75a-a326-41be-acd3-c529cf8b82c7 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:09.371924 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4419a75a-a326-41be-acd3-c529cf8b82c7 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:09.372350 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4419a75a-a326-41be-acd3-c529cf8b82c7 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:09.373018 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4419a75a-a326-41be-acd3-c529cf8b82c7 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:09.373459 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4419a75a-a326-41be-acd3-c529cf8b82c7 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:09.373870 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-4419a75a-a326-41be-acd3-c529cf8b82c7 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:09.508362 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-4419a75a-a326-41be-acd3-c529cf8b82c7 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:42:09.516101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-4419a75a-a326-41be-acd3-c529cf8b82c7 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1445 microversion: 2.1 time: 0.156148 Aug 24 05:42:09.516669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1856/3602] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:42:09 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1445 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:09.537022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-57cdab83-41ec-4011-85a5-da5ece1a5b4e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:42:09.537627 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-57cdab83-41ec-4011-85a5-da5ece1a5b4e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:42:09.544040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57cdab83-41ec-4011-85a5-da5ece1a5b4e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:09.544525 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57cdab83-41ec-4011-85a5-da5ece1a5b4e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:09.544963 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57cdab83-41ec-4011-85a5-da5ece1a5b4e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:09.545648 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57cdab83-41ec-4011-85a5-da5ece1a5b4e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:09.546101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57cdab83-41ec-4011-85a5-da5ece1a5b4e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:09.546523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-57cdab83-41ec-4011-85a5-da5ece1a5b4e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:09.677705 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-57cdab83-41ec-4011-85a5-da5ece1a5b4e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:42:09.685511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-57cdab83-41ec-4011-85a5-da5ece1a5b4e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1445 microversion: 2.1 time: 0.153006 Aug 24 05:42:09.686075 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1747/3603] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:42:09 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:42:11.546127 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-92020383-c1bd-4377-b814-b2b7de45b13c req-599346cd-7261-48d8-9e30-c900dbe91102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a261b95f-7633-46d9-a6b1-122ebe87d092", "tag": "6ccb2b6e-02ab-4e12-a51f-cca98516d108"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:42:11.556629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-92020383-c1bd-4377-b814-b2b7de45b13c req-599346cd-7261-48d8-9e30-c900dbe91102 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:42:11.557101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-92020383-c1bd-4377-b814-b2b7de45b13c req-599346cd-7261-48d8-9e30-c900dbe91102 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:42:11.557527 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-92020383-c1bd-4377-b814-b2b7de45b13c req-599346cd-7261-48d8-9e30-c900dbe91102 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:42:11.571766 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-92020383-c1bd-4377-b814-b2b7de45b13c req-599346cd-7261-48d8-9e30-c900dbe91102 service nova] Creating event network-changed:6ccb2b6e-02ab-4e12-a51f-cca98516d108 for instance a261b95f-7633-46d9-a6b1-122ebe87d092 on hv-cinder-85426 Aug 24 05:42:11.576775 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-92020383-c1bd-4377-b814-b2b7de45b13c req-599346cd-7261-48d8-9e30-c900dbe91102 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034497 Aug 24 05:42:11.577389 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1857/3604] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:42:41.220285 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:42:41.220994 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:42:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:44:06.799263 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:44:06.800091 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:44:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:44:20.692157 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:44:20.692827 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:44:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:44:25.436188 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0f475f23-180e-46e4-a088-6bcd979ad0d2] AMQP server on 10.222.0.97:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 05:44:25.437007 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:25.437742 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=48 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:25.442375 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1930a1fe-6a52-4716-8ae2-4f628cc5427a tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:25.442952 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1930a1fe-6a52-4716-8ae2-4f628cc5427a tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:25.451203 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1930a1fe-6a52-4716-8ae2-4f628cc5427a tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:25.451686 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1930a1fe-6a52-4716-8ae2-4f628cc5427a tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:25.452125 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1930a1fe-6a52-4716-8ae2-4f628cc5427a tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:25.452808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1930a1fe-6a52-4716-8ae2-4f628cc5427a tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:25.453260 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1930a1fe-6a52-4716-8ae2-4f628cc5427a tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:25.453678 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1930a1fe-6a52-4716-8ae2-4f628cc5427a tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:25.478906 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.objects.instance [None req-1930a1fe-6a52-4716-8ae2-4f628cc5427a tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lazy-loading 'flavor' on Instance uuid a261b95f-7633-46d9-a6b1-122ebe87d092 {{(pid=120557) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 05:44:25.551506 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1930a1fe-6a52-4716-8ae2-4f628cc5427a tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "POST /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092/action" status: 202 len: 0 microversion: 2.1 time: 0.117092 Aug 24 05:44:25.552102 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1748/3605] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 05:44:25 2022] POST /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:44:25.558650 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1343c1bd-3e13-4da3-8d92-1ce99057c678] AMQP server on 10.222.0.97:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 05:44:25.559286 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=22 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:25.560043 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=50 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:44:25.565218 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-e019f8d2-f12b-4a04-82cb-ac9e83d48495 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:25.565932 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-e019f8d2-f12b-4a04-82cb-ac9e83d48495 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:25.574373 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e019f8d2-f12b-4a04-82cb-ac9e83d48495 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:25.574884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e019f8d2-f12b-4a04-82cb-ac9e83d48495 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:25.575316 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e019f8d2-f12b-4a04-82cb-ac9e83d48495 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:25.575998 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e019f8d2-f12b-4a04-82cb-ac9e83d48495 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:25.576442 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e019f8d2-f12b-4a04-82cb-ac9e83d48495 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:25.576860 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-e019f8d2-f12b-4a04-82cb-ac9e83d48495 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:25.814669 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-e019f8d2-f12b-4a04-82cb-ac9e83d48495 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:25.823988 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-e019f8d2-f12b-4a04-82cb-ac9e83d48495 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.267211 Aug 24 05:44:25.824559 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1858/3606] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:25 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:26.846916 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-216c8f4c-1221-4846-8a14-05ba439f5597 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:26.847623 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-216c8f4c-1221-4846-8a14-05ba439f5597 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:26.855594 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-216c8f4c-1221-4846-8a14-05ba439f5597 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:26.856128 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-216c8f4c-1221-4846-8a14-05ba439f5597 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:26.856588 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-216c8f4c-1221-4846-8a14-05ba439f5597 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:26.857328 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-216c8f4c-1221-4846-8a14-05ba439f5597 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:26.857920 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-216c8f4c-1221-4846-8a14-05ba439f5597 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:26.858487 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-216c8f4c-1221-4846-8a14-05ba439f5597 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:26.862070 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] [0f475f23-180e-46e4-a088-6bcd979ad0d2] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 57354. Aug 24 05:44:27.078248 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-216c8f4c-1221-4846-8a14-05ba439f5597 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:27.086484 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-216c8f4c-1221-4846-8a14-05ba439f5597 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.244650 Aug 24 05:44:27.087079 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1749/3607] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:26 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:28.108532 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5d348656-abd7-4647-944f-8e324d6823dd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:28.109141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5d348656-abd7-4647-944f-8e324d6823dd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:28.116276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d348656-abd7-4647-944f-8e324d6823dd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:28.116759 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d348656-abd7-4647-944f-8e324d6823dd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:28.117194 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d348656-abd7-4647-944f-8e324d6823dd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:28.117888 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d348656-abd7-4647-944f-8e324d6823dd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:28.118349 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d348656-abd7-4647-944f-8e324d6823dd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:28.118812 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5d348656-abd7-4647-944f-8e324d6823dd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:28.135724 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] [1343c1bd-3e13-4da3-8d92-1ce99057c678] Reconnected to AMQP server on 10.222.0.97:5672 via [amqp] client with port 57362. Aug 24 05:44:28.255600 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5d348656-abd7-4647-944f-8e324d6823dd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:28.263853 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5d348656-abd7-4647-944f-8e324d6823dd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.159321 Aug 24 05:44:28.264412 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1859/3608] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:28 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:28.789712 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:44:28.789939 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:44:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:44:29.285306 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3b38ad5d-9649-461f-9d16-89825c65a955 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:29.285910 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3b38ad5d-9649-461f-9d16-89825c65a955 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:29.293016 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b38ad5d-9649-461f-9d16-89825c65a955 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:29.293542 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b38ad5d-9649-461f-9d16-89825c65a955 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:29.293982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b38ad5d-9649-461f-9d16-89825c65a955 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:29.294674 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b38ad5d-9649-461f-9d16-89825c65a955 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:29.295146 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b38ad5d-9649-461f-9d16-89825c65a955 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:29.295567 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3b38ad5d-9649-461f-9d16-89825c65a955 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:29.434755 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-3b38ad5d-9649-461f-9d16-89825c65a955 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:29.442993 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3b38ad5d-9649-461f-9d16-89825c65a955 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.161515 Aug 24 05:44:29.443564 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1750/3609] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:29 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:30.464026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-0fdaf89f-06f9-4a8e-9eca-5ab5cc3771df tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:30.464629 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-0fdaf89f-06f9-4a8e-9eca-5ab5cc3771df tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:30.471123 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fdaf89f-06f9-4a8e-9eca-5ab5cc3771df tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:30.471599 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fdaf89f-06f9-4a8e-9eca-5ab5cc3771df tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:30.472031 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fdaf89f-06f9-4a8e-9eca-5ab5cc3771df tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:30.472705 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fdaf89f-06f9-4a8e-9eca-5ab5cc3771df tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:30.473150 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fdaf89f-06f9-4a8e-9eca-5ab5cc3771df tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:30.473570 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-0fdaf89f-06f9-4a8e-9eca-5ab5cc3771df tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:30.611563 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-0fdaf89f-06f9-4a8e-9eca-5ab5cc3771df tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:30.619393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-0fdaf89f-06f9-4a8e-9eca-5ab5cc3771df tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.159275 Aug 24 05:44:30.619956 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1860/3610] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:30 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:31.642388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-4a6c1f0a-3b6a-4be6-afe3-616a36dc0fb4 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:31.643680 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-4a6c1f0a-3b6a-4be6-afe3-616a36dc0fb4 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:31.650138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a6c1f0a-3b6a-4be6-afe3-616a36dc0fb4 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:31.650646 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a6c1f0a-3b6a-4be6-afe3-616a36dc0fb4 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:31.651107 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a6c1f0a-3b6a-4be6-afe3-616a36dc0fb4 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:31.652372 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a6c1f0a-3b6a-4be6-afe3-616a36dc0fb4 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:31.652946 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a6c1f0a-3b6a-4be6-afe3-616a36dc0fb4 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:31.653582 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-4a6c1f0a-3b6a-4be6-afe3-616a36dc0fb4 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:31.789101 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-4a6c1f0a-3b6a-4be6-afe3-616a36dc0fb4 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:31.797962 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-4a6c1f0a-3b6a-4be6-afe3-616a36dc0fb4 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.159478 Aug 24 05:44:31.798523 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1751/3611] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:31 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:44:32.819798 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-00fdf59c-c922-4c4e-b8da-37765a321063 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:32.821132 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-00fdf59c-c922-4c4e-b8da-37765a321063 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:32.828386 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00fdf59c-c922-4c4e-b8da-37765a321063 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:32.828857 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00fdf59c-c922-4c4e-b8da-37765a321063 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:32.829312 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00fdf59c-c922-4c4e-b8da-37765a321063 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:32.829995 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00fdf59c-c922-4c4e-b8da-37765a321063 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:32.830465 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00fdf59c-c922-4c4e-b8da-37765a321063 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:32.830931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-00fdf59c-c922-4c4e-b8da-37765a321063 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:32.978722 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-00fdf59c-c922-4c4e-b8da-37765a321063 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:32.986647 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-00fdf59c-c922-4c4e-b8da-37765a321063 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.170687 Aug 24 05:44:32.987173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1861/3612] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:32 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:34.013245 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a2c85770-1fca-42c6-ba07-27c70857f718 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:34.014255 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a2c85770-1fca-42c6-ba07-27c70857f718 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:34.025338 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a2c85770-1fca-42c6-ba07-27c70857f718 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:34.025998 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a2c85770-1fca-42c6-ba07-27c70857f718 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:34.026430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a2c85770-1fca-42c6-ba07-27c70857f718 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:34.028180 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a2c85770-1fca-42c6-ba07-27c70857f718 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:34.028631 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a2c85770-1fca-42c6-ba07-27c70857f718 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:34.029051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a2c85770-1fca-42c6-ba07-27c70857f718 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:34.164022 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a2c85770-1fca-42c6-ba07-27c70857f718 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:34.172127 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a2c85770-1fca-42c6-ba07-27c70857f718 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.166970 Aug 24 05:44:34.172694 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1752/3613] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:34 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:35.193813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1179d931-e66f-431e-bf76-11eea65840a6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:35.194352 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1179d931-e66f-431e-bf76-11eea65840a6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:35.201070 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1179d931-e66f-431e-bf76-11eea65840a6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:35.201537 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1179d931-e66f-431e-bf76-11eea65840a6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:35.201957 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1179d931-e66f-431e-bf76-11eea65840a6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:35.202631 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1179d931-e66f-431e-bf76-11eea65840a6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:35.203100 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1179d931-e66f-431e-bf76-11eea65840a6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:35.203512 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1179d931-e66f-431e-bf76-11eea65840a6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:35.343884 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1179d931-e66f-431e-bf76-11eea65840a6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:35.351721 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1179d931-e66f-431e-bf76-11eea65840a6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.162083 Aug 24 05:44:35.352288 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1862/3614] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:35 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:36.374990 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5a01b21a-256c-4252-924b-b15a4013529b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:36.375595 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5a01b21a-256c-4252-924b-b15a4013529b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:36.382092 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a01b21a-256c-4252-924b-b15a4013529b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:36.382561 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a01b21a-256c-4252-924b-b15a4013529b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:36.383024 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a01b21a-256c-4252-924b-b15a4013529b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:36.383699 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a01b21a-256c-4252-924b-b15a4013529b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:36.384142 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a01b21a-256c-4252-924b-b15a4013529b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:36.384558 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a01b21a-256c-4252-924b-b15a4013529b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:36.521025 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5a01b21a-256c-4252-924b-b15a4013529b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:36.529227 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5a01b21a-256c-4252-924b-b15a4013529b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.158798 Aug 24 05:44:36.529781 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1753/3615] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:36 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:37.550735 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-1d8cd8b4-3492-4a2a-ab0e-50f3c3589989 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:37.551342 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-1d8cd8b4-3492-4a2a-ab0e-50f3c3589989 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:37.557931 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d8cd8b4-3492-4a2a-ab0e-50f3c3589989 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:37.558415 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d8cd8b4-3492-4a2a-ab0e-50f3c3589989 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:37.558886 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d8cd8b4-3492-4a2a-ab0e-50f3c3589989 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:37.559575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d8cd8b4-3492-4a2a-ab0e-50f3c3589989 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:37.560015 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d8cd8b4-3492-4a2a-ab0e-50f3c3589989 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:37.560430 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-1d8cd8b4-3492-4a2a-ab0e-50f3c3589989 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:37.704845 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-1d8cd8b4-3492-4a2a-ab0e-50f3c3589989 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:37.712660 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-1d8cd8b4-3492-4a2a-ab0e-50f3c3589989 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.165837 Aug 24 05:44:37.713223 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1863/3616] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:37 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:38.734562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-5a0f8cb0-efd0-4d5a-8e28-a426e03f3a49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:38.735148 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-5a0f8cb0-efd0-4d5a-8e28-a426e03f3a49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:38.741820 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a0f8cb0-efd0-4d5a-8e28-a426e03f3a49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:38.742307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a0f8cb0-efd0-4d5a-8e28-a426e03f3a49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:38.742768 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a0f8cb0-efd0-4d5a-8e28-a426e03f3a49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:38.743476 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a0f8cb0-efd0-4d5a-8e28-a426e03f3a49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:38.743930 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a0f8cb0-efd0-4d5a-8e28-a426e03f3a49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:38.744353 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-5a0f8cb0-efd0-4d5a-8e28-a426e03f3a49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:38.881220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-5a0f8cb0-efd0-4d5a-8e28-a426e03f3a49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:38.891534 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-5a0f8cb0-efd0-4d5a-8e28-a426e03f3a49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1571 microversion: 2.1 time: 0.161870 Aug 24 05:44:38.892117 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1754/3617] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:38 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:38.913181 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-af2c5a69-bab8-4570-88a2-3e2cb5e5dfd6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:38.913776 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-af2c5a69-bab8-4570-88a2-3e2cb5e5dfd6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:38.921657 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2c5a69-bab8-4570-88a2-3e2cb5e5dfd6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:38.922202 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2c5a69-bab8-4570-88a2-3e2cb5e5dfd6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:38.922633 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2c5a69-bab8-4570-88a2-3e2cb5e5dfd6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:38.923411 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2c5a69-bab8-4570-88a2-3e2cb5e5dfd6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:38.923859 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2c5a69-bab8-4570-88a2-3e2cb5e5dfd6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:38.924280 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-af2c5a69-bab8-4570-88a2-3e2cb5e5dfd6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:39.010324 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-af2c5a69-bab8-4570-88a2-3e2cb5e5dfd6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120558) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 05:44:39.079839 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-af2c5a69-bab8-4570-88a2-3e2cb5e5dfd6 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "POST /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092/action" status: 202 len: 0 microversion: 2.1 time: 0.170568 Aug 24 05:44:39.080485 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1864/3618] 10.222.0.97 () {60 vars in 1278 bytes} [Wed Aug 24 05:44:38 2022] POST /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:44:39.091046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-cc2a6a7f-486c-43fa-97c9-392e57dabf3c tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:39.091668 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-cc2a6a7f-486c-43fa-97c9-392e57dabf3c tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:39.098351 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc2a6a7f-486c-43fa-97c9-392e57dabf3c tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:39.098966 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc2a6a7f-486c-43fa-97c9-392e57dabf3c tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:39.099420 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc2a6a7f-486c-43fa-97c9-392e57dabf3c tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:39.100265 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc2a6a7f-486c-43fa-97c9-392e57dabf3c tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:39.100821 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc2a6a7f-486c-43fa-97c9-392e57dabf3c tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:39.101289 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-cc2a6a7f-486c-43fa-97c9-392e57dabf3c tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:39.280036 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-cc2a6a7f-486c-43fa-97c9-392e57dabf3c tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:39.287945 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-cc2a6a7f-486c-43fa-97c9-392e57dabf3c tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1519 microversion: 2.1 time: 0.203001 Aug 24 05:44:39.288505 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1755/3619] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:39 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1519 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:44:40.310381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-5cf4b156-c344-4281-88f7-86315f500a4f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:40.311761 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-5cf4b156-c344-4281-88f7-86315f500a4f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:40.321238 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5cf4b156-c344-4281-88f7-86315f500a4f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:40.322012 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5cf4b156-c344-4281-88f7-86315f500a4f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:40.322445 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5cf4b156-c344-4281-88f7-86315f500a4f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:40.323169 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5cf4b156-c344-4281-88f7-86315f500a4f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:40.323613 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5cf4b156-c344-4281-88f7-86315f500a4f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:40.324028 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-5cf4b156-c344-4281-88f7-86315f500a4f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:40.475278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-5cf4b156-c344-4281-88f7-86315f500a4f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:40.484542 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-5cf4b156-c344-4281-88f7-86315f500a4f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1521 microversion: 2.1 time: 0.179085 Aug 24 05:44:40.485114 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1865/3620] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:40 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:41.506062 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-8aa4e717-64e5-435a-b07c-b55e23451968 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:41.506723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-8aa4e717-64e5-435a-b07c-b55e23451968 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:41.513424 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8aa4e717-64e5-435a-b07c-b55e23451968 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:41.513888 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8aa4e717-64e5-435a-b07c-b55e23451968 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:41.514320 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8aa4e717-64e5-435a-b07c-b55e23451968 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:41.515046 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8aa4e717-64e5-435a-b07c-b55e23451968 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:41.515494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8aa4e717-64e5-435a-b07c-b55e23451968 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:41.515924 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-8aa4e717-64e5-435a-b07c-b55e23451968 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:41.550583 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-f86a5813-d9bd-4f03-b701-be5cb8951026 req-366dbab9-58be-4656-8985-d3a98582ed6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261b95f-7633-46d9-a6b1-122ebe87d092", "name": "network-vif-unplugged", "status": "completed", "tag": "6ccb2b6e-02ab-4e12-a51f-cca98516d108"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:41.562338 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f86a5813-d9bd-4f03-b701-be5cb8951026 req-366dbab9-58be-4656-8985-d3a98582ed6b service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:41.562969 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f86a5813-d9bd-4f03-b701-be5cb8951026 req-366dbab9-58be-4656-8985-d3a98582ed6b service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:41.563505 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f86a5813-d9bd-4f03-b701-be5cb8951026 req-366dbab9-58be-4656-8985-d3a98582ed6b service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:41.576823 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-f86a5813-d9bd-4f03-b701-be5cb8951026 req-366dbab9-58be-4656-8985-d3a98582ed6b service nova] Creating event network-vif-unplugged:6ccb2b6e-02ab-4e12-a51f-cca98516d108 for instance a261b95f-7633-46d9-a6b1-122ebe87d092 on hv-cinder-85426 Aug 24 05:44:41.581317 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-f86a5813-d9bd-4f03-b701-be5cb8951026 req-366dbab9-58be-4656-8985-d3a98582ed6b service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034390 Aug 24 05:44:41.582040 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1866/3621] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:44:41.666006 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-8aa4e717-64e5-435a-b07c-b55e23451968 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:41.675471 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-8aa4e717-64e5-435a-b07c-b55e23451968 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1577 microversion: 2.1 time: 0.173345 Aug 24 05:44:41.676064 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1756/3622] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:41 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:42.698173 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-3982974e-4db7-4f8d-b787-1312c2345352 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:42.698887 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-3982974e-4db7-4f8d-b787-1312c2345352 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:42.705125 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3982974e-4db7-4f8d-b787-1312c2345352 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:42.705602 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3982974e-4db7-4f8d-b787-1312c2345352 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:42.706025 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3982974e-4db7-4f8d-b787-1312c2345352 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:42.706723 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3982974e-4db7-4f8d-b787-1312c2345352 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:42.707166 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3982974e-4db7-4f8d-b787-1312c2345352 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:42.707577 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-3982974e-4db7-4f8d-b787-1312c2345352 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:42.842590 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-3982974e-4db7-4f8d-b787-1312c2345352 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:42.850315 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-3982974e-4db7-4f8d-b787-1312c2345352 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1577 microversion: 2.1 time: 0.156832 Aug 24 05:44:42.850907 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1867/3623] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:42 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:43.872964 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-72fed91c-5b39-44bc-957e-02eb0c78ad2e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:43.873490 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-72fed91c-5b39-44bc-957e-02eb0c78ad2e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:43.880217 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72fed91c-5b39-44bc-957e-02eb0c78ad2e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:43.880700 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72fed91c-5b39-44bc-957e-02eb0c78ad2e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:43.881126 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72fed91c-5b39-44bc-957e-02eb0c78ad2e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:43.881810 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72fed91c-5b39-44bc-957e-02eb0c78ad2e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:43.882250 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72fed91c-5b39-44bc-957e-02eb0c78ad2e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:43.882669 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-72fed91c-5b39-44bc-957e-02eb0c78ad2e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:44.017723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-72fed91c-5b39-44bc-957e-02eb0c78ad2e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:44.025846 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-72fed91c-5b39-44bc-957e-02eb0c78ad2e tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1577 microversion: 2.1 time: 0.157451 Aug 24 05:44:44.026421 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1757/3624] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:43 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:45.047197 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-58dee5c9-480c-44a2-a409-79bb274c01a8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:45.047874 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-58dee5c9-480c-44a2-a409-79bb274c01a8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:45.054503 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58dee5c9-480c-44a2-a409-79bb274c01a8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:45.055206 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58dee5c9-480c-44a2-a409-79bb274c01a8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:45.055654 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58dee5c9-480c-44a2-a409-79bb274c01a8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:45.056357 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58dee5c9-480c-44a2-a409-79bb274c01a8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:45.056811 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58dee5c9-480c-44a2-a409-79bb274c01a8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:45.057235 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-58dee5c9-480c-44a2-a409-79bb274c01a8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:45.202228 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-58dee5c9-480c-44a2-a409-79bb274c01a8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:45.210737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-58dee5c9-480c-44a2-a409-79bb274c01a8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1577 microversion: 2.1 time: 0.168012 Aug 24 05:44:45.211355 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1868/3625] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:45 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:46.232212 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-e97d2b55-434b-4027-b743-b521123dee58 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:46.232826 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-e97d2b55-434b-4027-b743-b521123dee58 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:46.239562 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e97d2b55-434b-4027-b743-b521123dee58 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:46.240047 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e97d2b55-434b-4027-b743-b521123dee58 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:46.240485 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e97d2b55-434b-4027-b743-b521123dee58 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:46.241181 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e97d2b55-434b-4027-b743-b521123dee58 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:46.241633 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e97d2b55-434b-4027-b743-b521123dee58 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:46.242056 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-e97d2b55-434b-4027-b743-b521123dee58 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:46.379386 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-e97d2b55-434b-4027-b743-b521123dee58 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:46.387470 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-e97d2b55-434b-4027-b743-b521123dee58 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1577 microversion: 2.1 time: 0.159915 Aug 24 05:44:46.388040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1758/3626] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:46 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:47.408229 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f3119793-283f-4959-bc41-d2395a64d067 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:47.408813 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f3119793-283f-4959-bc41-d2395a64d067 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:47.415276 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3119793-283f-4959-bc41-d2395a64d067 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:47.415758 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3119793-283f-4959-bc41-d2395a64d067 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:47.416191 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3119793-283f-4959-bc41-d2395a64d067 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:47.416872 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3119793-283f-4959-bc41-d2395a64d067 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:47.417318 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3119793-283f-4959-bc41-d2395a64d067 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:47.417737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f3119793-283f-4959-bc41-d2395a64d067 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:47.553740 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f3119793-283f-4959-bc41-d2395a64d067 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:47.561719 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f3119793-283f-4959-bc41-d2395a64d067 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1577 microversion: 2.1 time: 0.157352 Aug 24 05:44:47.562278 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1869/3627] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:47 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:48.584173 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-14716c48-797f-44e3-ad0d-e32e8d8791f8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:48.585214 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-14716c48-797f-44e3-ad0d-e32e8d8791f8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:48.593438 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14716c48-797f-44e3-ad0d-e32e8d8791f8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:48.593919 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14716c48-797f-44e3-ad0d-e32e8d8791f8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:48.594388 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14716c48-797f-44e3-ad0d-e32e8d8791f8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:48.595271 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14716c48-797f-44e3-ad0d-e32e8d8791f8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:48.595840 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14716c48-797f-44e3-ad0d-e32e8d8791f8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:48.596334 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-14716c48-797f-44e3-ad0d-e32e8d8791f8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:48.782346 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-14716c48-797f-44e3-ad0d-e32e8d8791f8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:48.790335 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-14716c48-797f-44e3-ad0d-e32e8d8791f8 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1577 microversion: 2.1 time: 0.210723 Aug 24 05:44:48.790977 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1759/3628] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:48 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1577 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:49.812774 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-f4d4ca99-beb4-41c1-a516-a383b8ea69bd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:49.813381 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-f4d4ca99-beb4-41c1-a516-a383b8ea69bd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:49.820151 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4d4ca99-beb4-41c1-a516-a383b8ea69bd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:49.820632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4d4ca99-beb4-41c1-a516-a383b8ea69bd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:49.821067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4d4ca99-beb4-41c1-a516-a383b8ea69bd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:49.821742 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4d4ca99-beb4-41c1-a516-a383b8ea69bd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:49.822188 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4d4ca99-beb4-41c1-a516-a383b8ea69bd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:49.822607 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-f4d4ca99-beb4-41c1-a516-a383b8ea69bd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:49.955772 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-f4d4ca99-beb4-41c1-a516-a383b8ea69bd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:49.966481 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-f4d4ca99-beb4-41c1-a516-a383b8ea69bd tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1577 microversion: 2.1 time: 0.158319 Aug 24 05:44:49.967112 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1870/3629] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:49 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:50.987731 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-097f1f29-084e-4275-967a-72f533a8437f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:44:50.988392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-097f1f29-084e-4275-967a-72f533a8437f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:44:50.994814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-097f1f29-084e-4275-967a-72f533a8437f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:50.995295 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-097f1f29-084e-4275-967a-72f533a8437f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:50.995723 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-097f1f29-084e-4275-967a-72f533a8437f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:50.997138 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-097f1f29-084e-4275-967a-72f533a8437f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:50.997802 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-097f1f29-084e-4275-967a-72f533a8437f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:50.998220 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-097f1f29-084e-4275-967a-72f533a8437f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:51.411307 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-097f1f29-084e-4275-967a-72f533a8437f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:44:51.420411 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-097f1f29-084e-4275-967a-72f533a8437f tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1564 microversion: 2.1 time: 0.436692 Aug 24 05:44:51.420995 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1760/3630] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:44:50 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1564 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:44:53.641095 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-fa6bb9b5-5f9f-46cc-84e0-4e7f2afd54c2 req-18a94171-913c-483a-9ee6-0bf61168ccd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261b95f-7633-46d9-a6b1-122ebe87d092", "name": "network-vif-plugged", "status": "completed", "tag": "6ccb2b6e-02ab-4e12-a51f-cca98516d108"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:44:53.651429 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-fa6bb9b5-5f9f-46cc-84e0-4e7f2afd54c2 req-18a94171-913c-483a-9ee6-0bf61168ccd2 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:44:53.651903 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-fa6bb9b5-5f9f-46cc-84e0-4e7f2afd54c2 req-18a94171-913c-483a-9ee6-0bf61168ccd2 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:44:53.652435 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-fa6bb9b5-5f9f-46cc-84e0-4e7f2afd54c2 req-18a94171-913c-483a-9ee6-0bf61168ccd2 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:44:53.664840 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-fa6bb9b5-5f9f-46cc-84e0-4e7f2afd54c2 req-18a94171-913c-483a-9ee6-0bf61168ccd2 service nova] Creating event network-vif-plugged:6ccb2b6e-02ab-4e12-a51f-cca98516d108 for instance a261b95f-7633-46d9-a6b1-122ebe87d092 on hv-cinder-85426 Aug 24 05:44:53.670760 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-fa6bb9b5-5f9f-46cc-84e0-4e7f2afd54c2 req-18a94171-913c-483a-9ee6-0bf61168ccd2 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033631 Aug 24 05:44:53.671522 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1871/3631] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:01.229808 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:46:01.230511 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:46:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:46:19.240454 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_api:SELECT=26 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.241282 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG dbcounter [-] [120557] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120557) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.244101 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.245141 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG dbcounter [-] [120558] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120558) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:46:19.246008 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-3860a435-374d-49ba-9552-10f3cf1991b2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:19.246586 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3860a435-374d-49ba-9552-10f3cf1991b2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:19.255267 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3860a435-374d-49ba-9552-10f3cf1991b2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.256049 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3860a435-374d-49ba-9552-10f3cf1991b2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.256554 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3860a435-374d-49ba-9552-10f3cf1991b2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.257343 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3860a435-374d-49ba-9552-10f3cf1991b2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.257872 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3860a435-374d-49ba-9552-10f3cf1991b2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.258469 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-3860a435-374d-49ba-9552-10f3cf1991b2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.296949 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-3860a435-374d-49ba-9552-10f3cf1991b2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Going to try to terminate instance {{(pid=120557) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 05:46:19.392059 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-424c4dde-4ecc-4d65-aac4-cb89d7c9a1cc req-78c0f1a0-e486-42ee-b988-c0bfa8096632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a261b95f-7633-46d9-a6b1-122ebe87d092", "tag": "6ccb2b6e-02ab-4e12-a51f-cca98516d108"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:19.404809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-424c4dde-4ecc-4d65-aac4-cb89d7c9a1cc req-78c0f1a0-e486-42ee-b988-c0bfa8096632 service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.406829 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-424c4dde-4ecc-4d65-aac4-cb89d7c9a1cc req-78c0f1a0-e486-42ee-b988-c0bfa8096632 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.407674 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-424c4dde-4ecc-4d65-aac4-cb89d7c9a1cc req-78c0f1a0-e486-42ee-b988-c0bfa8096632 service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.417878 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-3860a435-374d-49ba-9552-10f3cf1991b2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "DELETE /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 204 len: 0 microversion: 2.1 time: 0.179016 Aug 24 05:46:19.418464 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1761/3632] 10.222.0.97 () {58 vars in 1239 bytes} [Wed Aug 24 05:46:19 2022] DELETE /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 05:46:19.423801 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-424c4dde-4ecc-4d65-aac4-cb89d7c9a1cc req-78c0f1a0-e486-42ee-b988-c0bfa8096632 service nova] Creating event network-changed:6ccb2b6e-02ab-4e12-a51f-cca98516d108 for instance a261b95f-7633-46d9-a6b1-122ebe87d092 on hv-cinder-85426 Aug 24 05:46:19.429132 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-c2ffed37-e8bf-4f0b-90c4-4e91c1538624 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:19.429874 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-c2ffed37-e8bf-4f0b-90c4-4e91c1538624 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:19.430026 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-424c4dde-4ecc-4d65-aac4-cb89d7c9a1cc req-78c0f1a0-e486-42ee-b988-c0bfa8096632 service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.188152 Aug 24 05:46:19.430575 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1872/3633] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 05:46:19.437455 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2ffed37-e8bf-4f0b-90c4-4e91c1538624 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.438040 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2ffed37-e8bf-4f0b-90c4-4e91c1538624 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.438481 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2ffed37-e8bf-4f0b-90c4-4e91c1538624 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.439233 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2ffed37-e8bf-4f0b-90c4-4e91c1538624 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:19.439684 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2ffed37-e8bf-4f0b-90c4-4e91c1538624 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:19.440109 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-c2ffed37-e8bf-4f0b-90c4-4e91c1538624 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:19.590928 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-c2ffed37-e8bf-4f0b-90c4-4e91c1538624 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:19.600119 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-c2ffed37-e8bf-4f0b-90c4-4e91c1538624 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.176116 Aug 24 05:46:19.600713 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1762/3634] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:19 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 05:46:20.623476 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-a3f6f24b-8010-43d9-b881-a915a5d35161 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:20.624420 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.compute.api [None req-a3f6f24b-8010-43d9-b881-a915a5d35161 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120558) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:20.632364 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3f6f24b-8010-43d9-b881-a915a5d35161 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.632949 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3f6f24b-8010-43d9-b881-a915a5d35161 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.633470 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3f6f24b-8010-43d9-b881-a915a5d35161 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:20.634391 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3f6f24b-8010-43d9-b881-a915a5d35161 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:20.634809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3f6f24b-8010-43d9-b881-a915a5d35161 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:20.635246 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [None req-a3f6f24b-8010-43d9-b881-a915a5d35161 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:20.824014 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.policy [None req-a3f6f24b-8010-43d9-b881-a915a5d35161 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120558) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:20.835809 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-a3f6f24b-8010-43d9-b881-a915a5d35161 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1570 microversion: 2.1 time: 0.217253 Aug 24 05:46:20.836531 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1873/3635] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:20 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1570 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:21.857325 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-a8895282-79a2-409b-b546-685d3d05cb8b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:21.857982 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-a8895282-79a2-409b-b546-685d3d05cb8b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:21.865258 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8895282-79a2-409b-b546-685d3d05cb8b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:21.865747 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8895282-79a2-409b-b546-685d3d05cb8b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:21.866185 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8895282-79a2-409b-b546-685d3d05cb8b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:21.866936 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8895282-79a2-409b-b546-685d3d05cb8b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:21.867392 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8895282-79a2-409b-b546-685d3d05cb8b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:21.867814 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-a8895282-79a2-409b-b546-685d3d05cb8b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:22.086279 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [req-f227bd93-0552-4a89-be30-0d66597029d6 req-ea0e0d05-6f85-4bfb-ae71-a9f9049063dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a261b95f-7633-46d9-a6b1-122ebe87d092", "name": "network-vif-deleted", "tag": "6ccb2b6e-02ab-4e12-a51f-cca98516d108"}]} {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 05:46:22.100612 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f227bd93-0552-4a89-be30-0d66597029d6 req-ea0e0d05-6f85-4bfb-ae71-a9f9049063dc service nova] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:22.101064 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f227bd93-0552-4a89-be30-0d66597029d6 req-ea0e0d05-6f85-4bfb-ae71-a9f9049063dc service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:22.101500 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG oslo_concurrency.lockutils [req-f227bd93-0552-4a89-be30-0d66597029d6 req-ea0e0d05-6f85-4bfb-ae71-a9f9049063dc service nova] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120558) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:22.119510 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.policy [None req-a8895282-79a2-409b-b546-685d3d05cb8b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c88814cb3b64bd49d1cdc8d5d2f7f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91c965b644d4fee98c895b269675668', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120557) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 05:46:22.123525 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.compute.server_external_events [req-f227bd93-0552-4a89-be30-0d66597029d6 req-ea0e0d05-6f85-4bfb-ae71-a9f9049063dc service nova] Creating event network-vif-deleted:6ccb2b6e-02ab-4e12-a51f-cca98516d108 for instance a261b95f-7633-46d9-a6b1-122ebe87d092 on hv-cinder-85426 Aug 24 05:46:22.130489 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-a8895282-79a2-409b-b546-685d3d05cb8b tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 200 len: 1451 microversion: 2.1 time: 0.276906 Aug 24 05:46:22.131161 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1763/3636] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:21 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 1451 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 05:46:22.143185 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [req-f227bd93-0552-4a89-be30-0d66597029d6 req-ea0e0d05-6f85-4bfb-ae71-a9f9049063dc service nova] 10.222.0.97 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056927 Aug 24 05:46:22.144632 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1874/3637] 10.222.0.97 () {64 vars in 1317 bytes} [Wed Aug 24 05:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 05:46:23.153599 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '>' {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:23.154234 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.compute.api [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] [instance: a261b95f-7633-46d9-a6b1-122ebe87d092] Fetching instance by UUID {{(pid=120557) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 05:46:23.161494 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:23.161988 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:23.162430 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:23.163172 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Acquiring lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 05:46:23.163629 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 05:46:23.164052 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG oslo_concurrency.lockutils [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Lock "d9a825ce-3fb0-4120-988e-13c2ad98da6a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120557) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 05:46:23.179048 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.wsgi [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] HTTP exception thrown: Instance a261b95f-7633-46d9-a6b1-122ebe87d092 could not be found. Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Request method failure captured: Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: request: GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 HTTP/1.1 Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept: application/json Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Accept-Encoding: identity Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Connection: close Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Length: 0 Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Content-Type: application/json Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Host: 10.222.0.97 Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Openstack-System-Scope: None Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: User-Agent: python-urllib3/1.26.11 Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Auth-Token: gAAAAABjBboFG47bU4m3qcvxvwhzqTXd_bUAvNAu8cY_pby4Mor8O2fGi3QYB5xWqbNYRtE8e_C3aqRPajeAGpXyq4cp-1Ole2rKySaNSrm0kL1mvHpS4jbOYvpJqGMuB5xuIHupJF8cfGl0ku6KfWRxyzsuC-jb4Cv5l7UOQF25WkkhiRBv4Us Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Id: None Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Domain-Name: None Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Identity-Status: Confirmed Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Is-Admin-Project: True Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Id: default Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Domain-Name: Default Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Id: f91c965b644d4fee98c895b269675668 Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Project-Name: tempest-TestShelveInstance-518176570 Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Role: member,reader Aug 24 05:46:23.180722 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Roles: member,reader Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/compute/v2/f91c965b644d4fee98c895b269675668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:8080/v1/AUTH_f91c965b644d4fee98c895b269675668", "adminURL": "http://10.222.0.97:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/f91c965b644d4fee98c895b269675668"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/volume/v3/f91c965b644d4fee98c895b269675668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.97/image"}]}] Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant: tempest-TestShelveInstance-518176570 Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Id: f91c965b644d4fee98c895b269675668 Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-Tenant-Name: tempest-TestShelveInstance-518176570 Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User: tempest-TestShelveInstance-518176570-project Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Id: default Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Domain-Name: Default Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Id: 8c88814cb3b64bd49d1cdc8d5d2f7f6b Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: X-User-Name: tempest-TestShelveInstance-518176570-project Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: method: > Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: exception: Instance a261b95f-7633-46d9-a6b1-122ebe87d092 could not be found. Aug 24 05:46:23.182051 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: action_args: {'id': 'a261b95f-7633-46d9-a6b1-122ebe87d092'} Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: {{(pid=120557) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a261b95f-7633-46d9-a6b1-122ebe87d092 could not be found. Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 05:46:23.183099 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a261b95f-7633-46d9-a6b1-122ebe87d092 could not be found. Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a261b95f-7633-46d9-a6b1-122ebe87d092 could not be found. Aug 24 05:46:23.184744 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: ERROR nova.api.openstack.wsgi Aug 24 05:46:23.186162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: DEBUG nova.api.openstack.wsgi [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Returning 404 to user: Instance a261b95f-7633-46d9-a6b1-122ebe87d092 could not be found. {{(pid=120557) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 05:46:23.186162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO nova.api.openstack.requestlog [None req-1c84f85c-465d-4a6c-b47a-e2d432cec6a2 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092" status: 404 len: 111 microversion: 2.1 time: 0.032520 Aug 24 05:46:23.186162 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: [pid: 120557|app: 0|req: 1764/3638] 10.222.0.97 () {58 vars in 1236 bytes} [Wed Aug 24 05:46:23 2022] GET /compute/v2.1/servers/a261b95f-7633-46d9-a6b1-122ebe87d092 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 05:46:23.383067 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: DEBUG nova.api.openstack.wsgi [None req-798b3a06-1a78-4796-8826-f085289e7b49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] Calling method '.version_select at 0x7f359031d820>' {{(pid=120558) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 05:46:23.413835 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO nova.api.openstack.requestlog [None req-798b3a06-1a78-4796-8826-f085289e7b49 tempest-TestShelveInstance-518176570 tempest-TestShelveInstance-518176570-project] 10.222.0.97 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1726657091" status: 202 len: 0 microversion: 2.1 time: 0.036307 Aug 24 05:46:23.414565 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: [pid: 120558|app: 0|req: 1875/3639] 10.222.0.97 () {58 vars in 1254 bytes} [Wed Aug 24 05:46:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1726657091 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 05:47:26.807682 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:47:26.808378 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:47:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:47:48.799300 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:47:48.799898 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:47:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:49:20.704737 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:49:20.705672 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:49:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:49:21.239726 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:49:21.240347 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:49:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:49:23.693897 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:49:23.694947 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:49:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:49:26.175375 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:49:26.175960 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:49:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:50:46.817862 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:50:46.818608 dv-cinder-854266-1-iscsi devstack@n-api.service[120557]: Wed Aug 24 05:50:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 05:51:08.811520 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 05:51:08.812393 dv-cinder-854266-1-iscsi devstack@n-api.service[120558]: Wed Aug 24 05:51:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!